-- Logs begin at Tue 2022-09-20 21:44:12 UTC, end at Tue 2022-09-20 22:47:47 UTC. -- Sep 20 22:09:18.700881 dv-cinder-858276-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 20 22:09:18.709378 dv-cinder-858276-1-smb devstack@keystone.service[81294]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 20 22:09:18.711968 dv-cinder-858276-1-smb devstack@keystone.service[81294]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Sep 20 22:09:18 2022] *** Sep 20 22:09:18.711968 dv-cinder-858276-1-smb devstack@keystone.service[81294]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 20 22:09:18.711968 dv-cinder-858276-1-smb devstack@keystone.service[81294]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 20 22:09:18.711968 dv-cinder-858276-1-smb devstack@keystone.service[81294]: nodename: dv-cinder-858276-1-smb Sep 20 22:09:18.711968 dv-cinder-858276-1-smb devstack@keystone.service[81294]: machine: x86_64 Sep 20 22:09:18.711968 dv-cinder-858276-1-smb devstack@keystone.service[81294]: clock source: unix Sep 20 22:09:18.711968 dv-cinder-858276-1-smb devstack@keystone.service[81294]: pcre jit disabled Sep 20 22:09:18.711968 dv-cinder-858276-1-smb devstack@keystone.service[81294]: detected number of CPU cores: 4 Sep 20 22:09:18.711968 dv-cinder-858276-1-smb devstack@keystone.service[81294]: current working directory: / Sep 20 22:09:18.711968 dv-cinder-858276-1-smb devstack@keystone.service[81294]: detected binary path: /usr/bin/uwsgi-core Sep 20 22:09:18.711968 dv-cinder-858276-1-smb devstack@keystone.service[81294]: your processes number limit is 47680 Sep 20 22:09:18.712541 dv-cinder-858276-1-smb devstack@keystone.service[81294]: your memory page size is 4096 bytes Sep 20 22:09:18.712541 dv-cinder-858276-1-smb devstack@keystone.service[81294]: detected max file descriptor number: 2048 Sep 20 22:09:18.712541 dv-cinder-858276-1-smb devstack@keystone.service[81294]: lock engine: pthread robust mutexes Sep 20 22:09:18.712541 dv-cinder-858276-1-smb devstack@keystone.service[81294]: thunder lock: enabled Sep 20 22:09:18.712541 dv-cinder-858276-1-smb devstack@keystone.service[81294]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 20 22:09:18.712541 dv-cinder-858276-1-smb devstack@keystone.service[81294]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 20 22:09:18.751112 dv-cinder-858276-1-smb devstack@keystone.service[81294]: Python main interpreter initialized at 0x55a5f1f3d9c0 Sep 20 22:09:18.751112 dv-cinder-858276-1-smb devstack@keystone.service[81294]: python threads support enabled Sep 20 22:09:18.751112 dv-cinder-858276-1-smb devstack@keystone.service[81294]: your server socket listen backlog is limited to 100 connections Sep 20 22:09:18.751112 dv-cinder-858276-1-smb devstack@keystone.service[81294]: your mercy for graceful operations on workers is 90 seconds Sep 20 22:09:18.751443 dv-cinder-858276-1-smb devstack@keystone.service[81294]: mapped 403077 bytes (393 KB) for 2 cores Sep 20 22:09:18.751521 dv-cinder-858276-1-smb devstack@keystone.service[81294]: *** Operational MODE: preforking *** Sep 20 22:09:18.751787 dv-cinder-858276-1-smb devstack@keystone.service[81294]: *** uWSGI is running in multiple interpreter mode *** Sep 20 22:09:18.751787 dv-cinder-858276-1-smb devstack@keystone.service[81294]: spawned uWSGI master process (pid: 81294) Sep 20 22:09:18.751977 dv-cinder-858276-1-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 20 22:09:18.753350 dv-cinder-858276-1-smb devstack@keystone.service[81294]: spawned uWSGI worker 1 (pid: 81306, cores: 1) Sep 20 22:09:18.753350 dv-cinder-858276-1-smb devstack@keystone.service[81294]: spawned uWSGI worker 2 (pid: 81307, cores: 1) Sep 20 22:09:18.753350 dv-cinder-858276-1-smb devstack@keystone.service[81294]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 20 22:09:23.025482 dv-cinder-858276-1-smb devstack@keystone.service[81307]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 20 22:09:23.025482 dv-cinder-858276-1-smb devstack@keystone.service[81307]: from cryptography.utils import int_from_bytes Sep 20 22:09:23.026269 dv-cinder-858276-1-smb devstack@keystone.service[81306]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 20 22:09:23.026269 dv-cinder-858276-1-smb devstack@keystone.service[81306]: from cryptography.utils import int_from_bytes Sep 20 22:09:23.026744 dv-cinder-858276-1-smb devstack@keystone.service[81307]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 20 22:09:23.026744 dv-cinder-858276-1-smb devstack@keystone.service[81307]: from cryptography.utils import int_from_bytes Sep 20 22:09:23.026876 dv-cinder-858276-1-smb devstack@keystone.service[81306]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 20 22:09:23.026876 dv-cinder-858276-1-smb devstack@keystone.service[81306]: from cryptography.utils import int_from_bytes Sep 20 22:09:23.076502 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 20 22:09:23.076643 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 20 22:09:23.076741 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 20 22:09:23.076826 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 20 22:09:23.076903 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] command line args: [] {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 20 22:09:23.076979 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] command line args: [] {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 20 22:09:23.077131 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 20 22:09:23.077265 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 20 22:09:23.077353 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] ================================================================================ {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 20 22:09:23.077433 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] ================================================================================ {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 20 22:09:23.077551 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] admin_token = **** {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:09:23.077636 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] admin_token = **** {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:09:23.077804 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] config_dir = [] {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:09:23.077889 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] config_dir = [] {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:09:23.077987 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:09:23.078064 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:09:23.078169 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] config_source = [] {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:09:23.078252 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] config_source = [] {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:09:23.078333 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] debug = True {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:09:23.078409 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] debug = True {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:09:23.078546 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:09:23.078803 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:09:23.078901 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:09:23.078962 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:09:23.079086 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:09:23.079163 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:09:23.079312 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:09:23.079392 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:09:23.079558 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:09:23.079643 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:09:23.079785 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] list_limit = None {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:09:23.079862 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] list_limit = None {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:09:23.079963 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] log_config_append = None {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:09:23.080042 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] log_config_append = None {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:09:23.080146 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:09:23.080216 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:09:23.080319 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] log_dir = None {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:09:23.080399 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] log_dir = None {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:09:23.080459 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] log_file = None {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:09:23.080522 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] log_file = None {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:09:23.080696 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:09:23.080800 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:09:23.080952 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:09:23.081051 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:09:23.081187 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:09:23.081271 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:09:23.081435 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:09:23.081518 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:09:23.081631 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:09:23.081707 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:09:23.081773 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:09:23.081839 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:09:23.082007 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:09:23.082093 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:09:23.082248 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:09:23.082367 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:09:23.082489 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:09:23.082647 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:09:23.082764 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:09:23.082883 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:09:23.083001 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:09:23.083113 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:09:23.083224 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:09:23.083345 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:09:23.083458 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:09:23.083575 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:09:23.083687 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:09:23.083804 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:09:23.083923 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:09:23.084045 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:09:23.084338 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.33/identity {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:09:23.084463 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.33/identity {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:09:23.084584 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] publish_errors = False {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:09:23.084693 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] publish_errors = False {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:09:23.084810 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:09:23.084929 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:09:23.085049 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:09:23.085173 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:09:23.085286 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:09:23.085403 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:09:23.085521 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:09:23.086145 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:09:23.086273 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:09:23.086387 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:09:23.086387 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] standard_threads = False {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:09:23.086632 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] standard_threads = False {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:09:23.086747 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:09:23.086894 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:09:23.087015 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:09:23.087135 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:09:23.087248 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] use_journal = False {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:09:23.087359 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:09:23.087471 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] use_json = False {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:09:23.087633 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:09:23.087749 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] use_stderr = False {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:09:23.087749 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] use_syslog = False {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:09:23.087960 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] use_journal = False {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:09:23.088073 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:09:23.088185 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] use_json = False {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:09:23.088304 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.088418 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] use_stderr = False {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:09:23.088530 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.088642 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] use_syslog = False {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:09:23.088754 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.088865 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 22:09:23.088985 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.089098 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.089211 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.089329 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.089448 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.089561 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.089768 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.089905 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.090021 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.090133 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.090252 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.090365 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.090485 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.090639 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.090764 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.090867 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.090977 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.091087 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.091206 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.091319 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.091436 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.091584 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.091698 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.091810 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.091930 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.092044 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.092161 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.092276 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.092387 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.092513 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.092640 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.092755 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.092867 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.092978 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.093089 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.093201 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.093391 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.093513 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.093627 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.093738 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.093738 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.093961 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.094074 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.094186 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.094186 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.094396 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.094547 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.094675 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.094795 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.094914 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.095027 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.095138 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.095255 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.095375 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.095489 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.095601 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.095712 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.095822 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.095933 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.096052 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.096199 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.096314 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.096314 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.096523 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.096634 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.096753 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.096872 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.096984 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.097096 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.097213 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.097325 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.097445 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.097445 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.097669 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.097818 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.097933 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.098044 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.098163 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.098276 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.098394 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.098598 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.098716 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.098838 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.099028 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.099028 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.099248 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.099361 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.099472 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.099583 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.099704 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.099823 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.099941 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.100053 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.100171 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.100289 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.100410 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.100529 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.100647 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.100771 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.100883 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.100994 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.101113 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.101232 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.101975 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.102093 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.102204 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.102316 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.102436 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.102576 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.102691 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.102826 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.102933 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.103036 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.103138 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.103233 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.103326 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.103419 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.103513 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.103614 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.103715 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.103832 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.103953 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.104057 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.104174 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.104295 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.104410 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.104531 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.104645 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.104757 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.104870 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.104982 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.105094 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.105214 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.105328 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.105440 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.105551 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.105663 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.105775 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.105895 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.106008 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.106126 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.106240 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.106351 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.106478 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.106645 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.106765 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.106877 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.106991 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.107103 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.107216 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.107336 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.107456 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.107569 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.107671 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.107782 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.107900 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.108023 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.108137 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.108250 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.108368 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.108481 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.108593 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.108712 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.108826 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.108938 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.109051 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.109163 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.109275 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.109394 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.109509 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.109621 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.109733 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.109845 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.109956 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.110076 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.110190 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.110303 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.110415 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.110544 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.110660 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.110852 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.110971 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.111084 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.111198 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.111310 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.111431 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.111553 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.111675 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.111789 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.111901 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.112045 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.112160 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.112274 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.112394 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.112509 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.112621 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.112735 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.112853 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.112967 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.113088 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.113202 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.113316 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.113428 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.113540 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.113652 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.113652 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.113879 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.113992 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.114104 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.114104 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] auth.external = None {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.114352 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.114476 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.114616 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.114616 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] auth.external = None {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.114844 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.114958 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.115071 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.115071 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] auth.password = None {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.115281 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.115403 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] auth.token = None {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.115526 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.115640 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.115753 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] auth.password = None {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.115753 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] auth.token = None {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.115970 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.116092 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.116198 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.116309 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.116422 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.116535 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.116647 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.116767 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.116882 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.116994 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.117106 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.117219 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.117332 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] credential.caching = True {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.117453 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.117573 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.117721 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] credential.caching = True {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.117837 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.117951 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.118063 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.118190 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.118311 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.118426 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.118590 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.118706 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.118819 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.118945 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.119061 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.119174 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.119286 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.119399 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.119512 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.119693 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.119806 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.119925 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.120039 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.120192 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.120309 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.120431 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.120546 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.120661 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.120778 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.120891 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.121011 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.121136 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.121251 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] federation.caching = True {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.121365 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.121485 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.121600 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] federation.caching = True {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.121714 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.121834 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.121949 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.122098 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.122216 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.122329 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.122442 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.122589 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.122714 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.122834 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.122950 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.123063 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.123185 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.123301 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.123415 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.123537 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.123651 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.123766 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.123887 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.124002 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.124115 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] identity.caching = True {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.124227 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.124341 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.124454 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] identity.caching = True {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.124640 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.124757 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.124872 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.124986 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.125105 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.125221 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.125343 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.125458 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.125572 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.125685 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.125799 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.125913 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.126034 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.126149 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.126262 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.126376 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.126489 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.126623 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.126746 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.126861 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.126976 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.127089 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.127202 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.127305 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.127424 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.127538 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.127652 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.127764 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.127877 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.127991 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.127991 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.128214 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.128328 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.128449 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.128564 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.128677 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.128798 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.128913 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.129028 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.129141 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.129254 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.129368 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.129488 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.129608 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.129723 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.129841 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.129956 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.130070 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.130191 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.130306 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.130419 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.130583 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.130700 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.130816 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.130940 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.131056 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.131170 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.131283 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.131397 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.131509 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.131634 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.131749 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.131863 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.131977 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.132090 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.132245 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.132360 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.132474 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.132586 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.132700 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.132812 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.132933 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.133048 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.133162 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.133280 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.133401 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.133515 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.133636 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.133759 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.133874 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.133993 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.134107 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.134221 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.134342 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.134463 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.134590 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.134703 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.134816 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.134929 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.135059 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.135175 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.135175 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.135397 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.135510 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.135623 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.135743 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.135858 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.135971 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.136084 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.136197 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] ldap.user = None {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.136321 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] ldap.user = None {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.136444 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.136559 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.136672 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.136785 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.136898 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.137010 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.137131 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.137252 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.137367 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.137480 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.137593 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.137706 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.137826 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.137941 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.138055 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.138168 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.138280 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.138393 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.138539 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.138656 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.138770 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.138883 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.138995 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.139108 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.139233 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.139349 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.139463 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.139576 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.139689 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.139802 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.139923 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.140038 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.140151 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.140264 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.140377 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.140490 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.140612 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.140726 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.140844 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.140958 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.141071 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.141184 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.141305 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.141419 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.141533 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.141646 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.141759 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.141872 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.141993 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.142107 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.142256 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.142373 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.142486 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.142615 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.142741 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.142857 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.142970 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.143083 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.143196 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.143309 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.143430 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.143544 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.143658 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.143771 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.143884 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.143996 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.144117 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.144232 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.144345 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.144458 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.144571 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.144683 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.144804 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] resource.caching = True {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.144920 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] resource.caching = True {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.145283 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.145402 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.145515 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.145628 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.145750 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.145866 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.145979 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.146092 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.146204 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.146318 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.146439 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.146602 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.146719 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.146833 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.146957 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.147073 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.147259 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.147377 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.147490 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] role.caching = True {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.147604 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] role.caching = True {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.147717 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] role.driver = sql {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.147838 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] role.driver = sql {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.147955 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.148069 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.148680 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.148798 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.148913 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.149035 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.149152 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.149265 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.149378 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.149492 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.149605 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.149726 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.149841 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.149956 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.150069 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.150182 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.150295 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.150295 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.150530 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.150530 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.150750 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.150864 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.150978 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.150978 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.151208 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.151322 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.151436 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.151436 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.151649 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.151649 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.151872 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.151986 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.152101 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.152214 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.152365 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.152491 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.152606 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.152719 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.152833 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.152945 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.153066 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.153182 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.153295 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.153408 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.153521 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.153634 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.153755 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.153870 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.153984 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.154096 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.154210 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.154324 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.154445 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.154607 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.154723 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.154837 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.154950 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.155142 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.155277 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.155394 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.155508 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.155621 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.155734 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.155848 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.155969 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.156085 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] token.caching = True {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.156199 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.156314 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.156427 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] token.caching = True {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.156540 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.156665 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.156781 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.156885 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.156997 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.157111 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.157224 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.157347 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.157462 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.157575 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.157688 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.157801 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.157915 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.158036 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.158151 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.158265 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.158385 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.158500 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.158635 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.158765 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.158881 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.158995 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.159108 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.159222 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.159336 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.159459 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.159574 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.159696 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.159820 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.159936 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.160059 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.160187 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.160303 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] database.connection = **** {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.160417 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.160539 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.160654 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] database.connection = **** {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.160770 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.160884 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.160998 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.161111 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.161233 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.161348 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.161462 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.161576 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.161689 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.161802 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.161924 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.162039 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.162153 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.162267 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.162416 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.162574 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.162702 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.162818 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.162931 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.163044 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.163158 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.163271 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.163393 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.163508 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.163622 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.163736 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.164414 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.164529 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.164652 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.164767 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.164881 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.164995 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.165108 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.165221 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.165343 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 20 22:09:23.165459 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 22:09:23.165459 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 20 22:09:23.192489 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 22:09:23.192671 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 22:09:23.192776 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 22:09:23.192903 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 22:09:23.192988 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 22:09:23.193130 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 22:09:23.201261 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 22:09:23.201506 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 22:09:23.230171 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 22:09:23.230397 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 22:09:23.230481 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 22:09:23.230689 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 22:09:23.283939 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 22:09:23.284303 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 22:09:23.333241 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 22:09:23.333381 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 22:09:23.333467 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 22:09:23.333566 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 22:09:23.490207 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 22:09:23.490407 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 22:09:23.490487 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 22:09:23.490589 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 22:09:23.490688 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 22:09:23.490813 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 22:09:23.490898 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 22:09:23.491031 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 22:09:23.491113 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 22:09:23.491246 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 22:09:23.491337 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 22:09:23.491460 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 22:09:23.514941 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 22:09:23.515184 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 22:09:23.515267 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 22:09:23.515412 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 22:09:23.515494 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 22:09:23.515630 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 22:09:23.515711 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 22:09:23.515847 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 22:09:23.515939 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 22:09:23.516059 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 22:09:23.516183 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 22:09:23.516263 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 22:09:23.516335 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 22:09:23.516468 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 22:09:23.528116 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 22:09:23.528474 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 22:09:23.540778 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 22:09:23.540967 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 22:09:23.541157 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 22:09:23.541255 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 22:09:23.541391 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 22:09:23.541472 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 22:09:23.541616 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 22:09:23.541698 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 22:09:23.541829 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 22:09:23.541911 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 22:09:23.542042 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81306) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 22:09:23.542125 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 22:09:23.542253 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 22:09:23.542465 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81307) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 22:09:23.559213 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.559424 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 20 22:09:23.559595 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.559762 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.559845 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 20 22:09:23.559964 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 20 22:09:23.560129 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.560238 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.560319 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 20 22:09:23.560504 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.560593 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.560767 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.560848 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.561026 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.561107 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.561312 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.571176 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.571458 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.571541 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.571731 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.571812 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.572016 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.572097 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.572296 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.579060 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81306) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 20 22:09:23.579325 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81307) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 20 22:09:23.581980 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81306) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 20 22:09:23.582228 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81307) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 20 22:09:23.582309 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.582525 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.582609 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.582814 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.582908 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.583097 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.583180 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.583360 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.583440 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.583621 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.583703 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.583886 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.583968 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.584153 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.584240 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.584419 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.584499 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.584686 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.584765 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.584950 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.608108 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.608333 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.609582 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81306) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 20 22:09:23.609792 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81307) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 20 22:09:23.609874 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.610075 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.614575 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81306) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 20 22:09:23.614773 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81307) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 20 22:09:23.614855 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.615053 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.615146 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.615330 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.621527 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81306) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 20 22:09:23.621729 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81307) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 20 22:09:23.621813 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.622014 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.627434 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81306) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 20 22:09:23.627608 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81307) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 20 22:09:23.627733 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.627901 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.628025 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.628201 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.628316 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.628467 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.628597 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.628746 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.628877 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.629024 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.629155 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.629293 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.629430 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.629560 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.645574 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.645679 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.645850 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.645934 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.650244 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81307) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 20 22:09:23.650352 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81306) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 20 22:09:23.653452 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.653538 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.653749 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.653832 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.657949 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81307) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 20 22:09:23.658045 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81306) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 20 22:09:23.661138 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81307) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 20 22:09:23.661228 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81306) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 20 22:09:23.664502 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.664603 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.664801 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.664886 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.665086 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.665169 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.665377 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.665461 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.665651 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.665732 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.665941 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.666032 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.682116 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81307) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 20 22:09:23.682235 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81306) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 20 22:09:23.682404 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.682542 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.682701 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.682818 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.682966 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.683083 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.689828 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.689986 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.691395 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.691541 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.692923 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.693081 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.693197 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.693358 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.696467 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81307) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 20 22:09:23.696676 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81306) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 20 22:09:23.696759 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.696944 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.697025 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.697233 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.697318 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.697520 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.697672 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.697919 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.708979 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81307) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 20 22:09:23.709183 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81306) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 20 22:09:23.709267 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.709469 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.709551 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.709751 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.709834 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.710036 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.710164 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.710421 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.710534 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.711306 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.711399 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.711595 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.726991 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81307) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 20 22:09:23.727176 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81306) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 20 22:09:23.729918 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81307) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 20 22:09:23.730091 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81306) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 20 22:09:23.732859 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.733031 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.734289 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.734603 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.735782 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81307) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 20 22:09:23.736063 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.736144 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81306) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 20 22:09:23.736352 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.736445 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.736744 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.742879 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.743258 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.744330 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81307) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 20 22:09:23.744725 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81306) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 20 22:09:23.747268 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.747661 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.747743 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.747944 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.748056 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.748222 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.748343 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.748623 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.756112 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81307) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 20 22:09:23.756409 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.756558 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81306) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 20 22:09:23.756686 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.756851 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.757134 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.764171 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81307) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 20 22:09:23.764452 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.764634 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81306) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 20 22:09:23.764725 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.764919 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.765001 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.765200 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.765290 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.765479 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.765563 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.765755 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.765837 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.766027 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.766119 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.766295 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.766378 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.766592 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.766678 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.766861 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.766941 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.767129 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.767209 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.767392 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.767475 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.767665 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81307) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.767746 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.767928 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.768207 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81306) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 22:09:23.802979 dv-cinder-858276-1-smb devstack@keystone.service[81307]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55a5f1f3d9c0 pid: 81307 (default app) Sep 20 22:09:23.804216 dv-cinder-858276-1-smb devstack@keystone.service[81306]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55a5f1f3d9c0 pid: 81306 (default app) Sep 20 22:09:23.806970 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f68fbde-92b5-423b-8baa-851482e1d442 None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:23.807255 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f68fbde-92b5-423b-8baa-851482e1d442 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:23.807526 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f68fbde-92b5-423b-8baa-851482e1d442 None None] PATH_INFO: `/v3` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:23.811628 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1/1] 10.222.0.33 () {50 vars in 791 bytes} [Tue Sep 20 22:09:23 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:09:30.535609 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a8732f-4e45-4e77-a63b-0540670b2098 None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:30.536101 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a8732f-4e45-4e77-a63b-0540670b2098 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:30.536208 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a8732f-4e45-4e77-a63b-0540670b2098 None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:30.540936 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1/2] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:09:30 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:09:30.546136 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4514e633-3a7d-46b9-83d8-a730aa7cf096 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:30.546602 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4514e633-3a7d-46b9-83d8-a730aa7cf096 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:30.546743 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4514e633-3a7d-46b9-83d8-a730aa7cf096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:30.617721 dv-cinder-858276-1-smb devstack@keystone.service[81307]: INFO dbcounter [None req-4514e633-3a7d-46b9-83d8-a730aa7cf096 None None] Registered counter for database keystone Sep 20 22:09:30.639165 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG oslo_db.sqlalchemy.engines [None req-4514e633-3a7d-46b9-83d8-a730aa7cf096 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81307) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 20 22:09:30.645241 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writer thread running {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 20 22:09:30.823150 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG passlib.handlers.bcrypt [None req-4514e633-3a7d-46b9-83d8-a730aa7cf096 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81307) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 20 22:09:30.823150 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG passlib.handlers.bcrypt [None req-4514e633-3a7d-46b9-83d8-a730aa7cf096 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81307) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 20 22:09:30.880024 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-4514e633-3a7d-46b9-83d8-a730aa7cf096 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:09:30.881621 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-4514e633-3a7d-46b9-83d8-a730aa7cf096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:09:31.008658 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 2/3] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:09:30 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 463 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 20 22:09:31.434418 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a8732f-4e45-4e77-a63b-0540670b2098 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:09:31.504999 dv-cinder-858276-1-smb devstack@keystone.service[81306]: INFO dbcounter [None req-54a8732f-4e45-4e77-a63b-0540670b2098 None None] Registered counter for database keystone Sep 20 22:09:31.526542 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG oslo_db.sqlalchemy.engines [None req-54a8732f-4e45-4e77-a63b-0540670b2098 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81306) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 20 22:09:31.532831 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writer thread running {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 20 22:09:31.651879 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a8732f-4e45-4e77-a63b-0540670b2098 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:09:31.656223 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccba7ee5-13b5-4bfd-a354-23f1adbd2e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:09:31.656845 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccba7ee5-13b5-4bfd-a354-23f1adbd2e2f admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:31.657130 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccba7ee5-13b5-4bfd-a354-23f1adbd2e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:31.657405 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccba7ee5-13b5-4bfd-a354-23f1adbd2e2f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:31.666233 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccba7ee5-13b5-4bfd-a354-23f1adbd2e2f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:09:31.718612 dv-cinder-858276-1-smb devstack@keystone.service[81306]: WARNING keystone.common.rbac_enforcer.enforcer [None req-ccba7ee5-13b5-4bfd-a354-23f1adbd2e2f admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 20 22:09:31.718961 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccba7ee5-13b5-4bfd-a354-23f1adbd2e2f admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:09:31.728268 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 2/4] 10.222.0.33 () {58 vars in 1324 bytes} [Tue Sep 20 22:09:31 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 20 22:09:31.734148 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4514e633-3a7d-46b9-83d8-a730aa7cf096 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:09:31.750651 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4514e633-3a7d-46b9-83d8-a730aa7cf096 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:09:31.754993 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdb95a6-d333-4c41-91bc-7bd22c9eaa1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:09:31.756090 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdb95a6-d333-4c41-91bc-7bd22c9eaa1c admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:31.756369 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdb95a6-d333-4c41-91bc-7bd22c9eaa1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:31.756638 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdb95a6-d333-4c41-91bc-7bd22c9eaa1c admin admin] PATH_INFO: `/v3/projects/b201745482554bcb8321485927bbaae5` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:31.758759 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdb95a6-d333-4c41-91bc-7bd22c9eaa1c admin admin] RBAC: Authorizing `identity:get_project(project_id=b201745482554bcb8321485927bbaae5)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:09:31.811732 dv-cinder-858276-1-smb devstack@keystone.service[81307]: WARNING keystone.common.rbac_enforcer.enforcer [None req-cfdb95a6-d333-4c41-91bc-7bd22c9eaa1c admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 20 22:09:31.812075 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdb95a6-d333-4c41-91bc-7bd22c9eaa1c admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:09:31.816505 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 3/5] 10.222.0.33 () {56 vars in 1207 bytes} [Tue Sep 20 22:09:31 2022] GET /identity/v3/projects/b201745482554bcb8321485927bbaae5 => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:09:33.928089 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573a3caa-7527-4741-9a31-d3241ac50b85 None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:33.928910 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573a3caa-7527-4741-9a31-d3241ac50b85 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:33.928910 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573a3caa-7527-4741-9a31-d3241ac50b85 None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:33.933607 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 3/6] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:09:33 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:09:33.939265 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a916419-0681-44b4-a5d9-03f73506a419 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:33.939668 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a916419-0681-44b4-a5d9-03f73506a419 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:33.939830 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a916419-0681-44b4-a5d9-03f73506a419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:33.959703 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-2a916419-0681-44b4-a5d9-03f73506a419 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:09:33.961248 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-2a916419-0681-44b4-a5d9-03f73506a419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:09:33.969067 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 4/7] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:09:33 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Sep 20 22:09:34.233650 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573a3caa-7527-4741-9a31-d3241ac50b85 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:09:34.246182 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573a3caa-7527-4741-9a31-d3241ac50b85 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:09:34.250324 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481a01ec-980c-4144-af9b-7e5936461cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:09:34.250969 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481a01ec-980c-4144-af9b-7e5936461cd1 admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:34.251253 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481a01ec-980c-4144-af9b-7e5936461cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:34.251529 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481a01ec-980c-4144-af9b-7e5936461cd1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:34.260053 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481a01ec-980c-4144-af9b-7e5936461cd1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:09:34.261801 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481a01ec-980c-4144-af9b-7e5936461cd1 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:09:34.270434 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 4/8] 10.222.0.33 () {58 vars in 1324 bytes} [Tue Sep 20 22:09:34 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 20 22:09:34.275985 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a916419-0681-44b4-a5d9-03f73506a419 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:09:34.284969 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a916419-0681-44b4-a5d9-03f73506a419 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:09:34.289830 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5633ef28-b5ff-443f-94da-556868dd6cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:09:34.290497 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5633ef28-b5ff-443f-94da-556868dd6cf2 admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:34.290811 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5633ef28-b5ff-443f-94da-556868dd6cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:34.291097 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5633ef28-b5ff-443f-94da-556868dd6cf2 admin admin] PATH_INFO: `/v3/users/85f4e64839754c658de5c3fe0e1220a9` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:34.292434 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5633ef28-b5ff-443f-94da-556868dd6cf2 admin admin] RBAC: Authorizing `identity:get_user(user_id=85f4e64839754c658de5c3fe0e1220a9)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:09:34.294609 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5633ef28-b5ff-443f-94da-556868dd6cf2 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:09:34.295820 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 5/9] 10.222.0.33 () {56 vars in 1198 bytes} [Tue Sep 20 22:09:34 2022] GET /identity/v3/users/85f4e64839754c658de5c3fe0e1220a9 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:09:36.497085 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0f8cf1-a9af-4dd8-9afc-0af6c1bab303 None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:36.497610 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0f8cf1-a9af-4dd8-9afc-0af6c1bab303 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:36.497610 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0f8cf1-a9af-4dd8-9afc-0af6c1bab303 None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:36.498975 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 5/10] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:09:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:09:36.504140 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689068d2-6fea-4aac-b8e7-1923b6888552 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:36.504512 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689068d2-6fea-4aac-b8e7-1923b6888552 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:36.504688 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689068d2-6fea-4aac-b8e7-1923b6888552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:36.522574 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-689068d2-6fea-4aac-b8e7-1923b6888552 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:09:36.523809 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-689068d2-6fea-4aac-b8e7-1923b6888552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:09:36.524703 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe2da9-d32a-464b-a326-f07cce160de1 None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:36.524991 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe2da9-d32a-464b-a326-f07cce160de1 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:36.525268 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe2da9-d32a-464b-a326-f07cce160de1 None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:36.526580 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 6/11] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:09:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 20 22:09:36.531546 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcf4a30-47e4-4f64-a851-a791a88907e4 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:36.531831 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcf4a30-47e4-4f64-a851-a791a88907e4 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:36.532106 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcf4a30-47e4-4f64-a851-a791a88907e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:36.574358 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG passlib.handlers.bcrypt [None req-fdcf4a30-47e4-4f64-a851-a791a88907e4 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81306) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 20 22:09:36.574682 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG passlib.handlers.bcrypt [None req-fdcf4a30-47e4-4f64-a851-a791a88907e4 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81306) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 20 22:09:36.605108 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 6/12] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:09:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 22:09:36.623988 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-fdcf4a30-47e4-4f64-a851-a791a88907e4 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:09:36.625556 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-fdcf4a30-47e4-4f64-a851-a791a88907e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:09:36.723706 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 7/13] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:09:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 20 22:09:36.871893 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689068d2-6fea-4aac-b8e7-1923b6888552 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:09:36.897104 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:09:36.977600 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689068d2-6fea-4aac-b8e7-1923b6888552 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:09:36.989958 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcf4a30-47e4-4f64-a851-a791a88907e4 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:09:37.011099 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26357222-9e26-48db-87bc-e70cbf895ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:09:37.011738 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26357222-9e26-48db-87bc-e70cbf895ede None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:37.012022 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26357222-9e26-48db-87bc-e70cbf895ede None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:37.012301 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26357222-9e26-48db-87bc-e70cbf895ede None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:37.023920 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26357222-9e26-48db-87bc-e70cbf895ede None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 22:09:37.032743 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-26357222-9e26-48db-87bc-e70cbf895ede None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 22:09:37.032743 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:09:37.032743 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:09:37.032743 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:09:37.032743 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:09:37.032743 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:09:37.032743 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:09:37.032743 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:09:37.032743 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:09:37.032743 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:09:37.032743 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:09:37.032743 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:09:37.032743 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 22:09:37.032743 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 22:09:37.032743 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 22:09:37.032743 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 22:09:37.033850 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 22:09:37.033850 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 22:09:37.033850 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 22:09:37.033850 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 22:09:37.033850 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:09:37.033850 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:09:37.033850 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:09:37.033850 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:09:37.033850 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:09:37.033850 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:09:37.033850 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:09:37.033850 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:09:37.033850 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:09:37.033850 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:09:37.033850 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:09:37.033850 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:09:37.034825 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:09:37.034825 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:09:37.034825 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:09:37.034825 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:09:37.034825 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 22:09:37.034825 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 22:09:37.034825 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 22:09:37.034825 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 22:09:37.034825 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 22:09:37.034825 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 22:09:37.034825 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 22:09:37.034825 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:09:37.034825 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 7/14] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Sep 20 22:09:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:09:37.039508 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26357222-9e26-48db-87bc-e70cbf895ede None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:09:37.090615 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcf4a30-47e4-4f64-a851-a791a88907e4 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:09:37.092853 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:09:37.119375 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:09:37.127841 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0a1f55-2a01-4422-a1d4-ada02b72186c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:09:37.128644 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0a1f55-2a01-4422-a1d4-ada02b72186c None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:37.128923 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0a1f55-2a01-4422-a1d4-ada02b72186c None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:37.129194 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0a1f55-2a01-4422-a1d4-ada02b72186c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:37.137703 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26357222-9e26-48db-87bc-e70cbf895ede None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:09:37.171427 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc5007f-e04b-44b0-aaf3-298062fb5e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:09:37.172035 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc5007f-e04b-44b0-aaf3-298062fb5e23 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:37.172319 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc5007f-e04b-44b0-aaf3-298062fb5e23 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:37.172595 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc5007f-e04b-44b0-aaf3-298062fb5e23 None admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:37.173263 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc5007f-e04b-44b0-aaf3-298062fb5e23 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:09:37.173568 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc5007f-e04b-44b0-aaf3-298062fb5e23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:09:37.174994 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc5007f-e04b-44b0-aaf3-298062fb5e23 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:09:37.186921 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 8/15] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 20 22:09:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 22:09:37.192308 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc5007f-e04b-44b0-aaf3-298062fb5e23 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:09:37.196469 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0a1f55-2a01-4422-a1d4-ada02b72186c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:09:37.197998 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0a1f55-2a01-4422-a1d4-ada02b72186c None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:09:37.292540 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc5007f-e04b-44b0-aaf3-298062fb5e23 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:09:37.297855 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 8/16] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 20 22:09:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 20 22:09:37.303302 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0a1f55-2a01-4422-a1d4-ada02b72186c None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:09:37.307020 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:09:37.328282 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cc44ff-eb58-46aa-bce5-af9009e3d1ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:09:37.328912 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cc44ff-eb58-46aa-bce5-af9009e3d1ac None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:37.329188 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cc44ff-eb58-46aa-bce5-af9009e3d1ac None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:37.329458 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cc44ff-eb58-46aa-bce5-af9009e3d1ac None admin] PATH_INFO: `/v3/users/85f4e64839754c658de5c3fe0e1220a9` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:37.330617 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cc44ff-eb58-46aa-bce5-af9009e3d1ac None admin] RBAC: Authorizing `identity:get_user(user_id=85f4e64839754c658de5c3fe0e1220a9)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:09:37.332154 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cc44ff-eb58-46aa-bce5-af9009e3d1ac None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:09:37.333693 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 9/17] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Sep 20 22:09:37 2022] GET /identity/v3/users/85f4e64839754c658de5c3fe0e1220a9 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 22:09:37.339602 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cc44ff-eb58-46aa-bce5-af9009e3d1ac None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:09:37.354746 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:09:37.410269 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0a1f55-2a01-4422-a1d4-ada02b72186c None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:09:37.438637 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cc44ff-eb58-46aa-bce5-af9009e3d1ac None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:09:37.443386 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce0e4ed-35de-4b13-9d5a-ee024e1a10e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:09:37.444228 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce0e4ed-35de-4b13-9d5a-ee024e1a10e8 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:37.444503 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce0e4ed-35de-4b13-9d5a-ee024e1a10e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:37.444770 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce0e4ed-35de-4b13-9d5a-ee024e1a10e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:37.463169 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce0e4ed-35de-4b13-9d5a-ee024e1a10e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:09:37.464633 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce0e4ed-35de-4b13-9d5a-ee024e1a10e8 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:09:37.471527 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7466349-b660-46f5-a769-2047115048ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:09:37.472153 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7466349-b660-46f5-a769-2047115048ad None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:37.472432 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7466349-b660-46f5-a769-2047115048ad None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:37.472705 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7466349-b660-46f5-a769-2047115048ad None admin] PATH_INFO: `/v3/domains/default` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:37.473821 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7466349-b660-46f5-a769-2047115048ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:09:37.475267 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7466349-b660-46f5-a769-2047115048ad None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:09:37.482162 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 10/18] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 20 22:09:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 22:09:37.483067 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7466349-b660-46f5-a769-2047115048ad None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:09:37.483645 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-cce0e4ed-35de-4b13-9d5a-ee024e1a10e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:09:37.483645 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:09:37.483645 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:09:37.483645 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:09:37.483645 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:09:37.483645 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:09:37.483645 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:09:37.483645 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:09:37.483645 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:09:37.483645 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:09:37.483645 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:09:37.483645 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:09:37.483645 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 22:09:37.483645 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 22:09:37.483645 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 22:09:37.483645 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 22:09:37.484484 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:09:37.484484 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:09:37.484484 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:09:37.484484 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:09:37.484484 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:09:37.484484 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:09:37.484484 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:09:37.484484 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:09:37.484484 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:09:37.484484 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:09:37.484484 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:09:37.484484 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:09:37.484484 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:09:37.484484 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:09:37.484484 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:09:37.484484 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:09:37.484484 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 22:09:37.485280 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 22:09:37.485280 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:09:37.485280 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:09:37.485280 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 9/19] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 20 22:09:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 20 22:09:37.490305 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce0e4ed-35de-4b13-9d5a-ee024e1a10e8 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:09:37.548054 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:09:37.562368 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:09:37.581158 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7466349-b660-46f5-a769-2047115048ad None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:09:37.594059 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce0e4ed-35de-4b13-9d5a-ee024e1a10e8 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:09:37.614459 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f15e89-8a49-47d3-b438-fa8577c8f10b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:09:37.615086 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f15e89-8a49-47d3-b438-fa8577c8f10b None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:37.615367 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f15e89-8a49-47d3-b438-fa8577c8f10b None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:37.615638 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f15e89-8a49-47d3-b438-fa8577c8f10b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:37.616357 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f15e89-8a49-47d3-b438-fa8577c8f10b None admin] RBAC: Adding query filter params (role.id=8a829170b29d42d6af589399e51edb0f, scope.domain.id=default, user.id=85f4e64839754c658de5c3fe0e1220a9) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:09:37.616666 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f15e89-8a49-47d3-b438-fa8577c8f10b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:09:37.618146 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f15e89-8a49-47d3-b438-fa8577c8f10b None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:09:37.624631 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 11/20] 10.222.0.33 () {56 vars in 1322 bytes} [Tue Sep 20 22:09:37 2022] GET /identity/v3/role_assignments?user.id=85f4e64839754c658de5c3fe0e1220a9&scope.domain.id=default&role.id=8a829170b29d42d6af589399e51edb0f => generated 233 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 22:09:37.627495 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb66073-eb8a-4e8e-8a83-342c41ef9695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:09:37.628114 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb66073-eb8a-4e8e-8a83-342c41ef9695 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:37.628404 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb66073-eb8a-4e8e-8a83-342c41ef9695 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:37.628681 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb66073-eb8a-4e8e-8a83-342c41ef9695 None admin] PATH_INFO: `/v3/domains` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:37.629342 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb66073-eb8a-4e8e-8a83-342c41ef9695 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:09:37.629651 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb66073-eb8a-4e8e-8a83-342c41ef9695 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:09:37.631105 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb66073-eb8a-4e8e-8a83-342c41ef9695 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:09:37.651195 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 10/21] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 20 22:09:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 22:09:40.014777 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6bf176-d8b5-48de-a9aa-a7f9b95ef585 None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:40.015787 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6bf176-d8b5-48de-a9aa-a7f9b95ef585 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:40.016271 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6bf176-d8b5-48de-a9aa-a7f9b95ef585 None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:40.017824 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 12/22] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:09:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:09:40.023329 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc4d5c5-9805-40c8-bb53-e8ed642fe054 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:40.024134 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc4d5c5-9805-40c8-bb53-e8ed642fe054 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:40.024621 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc4d5c5-9805-40c8-bb53-e8ed642fe054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:40.048010 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-8dc4d5c5-9805-40c8-bb53-e8ed642fe054 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:09:40.049612 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-8dc4d5c5-9805-40c8-bb53-e8ed642fe054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:09:40.113585 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0bc307-88be-4afb-a35d-293c6c0ef42f None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:40.114328 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0bc307-88be-4afb-a35d-293c6c0ef42f None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:40.114939 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0bc307-88be-4afb-a35d-293c6c0ef42f None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:40.116724 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 13/23] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:09:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:09:40.121937 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3099f0cf-d017-463d-89bf-5f1bf1899c70 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:40.122477 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3099f0cf-d017-463d-89bf-5f1bf1899c70 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:40.122972 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3099f0cf-d017-463d-89bf-5f1bf1899c70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:40.146896 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 11/24] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:09:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 22:09:40.161422 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-3099f0cf-d017-463d-89bf-5f1bf1899c70 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:09:40.162979 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-3099f0cf-d017-463d-89bf-5f1bf1899c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:09:40.280869 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 14/25] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:09:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 20 22:09:40.372327 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5bd270-e28b-4edf-9f38-e94722e0b725 None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:40.372972 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5bd270-e28b-4edf-9f38-e94722e0b725 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:40.373444 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5bd270-e28b-4edf-9f38-e94722e0b725 None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:40.375313 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 12/26] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:09:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:09:40.380127 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6199c18-ebf3-4d92-9812-7f00f5200cf0 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:40.380423 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6199c18-ebf3-4d92-9812-7f00f5200cf0 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:40.380708 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6199c18-ebf3-4d92-9812-7f00f5200cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:40.411501 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-e6199c18-ebf3-4d92-9812-7f00f5200cf0 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:09:40.412705 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-e6199c18-ebf3-4d92-9812-7f00f5200cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:09:40.496988 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 15/27] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:09:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 22:09:40.690273 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5bd270-e28b-4edf-9f38-e94722e0b725 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:09:40.754118 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:09:40.802062 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6199c18-ebf3-4d92-9812-7f00f5200cf0 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:09:40.806587 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:09:40.835535 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5bd270-e28b-4edf-9f38-e94722e0b725 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:09:40.905055 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa908d38-d448-4539-9f97-67bf11908a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:09:40.905988 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa908d38-d448-4539-9f97-67bf11908a8d None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:40.906423 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa908d38-d448-4539-9f97-67bf11908a8d None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:40.906873 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa908d38-d448-4539-9f97-67bf11908a8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:40.930226 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa908d38-d448-4539-9f97-67bf11908a8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:09:40.931976 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa908d38-d448-4539-9f97-67bf11908a8d None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:09:40.962300 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-aa908d38-d448-4539-9f97-67bf11908a8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:09:40.962300 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:09:40.962300 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:09:40.962300 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:09:40.962300 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:09:40.962300 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:09:40.962300 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:09:40.962300 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:09:40.962300 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:09:40.962300 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:09:40.962300 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:09:40.962300 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:09:40.962300 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 22:09:40.962300 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 22:09:40.962300 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 22:09:40.962300 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 22:09:40.963379 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:09:40.963379 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:09:40.963379 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:09:40.963379 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:09:40.963379 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:09:40.963379 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:09:40.963379 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:09:40.963379 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:09:40.963379 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:09:40.963379 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:09:40.963379 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:09:40.963379 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:09:40.963379 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:09:40.963379 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:09:40.963379 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:09:40.963379 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:09:40.963379 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 22:09:40.964621 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 22:09:40.964621 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:09:40.964621 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:09:40.964621 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 13/28] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 20 22:09:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:09:40.964621 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa908d38-d448-4539-9f97-67bf11908a8d None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:09:40.985416 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6199c18-ebf3-4d92-9812-7f00f5200cf0 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:09:41.044663 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb66d9c-36bf-4fdf-9acc-4f40667be53c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:09:41.046095 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb66d9c-36bf-4fdf-9acc-4f40667be53c None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:41.046613 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb66d9c-36bf-4fdf-9acc-4f40667be53c None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:41.047028 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb66d9c-36bf-4fdf-9acc-4f40667be53c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:41.059316 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb66d9c-36bf-4fdf-9acc-4f40667be53c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 22:09:41.064568 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-8fb66d9c-36bf-4fdf-9acc-4f40667be53c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 22:09:41.064568 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:09:41.064568 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:09:41.064568 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:09:41.064568 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:09:41.064568 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:09:41.064568 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:09:41.064568 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:09:41.064568 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:09:41.064568 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:09:41.064568 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:09:41.064568 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:09:41.064568 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 22:09:41.064568 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 22:09:41.064568 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 22:09:41.064568 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 22:09:41.065554 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 22:09:41.065554 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 22:09:41.065554 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 22:09:41.065554 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 22:09:41.065554 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:09:41.065554 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:09:41.065554 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:09:41.065554 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:09:41.065554 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:09:41.065554 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:09:41.065554 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:09:41.065554 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:09:41.065554 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:09:41.065554 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:09:41.065554 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:09:41.065554 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:09:41.066308 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:09:41.066308 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:09:41.066308 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:09:41.066308 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:09:41.066308 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 22:09:41.066308 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 22:09:41.066308 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 22:09:41.066308 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 22:09:41.066308 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 22:09:41.066308 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 22:09:41.066308 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 22:09:41.066308 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:09:41.068459 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 16/29] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Sep 20 22:09:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:09:41.069383 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb66d9c-36bf-4fdf-9acc-4f40667be53c None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:09:41.096196 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:09:41.100276 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa908d38-d448-4539-9f97-67bf11908a8d None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:09:41.136985 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2347982-7f16-4a35-9a15-ebf25b177af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:09:41.137671 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2347982-7f16-4a35-9a15-ebf25b177af0 None admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:41.138258 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2347982-7f16-4a35-9a15-ebf25b177af0 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:41.138786 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2347982-7f16-4a35-9a15-ebf25b177af0 None admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:41.139214 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:09:41.140766 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2347982-7f16-4a35-9a15-ebf25b177af0 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:09:41.142318 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2347982-7f16-4a35-9a15-ebf25b177af0 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:09:41.183000 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb66d9c-36bf-4fdf-9acc-4f40667be53c None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:09:41.219762 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eae943f-0d49-49a2-b31c-9faa328bbdbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:09:41.220350 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eae943f-0d49-49a2-b31c-9faa328bbdbe None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:41.220632 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eae943f-0d49-49a2-b31c-9faa328bbdbe None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:41.220944 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eae943f-0d49-49a2-b31c-9faa328bbdbe None admin] PATH_INFO: `/v3/domains` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:41.221645 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eae943f-0d49-49a2-b31c-9faa328bbdbe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:09:41.221951 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eae943f-0d49-49a2-b31c-9faa328bbdbe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:09:41.223554 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eae943f-0d49-49a2-b31c-9faa328bbdbe None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:09:41.242800 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 17/30] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 20 22:09:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:09:41.243971 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8b5f67-7c7e-4cdc-b4b3-26ec583c21d6 None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:41.244254 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8b5f67-7c7e-4cdc-b4b3-26ec583c21d6 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:41.244525 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8b5f67-7c7e-4cdc-b4b3-26ec583c21d6 None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:41.250229 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 18/31] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:09:41 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:09:41.250971 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8b5f67-7c7e-4cdc-b4b3-26ec583c21d6 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:09:41.276445 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 14/32] 10.222.0.33 () {60 vars in 1131 bytes} [Tue Sep 20 22:09:40 2022] POST /identity/v3/roles => generated 219 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:09:41.277935 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2347982-7f16-4a35-9a15-ebf25b177af0 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:09:41.392048 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8b5f67-7c7e-4cdc-b4b3-26ec583c21d6 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:09:41.458762 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:09:41.483796 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825485ac-4870-401b-a4eb-e2f389f9cef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:09:41.484416 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825485ac-4870-401b-a4eb-e2f389f9cef5 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:41.484608 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825485ac-4870-401b-a4eb-e2f389f9cef5 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:41.484900 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825485ac-4870-401b-a4eb-e2f389f9cef5 None admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:41.485581 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825485ac-4870-401b-a4eb-e2f389f9cef5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:09:41.485888 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825485ac-4870-401b-a4eb-e2f389f9cef5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:09:41.487312 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825485ac-4870-401b-a4eb-e2f389f9cef5 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:09:41.487718 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2347982-7f16-4a35-9a15-ebf25b177af0 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:09:41.506451 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 19/33] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 20 22:09:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:09:41.508187 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1a337a-ee4c-4438-baaa-dad146a87e56 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:41.508474 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1a337a-ee4c-4438-baaa-dad146a87e56 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:41.508752 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1a337a-ee4c-4438-baaa-dad146a87e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:41.532579 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c6ced1-c91d-4537-8ad2-48f6c71ce5dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:09:41.533859 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c6ced1-c91d-4537-8ad2-48f6c71ce5dd None admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:41.534311 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c6ced1-c91d-4537-8ad2-48f6c71ce5dd None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:41.534847 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c6ced1-c91d-4537-8ad2-48f6c71ce5dd None admin] PATH_INFO: `/v3/projects` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:41.535972 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c6ced1-c91d-4537-8ad2-48f6c71ce5dd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:09:41.537330 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-de1a337a-ee4c-4438-baaa-dad146a87e56 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:09:41.537991 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c6ced1-c91d-4537-8ad2-48f6c71ce5dd None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:09:41.538761 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-de1a337a-ee4c-4438-baaa-dad146a87e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:09:41.582427 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 15/34] 10.222.0.33 () {60 vars in 1141 bytes} [Tue Sep 20 22:09:41 2022] POST /identity/v3/projects => generated 301 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:09:41.583776 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c6ced1-c91d-4537-8ad2-48f6c71ce5dd None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:09:41.599275 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:09:41.633470 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 20/35] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:09:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 22:09:41.740280 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c6ced1-c91d-4537-8ad2-48f6c71ce5dd None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:09:41.783972 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3452b3a6-969c-418d-8bf7-42c2c1f23f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:09:41.784682 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3452b3a6-969c-418d-8bf7-42c2c1f23f09 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:41.784965 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3452b3a6-969c-418d-8bf7-42c2c1f23f09 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:41.785241 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3452b3a6-969c-418d-8bf7-42c2c1f23f09 None admin] PATH_INFO: `/v3/users/85f4e64839754c658de5c3fe0e1220a9` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:41.791704 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3452b3a6-969c-418d-8bf7-42c2c1f23f09 None admin] RBAC: Authorizing `identity:get_user(user_id=85f4e64839754c658de5c3fe0e1220a9)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:09:41.793216 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3452b3a6-969c-418d-8bf7-42c2c1f23f09 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:09:41.795230 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 16/36] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Sep 20 22:09:41 2022] GET /identity/v3/users/85f4e64839754c658de5c3fe0e1220a9 => generated 247 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:09:41.800990 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1a337a-ee4c-4438-baaa-dad146a87e56 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:09:41.933875 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3452b3a6-969c-418d-8bf7-42c2c1f23f09 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:09:41.944687 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1a337a-ee4c-4438-baaa-dad146a87e56 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:09:41.975604 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:09:42.005883 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667c617c-75b7-4d75-b999-d87d27ced2c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:09:42.006483 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c617c-75b7-4d75-b999-d87d27ced2c3 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:42.006856 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c617c-75b7-4d75-b999-d87d27ced2c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:42.007124 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c617c-75b7-4d75-b999-d87d27ced2c3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:42.008805 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667c617c-75b7-4d75-b999-d87d27ced2c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:09:42.010260 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667c617c-75b7-4d75-b999-d87d27ced2c3 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:09:42.011927 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 21/37] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 20 22:09:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:09:42.017588 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667c617c-75b7-4d75-b999-d87d27ced2c3 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:09:42.043889 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:09:42.073839 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3452b3a6-969c-418d-8bf7-42c2c1f23f09 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:09:42.108329 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0316f6ce-a25a-4d56-b3aa-1945518566f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:09:42.108977 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0316f6ce-a25a-4d56-b3aa-1945518566f9 None admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:42.109205 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0316f6ce-a25a-4d56-b3aa-1945518566f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:42.109474 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0316f6ce-a25a-4d56-b3aa-1945518566f9 None admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:42.110140 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0316f6ce-a25a-4d56-b3aa-1945518566f9 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:09:42.111555 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0316f6ce-a25a-4d56-b3aa-1945518566f9 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:09:42.125220 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 17/38] 10.222.0.33 () {60 vars in 1131 bytes} [Tue Sep 20 22:09:41 2022] POST /identity/v3/roles => generated 225 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 20 22:09:42.126501 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b550f-2358-41c8-a9b2-11fc8ecd66b0 None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:42.126840 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b550f-2358-41c8-a9b2-11fc8ecd66b0 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:42.127104 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b550f-2358-41c8-a9b2-11fc8ecd66b0 None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:42.128329 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 18/39] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:09:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:09:42.129362 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542e86c7-e04a-4fe1-9dc3-f619b53b1602 None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:42.129645 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542e86c7-e04a-4fe1-9dc3-f619b53b1602 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:42.129921 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542e86c7-e04a-4fe1-9dc3-f619b53b1602 None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:42.131364 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 19/40] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:09:42 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:09:42.133769 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7392f950-db92-4fad-8cbf-c8b0d8742943 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:42.134054 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7392f950-db92-4fad-8cbf-c8b0d8742943 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:42.134332 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7392f950-db92-4fad-8cbf-c8b0d8742943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:42.139475 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667c617c-75b7-4d75-b999-d87d27ced2c3 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:09:42.165689 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-7392f950-db92-4fad-8cbf-c8b0d8742943 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:09:42.168000 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-7392f950-db92-4fad-8cbf-c8b0d8742943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:09:42.179333 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17097a1c-b538-49e6-9ea2-5f058a60c0db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:09:42.180043 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17097a1c-b538-49e6-9ea2-5f058a60c0db None admin] REQUEST_METHOD: `PUT` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:42.180439 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17097a1c-b538-49e6-9ea2-5f058a60c0db None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:42.180719 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17097a1c-b538-49e6-9ea2-5f058a60c0db None admin] PATH_INFO: `/v3/domains/default/users/85f4e64839754c658de5c3fe0e1220a9/roles/8a829170b29d42d6af589399e51edb0f` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:42.182947 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17097a1c-b538-49e6-9ea2-5f058a60c0db None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=85f4e64839754c658de5c3fe0e1220a9, role_id=8a829170b29d42d6af589399e51edb0f)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:09:42.184669 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17097a1c-b538-49e6-9ea2-5f058a60c0db None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:09:42.254535 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 20/41] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:09:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 20 22:09:42.254535 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429c34f3-ac51-46a4-b401-b740509b21e0 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:42.254535 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429c34f3-ac51-46a4-b401-b740509b21e0 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:42.254535 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429c34f3-ac51-46a4-b401-b740509b21e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:42.273870 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-429c34f3-ac51-46a4-b401-b740509b21e0 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:09:42.275256 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-429c34f3-ac51-46a4-b401-b740509b21e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:09:42.354600 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:09:42.365473 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 21/42] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:09:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 22:09:42.419351 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 22/43] 10.222.0.33 () {58 vars in 1361 bytes} [Tue Sep 20 22:09:42 2022] PUT /identity/v3/domains/default/users/85f4e64839754c658de5c3fe0e1220a9/roles/8a829170b29d42d6af589399e51edb0f => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 22:09:42.545253 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429c34f3-ac51-46a4-b401-b740509b21e0 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:09:42.639249 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17097a1c-b538-49e6-9ea2-5f058a60c0db None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:09:42.651169 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429c34f3-ac51-46a4-b401-b740509b21e0 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:09:42.688837 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4951cd0-da4c-4af4-8707-357b57870c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:09:42.689479 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4951cd0-da4c-4af4-8707-357b57870c0b None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:42.689757 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4951cd0-da4c-4af4-8707-357b57870c0b None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:42.690035 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4951cd0-da4c-4af4-8707-357b57870c0b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:42.690694 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:09:42.691164 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4951cd0-da4c-4af4-8707-357b57870c0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:09:42.692649 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4951cd0-da4c-4af4-8707-357b57870c0b None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:09:42.698587 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 22/44] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 20 22:09:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:09:42.700632 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4951cd0-da4c-4af4-8707-357b57870c0b None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:09:42.751438 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17097a1c-b538-49e6-9ea2-5f058a60c0db None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:09:42.769422 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:09:42.789056 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48178694-112e-431e-a2e9-10a1c7a1925a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:09:42.789680 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48178694-112e-431e-a2e9-10a1c7a1925a None admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:42.789963 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48178694-112e-431e-a2e9-10a1c7a1925a None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:42.790238 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48178694-112e-431e-a2e9-10a1c7a1925a None admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:42.790955 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48178694-112e-431e-a2e9-10a1c7a1925a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:09:42.792550 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48178694-112e-431e-a2e9-10a1c7a1925a None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:09:42.807794 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4951cd0-da4c-4af4-8707-357b57870c0b None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:09:42.812337 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 23/45] 10.222.0.33 () {60 vars in 1131 bytes} [Tue Sep 20 22:09:42 2022] POST /identity/v3/roles => generated 223 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 20 22:09:42.849577 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a426f2e-d486-4e18-b26b-e8b7984ba23d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:09:42.850207 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a426f2e-d486-4e18-b26b-e8b7984ba23d None admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:42.850488 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a426f2e-d486-4e18-b26b-e8b7984ba23d None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:42.850792 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a426f2e-d486-4e18-b26b-e8b7984ba23d None admin] PATH_INFO: `/v3/projects` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:42.851493 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a426f2e-d486-4e18-b26b-e8b7984ba23d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:09:42.852962 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a426f2e-d486-4e18-b26b-e8b7984ba23d None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:09:42.883796 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 23/46] 10.222.0.33 () {60 vars in 1141 bytes} [Tue Sep 20 22:09:42 2022] POST /identity/v3/projects => generated 312 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 20 22:09:44.564089 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e8c253-944c-4483-9b86-31ba185f5f1e None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:44.564585 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e8c253-944c-4483-9b86-31ba185f5f1e None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:44.564585 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e8c253-944c-4483-9b86-31ba185f5f1e None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:44.565910 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 24/47] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:09:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:09:44.571281 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8ba2da-f8ee-4604-bb04-3f21868fb515 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:44.571668 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8ba2da-f8ee-4604-bb04-3f21868fb515 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:44.571836 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8ba2da-f8ee-4604-bb04-3f21868fb515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:44.589575 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-1f8ba2da-f8ee-4604-bb04-3f21868fb515 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:09:44.590786 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-1f8ba2da-f8ee-4604-bb04-3f21868fb515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:09:44.654386 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 24/48] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:09:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 20 22:09:44.918193 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e8c253-944c-4483-9b86-31ba185f5f1e None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:09:45.024977 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e8c253-944c-4483-9b86-31ba185f5f1e None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:09:45.027345 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:09:45.058429 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5012d6-384f-4c4c-afef-1f020933025c None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:45.058748 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5012d6-384f-4c4c-afef-1f020933025c None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:45.059024 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5012d6-384f-4c4c-afef-1f020933025c None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:45.060485 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 25/49] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:09:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 20 22:09:45.060771 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fb4516-4cf2-47c2-9c90-56c38e492dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:09:45.061435 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb4516-4cf2-47c2-9c90-56c38e492dca None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:45.061720 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb4516-4cf2-47c2-9c90-56c38e492dca None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:45.062002 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb4516-4cf2-47c2-9c90-56c38e492dca None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:45.065031 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779febe2-9988-4e1d-bf67-cc212a8b45dc None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:45.065316 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779febe2-9988-4e1d-bf67-cc212a8b45dc None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:45.065591 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779febe2-9988-4e1d-bf67-cc212a8b45dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:45.072316 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fb4516-4cf2-47c2-9c90-56c38e492dca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 22:09:45.077160 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-05fb4516-4cf2-47c2-9c90-56c38e492dca None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 22:09:45.077160 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:09:45.077160 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:09:45.077160 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:09:45.077160 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:09:45.077160 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:09:45.077160 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:09:45.077160 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:09:45.077160 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:09:45.077160 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:09:45.077160 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:09:45.077160 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:09:45.077160 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 22:09:45.077160 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 22:09:45.077160 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 22:09:45.077160 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 22:09:45.077960 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 22:09:45.077960 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 22:09:45.077960 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 22:09:45.077960 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 22:09:45.077960 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:09:45.077960 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:09:45.077960 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:09:45.077960 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:09:45.077960 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:09:45.077960 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:09:45.077960 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:09:45.077960 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:09:45.077960 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:09:45.077960 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:09:45.077960 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:09:45.077960 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:09:45.078726 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:09:45.078726 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:09:45.078726 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:09:45.078726 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:09:45.078726 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 22:09:45.078726 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 22:09:45.078726 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 22:09:45.078726 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 22:09:45.078726 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 22:09:45.078726 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 22:09:45.078726 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 22:09:45.078726 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:09:45.078726 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 25/50] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Sep 20 22:09:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:09:45.083461 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-779febe2-9988-4e1d-bf67-cc212a8b45dc None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:09:45.083773 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fb4516-4cf2-47c2-9c90-56c38e492dca None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:09:45.084653 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-779febe2-9988-4e1d-bf67-cc212a8b45dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:09:45.129102 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:09:45.153451 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 26/51] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:09:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 20 22:09:45.184260 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fb4516-4cf2-47c2-9c90-56c38e492dca None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:09:45.217759 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedc5c6a-8a03-4dc0-91b4-821a54b79dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:09:45.218364 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedc5c6a-8a03-4dc0-91b4-821a54b79dcf None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:45.218685 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedc5c6a-8a03-4dc0-91b4-821a54b79dcf None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:45.218961 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedc5c6a-8a03-4dc0-91b4-821a54b79dcf None admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:45.219649 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedc5c6a-8a03-4dc0-91b4-821a54b79dcf None admin] RBAC: Adding query filter params (name=admin) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:09:45.219955 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedc5c6a-8a03-4dc0-91b4-821a54b79dcf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:09:45.221338 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedc5c6a-8a03-4dc0-91b4-821a54b79dcf None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:09:45.229294 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 26/52] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 20 22:09:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 22:09:45.234904 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779febe2-9988-4e1d-bf67-cc212a8b45dc None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:09:45.334037 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779febe2-9988-4e1d-bf67-cc212a8b45dc None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:09:45.366394 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025fe85b-25b1-4251-9bbe-181bb0c4c477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:09:45.367078 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025fe85b-25b1-4251-9bbe-181bb0c4c477 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:45.367362 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025fe85b-25b1-4251-9bbe-181bb0c4c477 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:45.367637 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025fe85b-25b1-4251-9bbe-181bb0c4c477 None admin] PATH_INFO: `/v3/users/85f4e64839754c658de5c3fe0e1220a9` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:45.368748 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025fe85b-25b1-4251-9bbe-181bb0c4c477 None admin] RBAC: Authorizing `identity:get_user(user_id=85f4e64839754c658de5c3fe0e1220a9)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:09:45.370189 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025fe85b-25b1-4251-9bbe-181bb0c4c477 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:09:45.371774 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 27/53] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Sep 20 22:09:45 2022] GET /identity/v3/users/85f4e64839754c658de5c3fe0e1220a9 => generated 247 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:09:45.377103 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedc5c6a-8a03-4dc0-91b4-821a54b79dcf None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:09:45.406070 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:09:45.420884 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025fe85b-25b1-4251-9bbe-181bb0c4c477 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:09:45.468839 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:09:45.480129 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedc5c6a-8a03-4dc0-91b4-821a54b79dcf None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:09:45.513891 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e4eedf-799d-424d-82fb-6a69dac9a771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:09:45.514623 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e4eedf-799d-424d-82fb-6a69dac9a771 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:45.514907 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e4eedf-799d-424d-82fb-6a69dac9a771 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:45.515180 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e4eedf-799d-424d-82fb-6a69dac9a771 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:45.516378 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e4eedf-799d-424d-82fb-6a69dac9a771 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:09:45.517820 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e4eedf-799d-424d-82fb-6a69dac9a771 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:09:45.519430 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 27/54] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 20 22:09:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:09:45.521817 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025fe85b-25b1-4251-9bbe-181bb0c4c477 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:09:45.526037 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e4eedf-799d-424d-82fb-6a69dac9a771 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:09:45.563415 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9595150-92f1-490b-8bdc-2a7fda820683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:09:45.564285 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9595150-92f1-490b-8bdc-2a7fda820683 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:45.564770 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9595150-92f1-490b-8bdc-2a7fda820683 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:45.565058 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9595150-92f1-490b-8bdc-2a7fda820683 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:45.566221 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9595150-92f1-490b-8bdc-2a7fda820683 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:09:45.568395 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9595150-92f1-490b-8bdc-2a7fda820683 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:09:45.571601 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 28/55] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 20 22:09:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 22:09:45.578307 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9595150-92f1-490b-8bdc-2a7fda820683 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:09:45.637541 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:09:45.645902 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e4eedf-799d-424d-82fb-6a69dac9a771 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:09:45.683932 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0ac465-4d16-4377-913a-0da8bac282ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:09:45.684559 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0ac465-4d16-4377-913a-0da8bac282ea None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:45.684850 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0ac465-4d16-4377-913a-0da8bac282ea None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:45.685127 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0ac465-4d16-4377-913a-0da8bac282ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:45.685864 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0ac465-4d16-4377-913a-0da8bac282ea None admin] RBAC: Adding query filter params (role.id=8a829170b29d42d6af589399e51edb0f, scope.domain.id=default, user.id=85f4e64839754c658de5c3fe0e1220a9) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:09:45.686175 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0ac465-4d16-4377-913a-0da8bac282ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:09:45.687706 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0ac465-4d16-4377-913a-0da8bac282ea None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:09:45.694265 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 28/56] 10.222.0.33 () {56 vars in 1322 bytes} [Tue Sep 20 22:09:45 2022] GET /identity/v3/role_assignments?user.id=85f4e64839754c658de5c3fe0e1220a9&scope.domain.id=default&role.id=8a829170b29d42d6af589399e51edb0f => generated 530 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:09:45.783037 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9595150-92f1-490b-8bdc-2a7fda820683 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:09:45.797438 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:09:45.818861 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac34846-ce93-4be1-91b0-eb772488263f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:09:45.819494 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac34846-ce93-4be1-91b0-eb772488263f None admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:45.819785 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac34846-ce93-4be1-91b0-eb772488263f None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:45.820134 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac34846-ce93-4be1-91b0-eb772488263f None admin] PATH_INFO: `/v3/projects` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:45.821348 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac34846-ce93-4be1-91b0-eb772488263f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:09:45.822833 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac34846-ce93-4be1-91b0-eb772488263f None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:09:45.850376 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 29/57] 10.222.0.33 () {60 vars in 1140 bytes} [Tue Sep 20 22:09:45 2022] POST /identity/v3/projects => generated 298 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 20 22:09:47.999111 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a14c96f-9166-40d0-9639-97d12b48ddf0 None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:47.999622 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a14c96f-9166-40d0-9639-97d12b48ddf0 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:47.999702 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a14c96f-9166-40d0-9639-97d12b48ddf0 None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:48.001010 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 29/58] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:09:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:09:48.006193 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c81e3-5a63-47ba-9426-4b6630c1b6c5 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:48.006629 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c81e3-5a63-47ba-9426-4b6630c1b6c5 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:48.006773 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c81e3-5a63-47ba-9426-4b6630c1b6c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:48.024767 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-7c2c81e3-5a63-47ba-9426-4b6630c1b6c5 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:09:48.025954 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-7c2c81e3-5a63-47ba-9426-4b6630c1b6c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:09:48.089040 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 30/59] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:09:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 22:09:48.361307 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a14c96f-9166-40d0-9639-97d12b48ddf0 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:09:48.460459 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a14c96f-9166-40d0-9639-97d12b48ddf0 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:09:48.493096 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761f1c9d-0596-42aa-aead-32d2a36959c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:09:48.493716 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761f1c9d-0596-42aa-aead-32d2a36959c9 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:48.493997 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761f1c9d-0596-42aa-aead-32d2a36959c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:48.494271 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761f1c9d-0596-42aa-aead-32d2a36959c9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:48.495405 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761f1c9d-0596-42aa-aead-32d2a36959c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:09:48.496866 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761f1c9d-0596-42aa-aead-32d2a36959c9 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:09:48.498421 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 30/60] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 20 22:09:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:09:48.503916 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2c81e3-5a63-47ba-9426-4b6630c1b6c5 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:09:48.594020 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:09:48.600012 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2c81e3-5a63-47ba-9426-4b6630c1b6c5 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:09:48.634045 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a4bce2-e9cc-4fe8-abc2-62211d178b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:09:48.634672 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a4bce2-e9cc-4fe8-abc2-62211d178b1c None admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:48.634952 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a4bce2-e9cc-4fe8-abc2-62211d178b1c None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:48.635225 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a4bce2-e9cc-4fe8-abc2-62211d178b1c None admin] PATH_INFO: `/v3/users` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:48.635874 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a4bce2-e9cc-4fe8-abc2-62211d178b1c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:09:48.637305 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a4bce2-e9cc-4fe8-abc2-62211d178b1c None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:09:48.662065 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 31/61] 10.222.0.33 () {60 vars in 1132 bytes} [Tue Sep 20 22:09:48 2022] POST /identity/v3/users => generated 275 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 20 22:09:51.943377 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225239ae-8c9d-44ad-9507-369f2a084a45 None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:51.943879 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225239ae-8c9d-44ad-9507-369f2a084a45 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:51.943951 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225239ae-8c9d-44ad-9507-369f2a084a45 None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:51.945554 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 31/62] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:09:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:09:51.960277 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7380e08-ca69-4f00-9975-62962d818a5b None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:51.960847 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7380e08-ca69-4f00-9975-62962d818a5b None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:51.961034 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7380e08-ca69-4f00-9975-62962d818a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:51.987769 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-d7380e08-ca69-4f00-9975-62962d818a5b None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:09:51.989026 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-d7380e08-ca69-4f00-9975-62962d818a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:09:52.080806 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 32/63] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:09:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 22:09:52.127233 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b07279-58ff-4c63-bc16-2eefd017a343 None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:52.127521 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b07279-58ff-4c63-bc16-2eefd017a343 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:52.127964 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b07279-58ff-4c63-bc16-2eefd017a343 None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:52.129478 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 32/64] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:09:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:09:52.135162 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dba1745-3073-43e6-bc7c-659fcff6d85d None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:52.135449 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dba1745-3073-43e6-bc7c-659fcff6d85d None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:52.135729 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dba1745-3073-43e6-bc7c-659fcff6d85d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:52.163804 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-4dba1745-3073-43e6-bc7c-659fcff6d85d None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:09:52.165016 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-4dba1745-3073-43e6-bc7c-659fcff6d85d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:09:52.268846 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 33/65] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:09:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 22:09:52.325685 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f80498-c512-48f0-9861-a713a4e55d8e None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:52.326271 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f80498-c512-48f0-9861-a713a4e55d8e None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:52.326795 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f80498-c512-48f0-9861-a713a4e55d8e None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:52.328672 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 33/66] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:09:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:09:52.333615 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306cff73-f9d1-40c8-9e82-88ab826ac077 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:52.333907 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306cff73-f9d1-40c8-9e82-88ab826ac077 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:52.334187 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306cff73-f9d1-40c8-9e82-88ab826ac077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:52.363513 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-306cff73-f9d1-40c8-9e82-88ab826ac077 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:09:52.364714 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-306cff73-f9d1-40c8-9e82-88ab826ac077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:09:52.373179 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:09:52.459245 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 34/67] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:09:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 22:09:52.505196 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d3084c-abfb-4430-81ad-23d628141c8c None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:52.505804 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d3084c-abfb-4430-81ad-23d628141c8c None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:52.506310 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d3084c-abfb-4430-81ad-23d628141c8c None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:52.507929 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 34/68] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:09:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:09:52.513111 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a968e3-045c-445a-b36e-b52a326a648b None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:52.513401 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a968e3-045c-445a-b36e-b52a326a648b None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:52.513677 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a968e3-045c-445a-b36e-b52a326a648b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:52.540227 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-89a968e3-045c-445a-b36e-b52a326a648b None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:09:52.541433 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-89a968e3-045c-445a-b36e-b52a326a648b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:09:52.590944 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d3084c-abfb-4430-81ad-23d628141c8c None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:09:52.623457 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:09:52.624957 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 35/69] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:09:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 22:09:52.626593 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb71bd2-cf13-4313-b10c-e5dbef241755 None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:52.626895 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb71bd2-cf13-4313-b10c-e5dbef241755 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:52.627242 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb71bd2-cf13-4313-b10c-e5dbef241755 None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:52.628473 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 36/70] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:09:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:09:52.630645 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb71bd2-cf13-4313-b10c-e5dbef241755 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:09:52.715076 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:09:52.721859 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d3084c-abfb-4430-81ad-23d628141c8c None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:09:52.751279 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb71bd2-cf13-4313-b10c-e5dbef241755 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:09:52.755927 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272e44e4-2097-406d-a410-e2b0a4da3a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:09:52.756757 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272e44e4-2097-406d-a410-e2b0a4da3a1d None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:52.757213 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272e44e4-2097-406d-a410-e2b0a4da3a1d None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:52.758238 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272e44e4-2097-406d-a410-e2b0a4da3a1d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:52.768532 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272e44e4-2097-406d-a410-e2b0a4da3a1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 22:09:52.774172 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-272e44e4-2097-406d-a410-e2b0a4da3a1d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 20 22:09:52.774172 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:09:52.774172 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:09:52.774172 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:09:52.774172 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:09:52.774172 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:09:52.774172 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:09:52.774172 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:09:52.774172 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:09:52.774172 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:09:52.774172 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:09:52.774172 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:09:52.774172 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 22:09:52.774172 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 22:09:52.774172 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 22:09:52.774172 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 22:09:52.775107 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 22:09:52.775107 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 22:09:52.775107 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 22:09:52.775107 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 22:09:52.775107 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:09:52.775107 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:09:52.775107 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:09:52.775107 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:09:52.775107 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:09:52.775107 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:09:52.775107 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:09:52.775107 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:09:52.775107 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:09:52.775107 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:09:52.775107 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:09:52.775107 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:09:52.775855 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:09:52.775855 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:09:52.775855 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:09:52.775855 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:09:52.775855 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 22:09:52.775855 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 22:09:52.775855 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 22:09:52.775855 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 22:09:52.775855 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 22:09:52.775855 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 22:09:52.775855 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 20 22:09:52.775855 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:09:52.778393 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 35/71] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 20 22:09:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:09:52.779820 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55002092-9382-4b46-9389-b3acc256494f None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:52.780297 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55002092-9382-4b46-9389-b3acc256494f None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:52.780758 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55002092-9382-4b46-9389-b3acc256494f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:52.790858 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b07c2f-6e87-41f8-8866-d2cdadae8a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:09:52.791485 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b07c2f-6e87-41f8-8866-d2cdadae8a96 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:52.791825 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b07c2f-6e87-41f8-8866-d2cdadae8a96 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:52.792109 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b07c2f-6e87-41f8-8866-d2cdadae8a96 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:52.800070 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-55002092-9382-4b46-9389-b3acc256494f None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:09:52.801813 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-55002092-9382-4b46-9389-b3acc256494f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:09:52.804714 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b07c2f-6e87-41f8-8866-d2cdadae8a96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 22:09:52.813697 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-d1b07c2f-6e87-41f8-8866-d2cdadae8a96 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 22:09:52.813697 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:09:52.813697 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:09:52.813697 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:09:52.813697 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:09:52.813697 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:09:52.813697 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:09:52.813697 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:09:52.813697 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:09:52.813697 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:09:52.813697 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:09:52.813697 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:09:52.813697 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 22:09:52.813697 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 22:09:52.813697 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 22:09:52.813697 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 22:09:52.814575 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 22:09:52.814575 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 22:09:52.814575 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 22:09:52.814575 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 22:09:52.814575 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:09:52.814575 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:09:52.814575 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:09:52.814575 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:09:52.814575 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:09:52.814575 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:09:52.814575 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:09:52.814575 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:09:52.814575 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:09:52.814575 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:09:52.814575 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:09:52.814575 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:09:52.815321 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:09:52.815321 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:09:52.815321 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:09:52.815321 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:09:52.815321 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 22:09:52.815321 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 22:09:52.815321 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 22:09:52.815321 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 22:09:52.815321 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 22:09:52.815321 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 22:09:52.815321 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 22:09:52.815321 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:09:52.815321 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 37/72] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Sep 20 22:09:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:09:52.816023 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b07c2f-6e87-41f8-8866-d2cdadae8a96 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:09:52.879504 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 36/73] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:09:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 22:09:52.884399 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55002092-9382-4b46-9389-b3acc256494f None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:09:52.909472 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:09:52.938930 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b07c2f-6e87-41f8-8866-d2cdadae8a96 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:09:52.971081 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:09:52.977778 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453f0699-9629-4103-bd12-96fa8c3e0352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:09:52.978398 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453f0699-9629-4103-bd12-96fa8c3e0352 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:52.978701 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453f0699-9629-4103-bd12-96fa8c3e0352 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:52.979135 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453f0699-9629-4103-bd12-96fa8c3e0352 None admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:52.979845 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453f0699-9629-4103-bd12-96fa8c3e0352 None admin] RBAC: Adding query filter params (name=member) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:09:52.980107 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453f0699-9629-4103-bd12-96fa8c3e0352 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:09:52.981486 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453f0699-9629-4103-bd12-96fa8c3e0352 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:09:52.998070 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 38/74] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Sep 20 22:09:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:09:52.998070 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453f0699-9629-4103-bd12-96fa8c3e0352 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:09:52.998289 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55002092-9382-4b46-9389-b3acc256494f None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:09:53.033093 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7220c1d1-a14f-4320-89d4-28e45a18009e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:09:53.033777 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7220c1d1-a14f-4320-89d4-28e45a18009e None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:53.034060 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7220c1d1-a14f-4320-89d4-28e45a18009e None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:53.034386 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7220c1d1-a14f-4320-89d4-28e45a18009e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:53.044761 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7220c1d1-a14f-4320-89d4-28e45a18009e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 22:09:53.049624 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-7220c1d1-a14f-4320-89d4-28e45a18009e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 20 22:09:53.049624 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:09:53.049624 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:09:53.049624 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:09:53.049624 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:09:53.049624 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:09:53.049624 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:09:53.049624 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:09:53.049624 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:09:53.049624 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:09:53.049624 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:09:53.049624 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:09:53.049624 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 22:09:53.049624 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 22:09:53.049624 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 22:09:53.049624 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 22:09:53.050437 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 22:09:53.050437 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 22:09:53.050437 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 22:09:53.050437 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 22:09:53.050437 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:09:53.050437 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:09:53.050437 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:09:53.050437 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:09:53.050437 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:09:53.050437 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:09:53.050437 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:09:53.050437 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:09:53.050437 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:09:53.050437 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:09:53.050437 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:09:53.050437 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:09:53.055594 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:09:53.055594 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:09:53.055594 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:09:53.055594 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:09:53.055594 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 22:09:53.055594 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 22:09:53.055594 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 22:09:53.055594 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 22:09:53.055594 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 22:09:53.055594 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 22:09:53.055594 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 20 22:09:53.055594 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:09:53.055594 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 37/75] 10.222.0.33 () {56 vars in 1114 bytes} [Tue Sep 20 22:09:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:09:53.055594 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7220c1d1-a14f-4320-89d4-28e45a18009e None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:09:53.105926 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453f0699-9629-4103-bd12-96fa8c3e0352 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:09:53.137365 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:09:53.144190 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec980f7-ac3a-4da9-9cca-e9cffe159cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:09:53.144809 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec980f7-ac3a-4da9-9cca-e9cffe159cf4 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:53.145084 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec980f7-ac3a-4da9-9cca-e9cffe159cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:53.145549 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec980f7-ac3a-4da9-9cca-e9cffe159cf4 None admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:53.146374 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec980f7-ac3a-4da9-9cca-e9cffe159cf4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:09:53.146848 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec980f7-ac3a-4da9-9cca-e9cffe159cf4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:09:53.148263 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec980f7-ac3a-4da9-9cca-e9cffe159cf4 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:09:53.156264 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 39/76] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 20 22:09:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:09:53.161678 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec980f7-ac3a-4da9-9cca-e9cffe159cf4 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:09:53.162321 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7220c1d1-a14f-4320-89d4-28e45a18009e None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:09:53.197469 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eb6781-6a7f-4d77-9065-cc0ec0050db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:09:53.198196 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb6781-6a7f-4d77-9065-cc0ec0050db5 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:53.198578 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb6781-6a7f-4d77-9065-cc0ec0050db5 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:53.198859 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb6781-6a7f-4d77-9065-cc0ec0050db5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:53.209985 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eb6781-6a7f-4d77-9065-cc0ec0050db5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 22:09:53.214837 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-d1eb6781-6a7f-4d77-9065-cc0ec0050db5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 20 22:09:53.214837 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:09:53.214837 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:09:53.214837 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:09:53.214837 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:09:53.214837 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:09:53.214837 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:09:53.214837 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:09:53.214837 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:09:53.214837 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:09:53.214837 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:09:53.214837 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:09:53.214837 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 22:09:53.214837 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 22:09:53.214837 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 22:09:53.214837 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 22:09:53.215686 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 22:09:53.215686 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 22:09:53.215686 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 22:09:53.215686 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 22:09:53.215686 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:09:53.215686 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:09:53.215686 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:09:53.215686 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:09:53.215686 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:09:53.215686 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:09:53.215686 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:09:53.215686 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:09:53.215686 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:09:53.215686 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:09:53.215686 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:09:53.215686 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:09:53.216865 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:09:53.216865 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:09:53.216865 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:09:53.216865 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:09:53.216865 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 22:09:53.216865 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 22:09:53.216865 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 22:09:53.216865 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 22:09:53.216865 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 22:09:53.216865 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 22:09:53.216865 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 20 22:09:53.216865 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:09:53.216865 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 38/77] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 20 22:09:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:09:53.216865 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eb6781-6a7f-4d77-9065-cc0ec0050db5 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:09:53.219801 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:09:53.265742 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec980f7-ac3a-4da9-9cca-e9cffe159cf4 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:09:53.300659 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91403b05-20c3-43b7-94f0-81a3ebea720f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:09:53.301301 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91403b05-20c3-43b7-94f0-81a3ebea720f None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:53.301580 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91403b05-20c3-43b7-94f0-81a3ebea720f None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:53.301856 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91403b05-20c3-43b7-94f0-81a3ebea720f None admin] PATH_INFO: `/v3/users/353bf7be83974c0e8e94f1044be36966` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:53.316326 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eb6781-6a7f-4d77-9065-cc0ec0050db5 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:09:53.317448 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91403b05-20c3-43b7-94f0-81a3ebea720f None admin] RBAC: Authorizing `identity:get_user(user_id=353bf7be83974c0e8e94f1044be36966)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:09:53.318953 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91403b05-20c3-43b7-94f0-81a3ebea720f None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:09:53.321175 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 40/78] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Sep 20 22:09:53 2022] GET /identity/v3/users/353bf7be83974c0e8e94f1044be36966 => generated 275 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:09:53.321938 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91403b05-20c3-43b7-94f0-81a3ebea720f None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:09:53.351885 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbae703-752d-4b4a-ae91-67c6fae16b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:09:53.352506 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbae703-752d-4b4a-ae91-67c6fae16b1c None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:53.352792 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbae703-752d-4b4a-ae91-67c6fae16b1c None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:53.353072 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbae703-752d-4b4a-ae91-67c6fae16b1c None admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:53.353747 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbae703-752d-4b4a-ae91-67c6fae16b1c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:09:53.354059 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbae703-752d-4b4a-ae91-67c6fae16b1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:09:53.355553 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbae703-752d-4b4a-ae91-67c6fae16b1c None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:09:53.357686 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:09:53.364110 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 39/79] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Sep 20 22:09:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:09:53.364896 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbae703-752d-4b4a-ae91-67c6fae16b1c None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:09:53.421803 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91403b05-20c3-43b7-94f0-81a3ebea720f None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:09:53.436253 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:09:53.456884 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1014144e-2bc8-4bda-91d6-45ebf8dfad54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:09:53.457516 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1014144e-2bc8-4bda-91d6-45ebf8dfad54 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:53.457800 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1014144e-2bc8-4bda-91d6-45ebf8dfad54 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:53.458079 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1014144e-2bc8-4bda-91d6-45ebf8dfad54 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:53.459219 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1014144e-2bc8-4bda-91d6-45ebf8dfad54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:09:53.460704 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1014144e-2bc8-4bda-91d6-45ebf8dfad54 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:09:53.462254 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 41/80] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 20 22:09:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:09:53.463042 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1014144e-2bc8-4bda-91d6-45ebf8dfad54 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:09:53.467371 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbae703-752d-4b4a-ae91-67c6fae16b1c None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:09:53.500719 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c429fd05-b2cb-4968-94ea-9f781a314be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:09:53.501348 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c429fd05-b2cb-4968-94ea-9f781a314be2 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:53.501638 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c429fd05-b2cb-4968-94ea-9f781a314be2 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:53.501912 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c429fd05-b2cb-4968-94ea-9f781a314be2 None admin] PATH_INFO: `/v3/users/85f4e64839754c658de5c3fe0e1220a9` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:53.503075 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c429fd05-b2cb-4968-94ea-9f781a314be2 None admin] RBAC: Authorizing `identity:get_user(user_id=85f4e64839754c658de5c3fe0e1220a9)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:09:53.504539 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c429fd05-b2cb-4968-94ea-9f781a314be2 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:09:53.506092 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 40/81] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Sep 20 22:09:53 2022] GET /identity/v3/users/85f4e64839754c658de5c3fe0e1220a9 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:09:53.506874 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c429fd05-b2cb-4968-94ea-9f781a314be2 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:09:53.565657 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1014144e-2bc8-4bda-91d6-45ebf8dfad54 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:09:53.571282 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:09:53.598534 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20b43f9-9c06-4f36-a546-56e0fd8ee9dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:09:53.599147 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20b43f9-9c06-4f36-a546-56e0fd8ee9dd None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:53.599430 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20b43f9-9c06-4f36-a546-56e0fd8ee9dd None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:53.599714 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20b43f9-9c06-4f36-a546-56e0fd8ee9dd None admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:53.600374 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20b43f9-9c06-4f36-a546-56e0fd8ee9dd None admin] RBAC: Adding query filter params (name=member) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:09:53.600683 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20b43f9-9c06-4f36-a546-56e0fd8ee9dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:09:53.602614 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20b43f9-9c06-4f36-a546-56e0fd8ee9dd None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:09:53.605470 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c429fd05-b2cb-4968-94ea-9f781a314be2 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:09:53.610388 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 42/82] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Sep 20 22:09:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:09:53.611360 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20b43f9-9c06-4f36-a546-56e0fd8ee9dd None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:09:53.641643 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5596ad0d-9a86-476f-a9b6-ceb69545f5b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:09:53.642254 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5596ad0d-9a86-476f-a9b6-ceb69545f5b1 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:53.642562 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5596ad0d-9a86-476f-a9b6-ceb69545f5b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:53.642842 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5596ad0d-9a86-476f-a9b6-ceb69545f5b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:53.657550 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:09:53.707950 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5596ad0d-9a86-476f-a9b6-ceb69545f5b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:09:53.709422 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5596ad0d-9a86-476f-a9b6-ceb69545f5b1 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:09:53.713231 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20b43f9-9c06-4f36-a546-56e0fd8ee9dd None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:09:53.748534 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fa8201-52e3-4283-98fe-c2402ab41b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:09:53.749512 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fa8201-52e3-4283-98fe-c2402ab41b6b None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:53.749800 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fa8201-52e3-4283-98fe-c2402ab41b6b None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:53.750076 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fa8201-52e3-4283-98fe-c2402ab41b6b None admin] PATH_INFO: `/v3/users/353bf7be83974c0e8e94f1044be36966` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:53.751610 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fa8201-52e3-4283-98fe-c2402ab41b6b None admin] RBAC: Authorizing `identity:get_user(user_id=353bf7be83974c0e8e94f1044be36966)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:09:53.753051 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fa8201-52e3-4283-98fe-c2402ab41b6b None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:09:53.754809 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 43/83] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Sep 20 22:09:53 2022] GET /identity/v3/users/353bf7be83974c0e8e94f1044be36966 => generated 275 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:09:53.755389 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fa8201-52e3-4283-98fe-c2402ab41b6b None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:09:53.777360 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:09:53.812056 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 41/84] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 20 22:09:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 20 22:09:53.812914 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5596ad0d-9a86-476f-a9b6-ceb69545f5b1 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:09:53.854889 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fa8201-52e3-4283-98fe-c2402ab41b6b None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:09:53.867509 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:09:53.887707 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae10cd0-c125-4e3a-9279-2a806ccece82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:09:53.888301 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae10cd0-c125-4e3a-9279-2a806ccece82 None admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:53.888579 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae10cd0-c125-4e3a-9279-2a806ccece82 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:53.888848 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae10cd0-c125-4e3a-9279-2a806ccece82 None admin] PATH_INFO: `/v3/users` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:53.889495 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae10cd0-c125-4e3a-9279-2a806ccece82 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:09:53.890967 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae10cd0-c125-4e3a-9279-2a806ccece82 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:09:53.913115 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 44/85] 10.222.0.33 () {60 vars in 1132 bytes} [Tue Sep 20 22:09:53 2022] POST /identity/v3/users => generated 289 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:09:53.914549 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae10cd0-c125-4e3a-9279-2a806ccece82 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:09:53.914652 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5596ad0d-9a86-476f-a9b6-ceb69545f5b1 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:09:53.957351 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238a310e-39f4-4df8-8e84-fc949f0d31fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:09:53.958014 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a310e-39f4-4df8-8e84-fc949f0d31fe None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:53.958302 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a310e-39f4-4df8-8e84-fc949f0d31fe None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:53.958606 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a310e-39f4-4df8-8e84-fc949f0d31fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:53.999589 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:09:54.037167 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238a310e-39f4-4df8-8e84-fc949f0d31fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:09:54.039432 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238a310e-39f4-4df8-8e84-fc949f0d31fe None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:09:54.042146 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae10cd0-c125-4e3a-9279-2a806ccece82 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:09:54.088392 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4463007-231f-42a1-ba0c-f63b4b41d12a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:09:54.088730 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4463007-231f-42a1-ba0c-f63b4b41d12a None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:54.089014 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4463007-231f-42a1-ba0c-f63b4b41d12a None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:54.089291 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4463007-231f-42a1-ba0c-f63b4b41d12a None admin] PATH_INFO: `/v3/users/353bf7be83974c0e8e94f1044be36966` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:54.090796 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4463007-231f-42a1-ba0c-f63b4b41d12a None admin] RBAC: Authorizing `identity:get_user(user_id=353bf7be83974c0e8e94f1044be36966)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:09:54.092254 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4463007-231f-42a1-ba0c-f63b4b41d12a None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:09:54.093995 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 45/86] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Sep 20 22:09:53 2022] GET /identity/v3/users/353bf7be83974c0e8e94f1044be36966 => generated 275 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:09:54.094616 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4463007-231f-42a1-ba0c-f63b4b41d12a None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:09:54.137515 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:09:54.154234 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 42/87] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 20 22:09:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 20 22:09:54.155122 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238a310e-39f4-4df8-8e84-fc949f0d31fe None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:09:54.227465 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4463007-231f-42a1-ba0c-f63b4b41d12a None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:09:54.238488 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:09:54.271087 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1b9193-6200-4401-86b5-41a2c13a9465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:09:54.271705 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1b9193-6200-4401-86b5-41a2c13a9465 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:54.271992 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1b9193-6200-4401-86b5-41a2c13a9465 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:54.272275 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1b9193-6200-4401-86b5-41a2c13a9465 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:54.283606 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238a310e-39f4-4df8-8e84-fc949f0d31fe None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:09:54.327217 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6aba91-0768-45ef-96f8-1a4446b95b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:09:54.328215 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6aba91-0768-45ef-96f8-1a4446b95b7f None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:54.328678 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6aba91-0768-45ef-96f8-1a4446b95b7f None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:54.329125 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6aba91-0768-45ef-96f8-1a4446b95b7f None admin] PATH_INFO: `/v3/projects/be4987daebfd4f378eb4bc9efc68e66c` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:54.330488 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6aba91-0768-45ef-96f8-1a4446b95b7f None admin] RBAC: Authorizing `identity:get_project(project_id=be4987daebfd4f378eb4bc9efc68e66c)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:09:54.332156 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6aba91-0768-45ef-96f8-1a4446b95b7f None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:09:54.334266 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 43/88] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Sep 20 22:09:54 2022] GET /identity/v3/projects/be4987daebfd4f378eb4bc9efc68e66c => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:09:54.335322 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6aba91-0768-45ef-96f8-1a4446b95b7f None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:09:54.362068 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1b9193-6200-4401-86b5-41a2c13a9465 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:09:54.363809 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1b9193-6200-4401-86b5-41a2c13a9465 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:09:54.406497 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:09:54.464105 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6aba91-0768-45ef-96f8-1a4446b95b7f None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:09:54.498629 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 46/89] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 20 22:09:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 20 22:09:54.500238 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1b9193-6200-4401-86b5-41a2c13a9465 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:09:54.506035 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edc64fa-789d-4730-8706-d153f9009dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:09:54.506697 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edc64fa-789d-4730-8706-d153f9009dd9 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:54.506983 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edc64fa-789d-4730-8706-d153f9009dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:54.507260 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edc64fa-789d-4730-8706-d153f9009dd9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:54.510261 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:09:54.588718 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edc64fa-789d-4730-8706-d153f9009dd9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:09:54.590860 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edc64fa-789d-4730-8706-d153f9009dd9 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:09:54.639917 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1b9193-6200-4401-86b5-41a2c13a9465 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:09:54.680391 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2387012-d8b3-40db-99fc-d85e4624a5b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:09:54.680955 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2387012-d8b3-40db-99fc-d85e4624a5b4 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:54.681241 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2387012-d8b3-40db-99fc-d85e4624a5b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:54.681521 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2387012-d8b3-40db-99fc-d85e4624a5b4 None admin] PATH_INFO: `/v3/projects/be4987daebfd4f378eb4bc9efc68e66c` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:54.682799 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2387012-d8b3-40db-99fc-d85e4624a5b4 None admin] RBAC: Authorizing `identity:get_project(project_id=be4987daebfd4f378eb4bc9efc68e66c)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:09:54.684351 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2387012-d8b3-40db-99fc-d85e4624a5b4 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:09:54.686353 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 47/90] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Sep 20 22:09:54 2022] GET /identity/v3/projects/be4987daebfd4f378eb4bc9efc68e66c => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:09:54.687522 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2387012-d8b3-40db-99fc-d85e4624a5b4 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:09:54.691905 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:09:54.713793 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 44/91] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 20 22:09:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 20 22:09:54.715034 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edc64fa-789d-4730-8706-d153f9009dd9 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:09:54.753006 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:09:54.812161 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2387012-d8b3-40db-99fc-d85e4624a5b4 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:09:54.828344 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edc64fa-789d-4730-8706-d153f9009dd9 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:09:54.854330 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca53f56-0721-40cf-a554-ae4243bb6728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:09:54.855308 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca53f56-0721-40cf-a554-ae4243bb6728 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:54.855509 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca53f56-0721-40cf-a554-ae4243bb6728 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:54.855792 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca53f56-0721-40cf-a554-ae4243bb6728 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:54.856596 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca53f56-0721-40cf-a554-ae4243bb6728 None admin] RBAC: Adding query filter params (role.id=604444e7ad0d437dbd1f5a6e02b761f5, scope.project.id=be4987daebfd4f378eb4bc9efc68e66c, user.id=353bf7be83974c0e8e94f1044be36966) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:09:54.856842 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca53f56-0721-40cf-a554-ae4243bb6728 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:09:54.858622 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca53f56-0721-40cf-a554-ae4243bb6728 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:09:54.868507 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05a801a-5127-4e5f-b883-a35ad04fa12c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:09:54.869076 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 48/92] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Sep 20 22:09:54 2022] GET /identity/v3/role_assignments?user.id=353bf7be83974c0e8e94f1044be36966&scope.project.id=be4987daebfd4f378eb4bc9efc68e66c&role.id=604444e7ad0d437dbd1f5a6e02b761f5 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:09:54.869658 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a801a-5127-4e5f-b883-a35ad04fa12c None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:54.870157 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a801a-5127-4e5f-b883-a35ad04fa12c None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:54.870670 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a801a-5127-4e5f-b883-a35ad04fa12c None admin] PATH_INFO: `/v3/projects/be4987daebfd4f378eb4bc9efc68e66c` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:54.875428 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca53f56-0721-40cf-a554-ae4243bb6728 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:09:54.876547 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05a801a-5127-4e5f-b883-a35ad04fa12c None admin] RBAC: Authorizing `identity:get_project(project_id=be4987daebfd4f378eb4bc9efc68e66c)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:09:54.878277 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05a801a-5127-4e5f-b883-a35ad04fa12c None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:09:54.880910 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 45/93] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Sep 20 22:09:54 2022] GET /identity/v3/projects/be4987daebfd4f378eb4bc9efc68e66c => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:09:54.885423 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05a801a-5127-4e5f-b883-a35ad04fa12c None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:09:55.003203 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:09:55.041443 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca53f56-0721-40cf-a554-ae4243bb6728 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:09:55.080415 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2e07d5-62dd-4dee-ba77-b7cdd516a249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:09:55.081153 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2e07d5-62dd-4dee-ba77-b7cdd516a249 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:55.081398 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2e07d5-62dd-4dee-ba77-b7cdd516a249 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:55.081581 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2e07d5-62dd-4dee-ba77-b7cdd516a249 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:55.082323 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2e07d5-62dd-4dee-ba77-b7cdd516a249 None admin] RBAC: Adding query filter params (role.id=8a829170b29d42d6af589399e51edb0f, scope.project.id=be4987daebfd4f378eb4bc9efc68e66c, user.id=85f4e64839754c658de5c3fe0e1220a9) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:09:55.082674 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2e07d5-62dd-4dee-ba77-b7cdd516a249 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:09:55.084303 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2e07d5-62dd-4dee-ba77-b7cdd516a249 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:09:55.095741 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 49/94] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Sep 20 22:09:54 2022] GET /identity/v3/role_assignments?user.id=85f4e64839754c658de5c3fe0e1220a9&scope.project.id=be4987daebfd4f378eb4bc9efc68e66c&role.id=8a829170b29d42d6af589399e51edb0f => generated 259 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:09:55.096933 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2e07d5-62dd-4dee-ba77-b7cdd516a249 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:09:55.103897 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05a801a-5127-4e5f-b883-a35ad04fa12c None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:09:55.109106 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:09:55.176738 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cfd91e-e43b-4827-8a91-e48be4f282e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:09:55.177406 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cfd91e-e43b-4827-8a91-e48be4f282e0 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:55.177691 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cfd91e-e43b-4827-8a91-e48be4f282e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:55.177964 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cfd91e-e43b-4827-8a91-e48be4f282e0 None admin] PATH_INFO: `/v3/projects/ac207cd789b74f988a87a52d5f481c84` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:55.182406 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cfd91e-e43b-4827-8a91-e48be4f282e0 None admin] RBAC: Authorizing `identity:get_project(project_id=ac207cd789b74f988a87a52d5f481c84)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:09:55.182406 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cfd91e-e43b-4827-8a91-e48be4f282e0 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:09:55.183381 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 46/95] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Sep 20 22:09:54 2022] GET /identity/v3/projects/ac207cd789b74f988a87a52d5f481c84 => generated 312 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:09:55.189935 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cfd91e-e43b-4827-8a91-e48be4f282e0 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:09:55.326357 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2e07d5-62dd-4dee-ba77-b7cdd516a249 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:09:55.382285 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cfd91e-e43b-4827-8a91-e48be4f282e0 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:09:55.397817 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:09:55.406029 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa35dd1-5803-4f4d-9007-a0e36550a15f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:09:55.407434 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa35dd1-5803-4f4d-9007-a0e36550a15f None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:55.408896 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa35dd1-5803-4f4d-9007-a0e36550a15f None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:55.409186 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa35dd1-5803-4f4d-9007-a0e36550a15f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:55.411365 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa35dd1-5803-4f4d-9007-a0e36550a15f None admin] RBAC: Adding query filter params (role.id=4e75d58a1e0e4fffa940914b1e5f46de, scope.project.id=be4987daebfd4f378eb4bc9efc68e66c, user.id=353bf7be83974c0e8e94f1044be36966) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:09:55.411690 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa35dd1-5803-4f4d-9007-a0e36550a15f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:09:55.413176 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa35dd1-5803-4f4d-9007-a0e36550a15f None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:09:55.430496 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 50/96] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Sep 20 22:09:55 2022] GET /identity/v3/role_assignments?user.id=353bf7be83974c0e8e94f1044be36966&scope.project.id=be4987daebfd4f378eb4bc9efc68e66c&role.id=4e75d58a1e0e4fffa940914b1e5f46de => generated 259 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:09:55.446474 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b042319-c398-4e83-affd-fe19c89002d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:09:55.447140 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b042319-c398-4e83-affd-fe19c89002d0 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:55.447424 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b042319-c398-4e83-affd-fe19c89002d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:55.447701 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b042319-c398-4e83-affd-fe19c89002d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:55.448454 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b042319-c398-4e83-affd-fe19c89002d0 None admin] RBAC: Adding query filter params (role.id=604444e7ad0d437dbd1f5a6e02b761f5, scope.project.id=ac207cd789b74f988a87a52d5f481c84, user.id=353bf7be83974c0e8e94f1044be36966) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:09:55.448770 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b042319-c398-4e83-affd-fe19c89002d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:09:55.450271 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b042319-c398-4e83-affd-fe19c89002d0 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:09:55.456780 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 47/97] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Sep 20 22:09:55 2022] GET /identity/v3/role_assignments?user.id=353bf7be83974c0e8e94f1044be36966&scope.project.id=ac207cd789b74f988a87a52d5f481c84&role.id=604444e7ad0d437dbd1f5a6e02b761f5 => generated 259 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 22:09:56.718414 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eb6067-d5c5-44fd-8c55-a96954278244 None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:56.719000 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eb6067-d5c5-44fd-8c55-a96954278244 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:56.719000 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eb6067-d5c5-44fd-8c55-a96954278244 None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:56.720471 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 51/98] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:09:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:09:56.727115 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73420121-084b-45ad-ad7b-cc9fc97bcf66 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:56.727679 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73420121-084b-45ad-ad7b-cc9fc97bcf66 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:56.727679 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73420121-084b-45ad-ad7b-cc9fc97bcf66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:56.749136 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-73420121-084b-45ad-ad7b-cc9fc97bcf66 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:09:56.750337 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-73420121-084b-45ad-ad7b-cc9fc97bcf66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:09:56.787359 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:09:56.847778 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 48/99] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:09:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 22:09:56.953732 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d040b-b61a-47e3-ba3d-28565207b20a None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:56.954043 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d040b-b61a-47e3-ba3d-28565207b20a None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:56.954296 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d040b-b61a-47e3-ba3d-28565207b20a None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:56.955979 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 52/100] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:09:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:09:56.961862 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fffc5a-1795-444d-8ace-d3b1da3abe8a None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:56.962152 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fffc5a-1795-444d-8ace-d3b1da3abe8a None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:56.962431 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fffc5a-1795-444d-8ace-d3b1da3abe8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:56.981675 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-56fffc5a-1795-444d-8ace-d3b1da3abe8a None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:09:56.982820 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-56fffc5a-1795-444d-8ace-d3b1da3abe8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:09:57.075456 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 49/101] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:09:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 22:09:57.289790 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36d040b-b61a-47e3-ba3d-28565207b20a None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:09:57.423260 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36d040b-b61a-47e3-ba3d-28565207b20a None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:09:57.471539 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04ced5b-a688-49d2-ad38-660bf820592b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:09:57.472180 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ced5b-a688-49d2-ad38-660bf820592b None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:57.472464 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ced5b-a688-49d2-ad38-660bf820592b None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:57.472740 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ced5b-a688-49d2-ad38-660bf820592b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:57.486487 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04ced5b-a688-49d2-ad38-660bf820592b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 22:09:57.491838 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-b04ced5b-a688-49d2-ad38-660bf820592b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 20 22:09:57.491838 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:09:57.491838 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:09:57.491838 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:09:57.491838 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:09:57.491838 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:09:57.491838 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:09:57.491838 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:09:57.491838 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:09:57.491838 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:09:57.491838 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:09:57.491838 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:09:57.491838 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 22:09:57.491838 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 22:09:57.491838 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 22:09:57.491838 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 22:09:57.492714 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 22:09:57.492714 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 22:09:57.492714 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 22:09:57.492714 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 22:09:57.492714 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:09:57.492714 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:09:57.492714 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:09:57.492714 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:09:57.492714 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:09:57.492714 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:09:57.492714 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:09:57.492714 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:09:57.492714 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:09:57.492714 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:09:57.492714 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:09:57.492714 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:09:57.493470 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:09:57.493470 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:09:57.493470 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:09:57.493470 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:09:57.493470 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 22:09:57.493470 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 22:09:57.493470 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 22:09:57.493470 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 22:09:57.493470 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 22:09:57.493470 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 22:09:57.493470 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 20 22:09:57.493470 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:09:57.493470 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 53/102] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 20 22:09:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:09:57.499432 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fffc5a-1795-444d-8ace-d3b1da3abe8a None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:09:57.626682 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04ced5b-a688-49d2-ad38-660bf820592b None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:09:57.647544 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:09:57.655581 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fffc5a-1795-444d-8ace-d3b1da3abe8a None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:09:57.696726 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e36bf9-dd0b-402a-a88f-c5a6a6b95b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:09:57.697742 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e36bf9-dd0b-402a-a88f-c5a6a6b95b7c None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:57.698161 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e36bf9-dd0b-402a-a88f-c5a6a6b95b7c None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:57.698745 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e36bf9-dd0b-402a-a88f-c5a6a6b95b7c None admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:57.699841 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e36bf9-dd0b-402a-a88f-c5a6a6b95b7c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:09:57.700288 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e36bf9-dd0b-402a-a88f-c5a6a6b95b7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:09:57.701967 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e36bf9-dd0b-402a-a88f-c5a6a6b95b7c None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:09:57.711072 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 50/103] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Sep 20 22:09:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:09:57.723734 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e36bf9-dd0b-402a-a88f-c5a6a6b95b7c None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:09:57.763864 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:09:57.849442 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04ced5b-a688-49d2-ad38-660bf820592b None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:09:57.879432 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e36bf9-dd0b-402a-a88f-c5a6a6b95b7c None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:09:57.909591 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f46c62c-befa-4fb1-93e0-e35efab2ce79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:09:57.912267 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f46c62c-befa-4fb1-93e0-e35efab2ce79 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:57.912560 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f46c62c-befa-4fb1-93e0-e35efab2ce79 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:57.912837 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f46c62c-befa-4fb1-93e0-e35efab2ce79 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:57.917548 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f46c62c-befa-4fb1-93e0-e35efab2ce79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:09:57.919029 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f46c62c-befa-4fb1-93e0-e35efab2ce79 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:09:57.923978 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 54/104] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 20 22:09:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 22:09:57.930664 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f46c62c-befa-4fb1-93e0-e35efab2ce79 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:09:57.949027 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24256b6-bdeb-44a7-8fd0-4e2250651067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:09:57.949675 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24256b6-bdeb-44a7-8fd0-4e2250651067 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:57.949954 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24256b6-bdeb-44a7-8fd0-4e2250651067 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:57.950229 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24256b6-bdeb-44a7-8fd0-4e2250651067 None admin] PATH_INFO: `/v3/users/29e817501e714549bcbc6bff9175dabf` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:57.976933 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24256b6-bdeb-44a7-8fd0-4e2250651067 None admin] RBAC: Authorizing `identity:get_user(user_id=29e817501e714549bcbc6bff9175dabf)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:09:57.978397 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24256b6-bdeb-44a7-8fd0-4e2250651067 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:09:57.980133 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 51/105] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Sep 20 22:09:57 2022] GET /identity/v3/users/29e817501e714549bcbc6bff9175dabf => generated 289 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 22:09:57.985850 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24256b6-bdeb-44a7-8fd0-4e2250651067 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:09:58.010755 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:09:58.093574 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f46c62c-befa-4fb1-93e0-e35efab2ce79 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:09:58.124730 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24256b6-bdeb-44a7-8fd0-4e2250651067 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:09:58.131194 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:09:58.155782 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75471254-8024-44c6-9241-6e50a85408d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:09:58.156638 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75471254-8024-44c6-9241-6e50a85408d4 None admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:58.157067 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75471254-8024-44c6-9241-6e50a85408d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:58.157473 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75471254-8024-44c6-9241-6e50a85408d4 None admin] PATH_INFO: `/v3/projects` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:58.158273 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75471254-8024-44c6-9241-6e50a85408d4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:09:58.159924 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75471254-8024-44c6-9241-6e50a85408d4 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:09:58.192193 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353b9134-80fa-4bca-8ba3-04f11139a09a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:09:58.193013 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353b9134-80fa-4bca-8ba3-04f11139a09a None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:58.193398 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353b9134-80fa-4bca-8ba3-04f11139a09a None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:58.193763 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353b9134-80fa-4bca-8ba3-04f11139a09a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:58.220861 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 55/106] 10.222.0.33 () {60 vars in 1141 bytes} [Tue Sep 20 22:09:57 2022] POST /identity/v3/projects => generated 302 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:09:58.319528 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353b9134-80fa-4bca-8ba3-04f11139a09a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:09:58.321225 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353b9134-80fa-4bca-8ba3-04f11139a09a None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:09:58.339075 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:09:58.446803 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 52/107] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 20 22:09:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 20 22:09:58.455927 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75471254-8024-44c6-9241-6e50a85408d4 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:09:58.467197 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d821844a-9866-4226-9bda-551fbbb0c3f5 None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:58.467548 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d821844a-9866-4226-9bda-551fbbb0c3f5 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:58.467835 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d821844a-9866-4226-9bda-551fbbb0c3f5 None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:58.469205 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 53/108] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:09:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 20 22:09:58.491219 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e250b2db-9549-4272-96e6-f312674b41c9 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:58.491219 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e250b2db-9549-4272-96e6-f312674b41c9 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:58.491219 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e250b2db-9549-4272-96e6-f312674b41c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:58.514694 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-e250b2db-9549-4272-96e6-f312674b41c9 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:09:58.514694 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-e250b2db-9549-4272-96e6-f312674b41c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:09:58.600511 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 54/109] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:09:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 20 22:09:58.602742 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2279affa-c120-4d36-9f39-613dfcbcf9c7 None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:58.603033 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2279affa-c120-4d36-9f39-613dfcbcf9c7 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:58.603308 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2279affa-c120-4d36-9f39-613dfcbcf9c7 None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:58.604828 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 55/110] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:09:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:09:58.606077 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4468b88-e059-44d0-af79-63f38d22b9b4 None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:58.606669 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4468b88-e059-44d0-af79-63f38d22b9b4 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:58.607117 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4468b88-e059-44d0-af79-63f38d22b9b4 None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:58.609304 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 56/111] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:09:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:09:58.610698 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2350f7c2-5dd9-42c8-95d2-dc459ac4477c None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:58.611126 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2350f7c2-5dd9-42c8-95d2-dc459ac4477c None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:58.611608 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2350f7c2-5dd9-42c8-95d2-dc459ac4477c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:58.624646 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75471254-8024-44c6-9241-6e50a85408d4 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:09:58.632384 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-2350f7c2-5dd9-42c8-95d2-dc459ac4477c None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:09:58.634783 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-2350f7c2-5dd9-42c8-95d2-dc459ac4477c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:09:58.691899 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:09:58.702756 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf41f0c-be1f-41b8-89d1-bcbec7ffb875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:09:58.703627 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf41f0c-be1f-41b8-89d1-bcbec7ffb875 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:58.704164 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf41f0c-be1f-41b8-89d1-bcbec7ffb875 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:58.704582 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf41f0c-be1f-41b8-89d1-bcbec7ffb875 None admin] PATH_INFO: `/v3/projects/be4987daebfd4f378eb4bc9efc68e66c` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:58.705872 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf41f0c-be1f-41b8-89d1-bcbec7ffb875 None admin] RBAC: Authorizing `identity:get_project(project_id=be4987daebfd4f378eb4bc9efc68e66c)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:09:58.712708 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf41f0c-be1f-41b8-89d1-bcbec7ffb875 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:09:58.713654 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 57/112] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:09:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 22:09:58.714630 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 56/113] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Sep 20 22:09:58 2022] GET /identity/v3/projects/be4987daebfd4f378eb4bc9efc68e66c => generated 298 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:09:58.715504 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b16c36-ef6a-4af3-b2ba-64fb05378958 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:58.715985 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b16c36-ef6a-4af3-b2ba-64fb05378958 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:58.716418 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b16c36-ef6a-4af3-b2ba-64fb05378958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:58.720527 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf41f0c-be1f-41b8-89d1-bcbec7ffb875 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:09:58.736453 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-82b16c36-ef6a-4af3-b2ba-64fb05378958 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:09:58.738606 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-82b16c36-ef6a-4af3-b2ba-64fb05378958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:09:58.817628 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:09:58.819397 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 58/114] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:09:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 22:09:58.878971 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf41f0c-be1f-41b8-89d1-bcbec7ffb875 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:09:58.916356 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6157150d-a73f-4fbf-abc8-d3fe2c07e3d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:09:58.917022 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6157150d-a73f-4fbf-abc8-d3fe2c07e3d7 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:58.917306 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6157150d-a73f-4fbf-abc8-d3fe2c07e3d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:58.917575 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6157150d-a73f-4fbf-abc8-d3fe2c07e3d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:58.918300 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6157150d-a73f-4fbf-abc8-d3fe2c07e3d7 None admin] RBAC: Adding query filter params (role.id=22cfe7a128b64671998d0ff9c54f8ce4, scope.project.id=be4987daebfd4f378eb4bc9efc68e66c, user.id=29e817501e714549bcbc6bff9175dabf) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:09:58.918634 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6157150d-a73f-4fbf-abc8-d3fe2c07e3d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:09:58.920054 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6157150d-a73f-4fbf-abc8-d3fe2c07e3d7 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:09:58.925932 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 57/115] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Sep 20 22:09:58 2022] GET /identity/v3/role_assignments?user.id=29e817501e714549bcbc6bff9175dabf&scope.project.id=be4987daebfd4f378eb4bc9efc68e66c&role.id=22cfe7a128b64671998d0ff9c54f8ce4 => generated 259 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 22:09:58.978070 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040eafc3-8b21-41de-b78a-f16430f82789 None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:58.979054 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040eafc3-8b21-41de-b78a-f16430f82789 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:58.979526 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040eafc3-8b21-41de-b78a-f16430f82789 None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:58.981166 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 59/116] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:09:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:09:58.986998 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2041948-828d-4825-84de-15a871182af8 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:58.987283 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2041948-828d-4825-84de-15a871182af8 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:58.987552 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2041948-828d-4825-84de-15a871182af8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:59.014342 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-f2041948-828d-4825-84de-15a871182af8 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:09:59.015583 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-f2041948-828d-4825-84de-15a871182af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:09:59.092368 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 58/117] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:09:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 22:09:59.146671 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040eafc3-8b21-41de-b78a-f16430f82789 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:09:59.162813 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2041948-828d-4825-84de-15a871182af8 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:09:59.225429 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:09:59.310948 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2041948-828d-4825-84de-15a871182af8 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:09:59.343317 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040eafc3-8b21-41de-b78a-f16430f82789 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:09:59.346005 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:09:59.350051 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e6a080-078f-445f-8125-9ca6961aa1cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:09:59.350721 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e6a080-078f-445f-8125-9ca6961aa1cf None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:59.351101 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e6a080-078f-445f-8125-9ca6961aa1cf None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:59.352143 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e6a080-078f-445f-8125-9ca6961aa1cf None admin] PATH_INFO: `/v3/roles/member` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:59.377261 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e6a080-078f-445f-8125-9ca6961aa1cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 22:09:59.383832 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-02e6a080-078f-445f-8125-9ca6961aa1cf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 20 22:09:59.383832 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:09:59.383832 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:09:59.383832 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:09:59.383832 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:09:59.383832 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:09:59.383832 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:09:59.383832 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:09:59.383832 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:09:59.383832 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:09:59.383832 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:09:59.383832 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:09:59.383832 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 22:09:59.383832 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 22:09:59.383832 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 22:09:59.383832 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 22:09:59.384668 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 22:09:59.384668 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 22:09:59.384668 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 22:09:59.384668 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 22:09:59.384668 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:09:59.384668 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:09:59.384668 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:09:59.384668 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:09:59.384668 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:09:59.384668 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:09:59.384668 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:09:59.384668 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:09:59.384668 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:09:59.384668 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:09:59.384668 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:09:59.384668 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:09:59.385412 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:09:59.385412 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:09:59.385412 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:09:59.385412 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:09:59.385412 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 22:09:59.385412 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 22:09:59.385412 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 22:09:59.385412 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 22:09:59.385412 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 22:09:59.385412 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 22:09:59.385412 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 20 22:09:59.385412 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:09:59.385412 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 59/118] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 20 22:09:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 20 22:09:59.386022 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e6a080-078f-445f-8125-9ca6961aa1cf None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:09:59.410470 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af3abaf-cd4a-49a5-805b-fa3bfea78761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:09:59.411135 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af3abaf-cd4a-49a5-805b-fa3bfea78761 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:59.411414 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af3abaf-cd4a-49a5-805b-fa3bfea78761 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:59.411684 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af3abaf-cd4a-49a5-805b-fa3bfea78761 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:59.432131 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af3abaf-cd4a-49a5-805b-fa3bfea78761 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 22:09:59.438135 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-3af3abaf-cd4a-49a5-805b-fa3bfea78761 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 20 22:09:59.438135 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:09:59.438135 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:09:59.438135 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:09:59.438135 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:09:59.438135 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:09:59.438135 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:09:59.438135 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:09:59.438135 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:09:59.438135 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:09:59.438135 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:09:59.438135 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:09:59.438135 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 22:09:59.438135 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 22:09:59.438135 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 22:09:59.438135 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 22:09:59.439019 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 22:09:59.439019 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 22:09:59.439019 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 22:09:59.439019 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 22:09:59.439019 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:09:59.439019 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:09:59.439019 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:09:59.439019 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:09:59.439019 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:09:59.439019 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:09:59.439019 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:09:59.439019 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:09:59.439019 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:09:59.439019 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:09:59.439019 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:09:59.439019 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:09:59.440188 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:09:59.440188 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:09:59.440188 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:09:59.440188 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:09:59.440188 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 22:09:59.440188 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 22:09:59.440188 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 22:09:59.440188 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 22:09:59.440188 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 22:09:59.440188 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 22:09:59.440188 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 20 22:09:59.440188 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:09:59.440188 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 60/119] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 20 22:09:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:09:59.440188 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af3abaf-cd4a-49a5-805b-fa3bfea78761 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:09:59.533649 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:09:59.539796 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e6a080-078f-445f-8125-9ca6961aa1cf None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:09:59.573977 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af3abaf-cd4a-49a5-805b-fa3bfea78761 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:09:59.584261 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81207dbd-dbaa-45aa-a915-44b1fa04db4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:09:59.585605 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81207dbd-dbaa-45aa-a915-44b1fa04db4b None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:59.586368 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81207dbd-dbaa-45aa-a915-44b1fa04db4b None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:59.587010 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81207dbd-dbaa-45aa-a915-44b1fa04db4b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:59.601978 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81207dbd-dbaa-45aa-a915-44b1fa04db4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 22:09:59.607439 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-81207dbd-dbaa-45aa-a915-44b1fa04db4b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 20 22:09:59.607439 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:09:59.607439 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:09:59.607439 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:09:59.607439 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:09:59.607439 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:09:59.607439 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:09:59.607439 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:09:59.607439 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:09:59.607439 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:09:59.607439 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:09:59.607439 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:09:59.607439 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 22:09:59.607439 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 22:09:59.607439 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 22:09:59.607439 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 22:09:59.608274 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 22:09:59.608274 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 22:09:59.608274 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 22:09:59.608274 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 22:09:59.608274 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:09:59.608274 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:09:59.608274 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:09:59.608274 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:09:59.608274 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:09:59.608274 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:09:59.608274 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:09:59.608274 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:09:59.608274 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:09:59.608274 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:09:59.608274 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:09:59.608274 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:09:59.609064 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:09:59.609064 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:09:59.609064 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:09:59.609064 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:09:59.609064 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 22:09:59.609064 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 22:09:59.609064 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 22:09:59.609064 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 22:09:59.609064 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 22:09:59.609064 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 22:09:59.609064 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 20 22:09:59.609064 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:09:59.609064 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 60/120] 10.222.0.33 () {56 vars in 1114 bytes} [Tue Sep 20 22:09:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:09:59.609676 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81207dbd-dbaa-45aa-a915-44b1fa04db4b None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:09:59.617739 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30434be4-03dd-4c28-b06f-5bb43685b080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:09:59.618777 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30434be4-03dd-4c28-b06f-5bb43685b080 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:59.619357 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30434be4-03dd-4c28-b06f-5bb43685b080 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:59.619637 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30434be4-03dd-4c28-b06f-5bb43685b080 None admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:59.620312 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30434be4-03dd-4c28-b06f-5bb43685b080 None admin] RBAC: Adding query filter params (name=member) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:09:59.620617 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30434be4-03dd-4c28-b06f-5bb43685b080 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:09:59.622014 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30434be4-03dd-4c28-b06f-5bb43685b080 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:09:59.631422 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 61/121] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Sep 20 22:09:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:09:59.637174 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30434be4-03dd-4c28-b06f-5bb43685b080 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:09:59.665758 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:09:59.745543 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30434be4-03dd-4c28-b06f-5bb43685b080 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:09:59.750573 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81207dbd-dbaa-45aa-a915-44b1fa04db4b None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:09:59.784040 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6bd1bc-2a5f-4d54-9310-831a9a315609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:09:59.784735 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6bd1bc-2a5f-4d54-9310-831a9a315609 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:59.785099 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6bd1bc-2a5f-4d54-9310-831a9a315609 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:59.785313 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6bd1bc-2a5f-4d54-9310-831a9a315609 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:59.796444 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6bd1bc-2a5f-4d54-9310-831a9a315609 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 22:09:59.799372 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1fed35-e92e-46f2-a2be-28ac236c8a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:09:59.800252 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1fed35-e92e-46f2-a2be-28ac236c8a72 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:59.800739 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1fed35-e92e-46f2-a2be-28ac236c8a72 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:59.801291 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1fed35-e92e-46f2-a2be-28ac236c8a72 None admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:59.802147 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1fed35-e92e-46f2-a2be-28ac236c8a72 None admin] RBAC: Adding query filter params (name=member) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:09:59.802248 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-ff6bd1bc-2a5f-4d54-9310-831a9a315609 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 22:09:59.802248 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:09:59.802248 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:09:59.802248 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:09:59.802248 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:09:59.802248 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:09:59.802248 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:09:59.802248 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:09:59.802248 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:09:59.802248 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:09:59.802248 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:09:59.802248 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:09:59.802248 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 22:09:59.802248 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 22:09:59.802248 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 22:09:59.802248 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 22:09:59.803081 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 22:09:59.803081 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 22:09:59.803081 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 22:09:59.803081 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 22:09:59.803081 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:09:59.803081 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:09:59.803081 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:09:59.803081 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:09:59.803081 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:09:59.803081 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:09:59.803081 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:09:59.803081 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:09:59.803081 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:09:59.803081 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:09:59.803081 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:09:59.803081 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:09:59.803840 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:09:59.803840 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:09:59.803840 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:09:59.803840 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:09:59.803840 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 22:09:59.803840 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 22:09:59.803840 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 22:09:59.803840 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 22:09:59.803840 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 22:09:59.803840 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 22:09:59.803840 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 22:09:59.803840 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:09:59.803840 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 62/122] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Sep 20 22:09:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:09:59.805347 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6bd1bc-2a5f-4d54-9310-831a9a315609 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:09:59.806572 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1fed35-e92e-46f2-a2be-28ac236c8a72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:09:59.809593 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1fed35-e92e-46f2-a2be-28ac236c8a72 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:09:59.821744 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 61/123] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Sep 20 22:09:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:09:59.827026 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1fed35-e92e-46f2-a2be-28ac236c8a72 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:09:59.854683 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:09:59.908884 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:09:59.925321 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6bd1bc-2a5f-4d54-9310-831a9a315609 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:09:59.951585 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1fed35-e92e-46f2-a2be-28ac236c8a72 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:09:59.973033 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5954b721-712a-4f74-a150-fecd2282f710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:09:59.974064 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5954b721-712a-4f74-a150-fecd2282f710 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:59.975198 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5954b721-712a-4f74-a150-fecd2282f710 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:59.975687 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5954b721-712a-4f74-a150-fecd2282f710 None admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:59.976905 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5954b721-712a-4f74-a150-fecd2282f710 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:09:59.977452 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5954b721-712a-4f74-a150-fecd2282f710 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:09:59.979980 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5954b721-712a-4f74-a150-fecd2282f710 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:09:59.989889 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc742ea4-80bc-46b2-a5ad-b277d5897eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:09:59.990727 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc742ea4-80bc-46b2-a5ad-b277d5897eb2 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:09:59.991084 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc742ea4-80bc-46b2-a5ad-b277d5897eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:09:59.991437 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc742ea4-80bc-46b2-a5ad-b277d5897eb2 None admin] PATH_INFO: `/v3/users/353bf7be83974c0e8e94f1044be36966` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:09:59.992601 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 63/124] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Sep 20 22:09:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:09:59.997103 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc742ea4-80bc-46b2-a5ad-b277d5897eb2 None admin] RBAC: Authorizing `identity:get_user(user_id=353bf7be83974c0e8e94f1044be36966)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:09:59.997103 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc742ea4-80bc-46b2-a5ad-b277d5897eb2 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:09:59.997103 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 62/125] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Sep 20 22:09:59 2022] GET /identity/v3/users/353bf7be83974c0e8e94f1044be36966 => generated 275 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:09:59.997889 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc742ea4-80bc-46b2-a5ad-b277d5897eb2 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:09:59.998686 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5954b721-712a-4f74-a150-fecd2282f710 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:00.098799 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:00.114439 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc742ea4-80bc-46b2-a5ad-b277d5897eb2 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:00.128638 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5954b721-712a-4f74-a150-fecd2282f710 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:00.160290 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fa7bad-e09c-4d23-b661-21b6886c62b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:00.161310 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fa7bad-e09c-4d23-b661-21b6886c62b9 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:00.161857 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fa7bad-e09c-4d23-b661-21b6886c62b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:00.162320 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fa7bad-e09c-4d23-b661-21b6886c62b9 None admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:00.163225 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fa7bad-e09c-4d23-b661-21b6886c62b9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:10:00.163741 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fa7bad-e09c-4d23-b661-21b6886c62b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:00.166008 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fa7bad-e09c-4d23-b661-21b6886c62b9 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:00.167647 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cef9b3-14ca-42ed-a8a6-5e7f703ddb87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:00.168547 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cef9b3-14ca-42ed-a8a6-5e7f703ddb87 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:00.169012 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cef9b3-14ca-42ed-a8a6-5e7f703ddb87 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:00.169483 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cef9b3-14ca-42ed-a8a6-5e7f703ddb87 None admin] PATH_INFO: `/v3/users/353bf7be83974c0e8e94f1044be36966` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:00.171008 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cef9b3-14ca-42ed-a8a6-5e7f703ddb87 None admin] RBAC: Authorizing `identity:get_user(user_id=353bf7be83974c0e8e94f1044be36966)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:00.172772 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cef9b3-14ca-42ed-a8a6-5e7f703ddb87 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:00.174568 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 64/126] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Sep 20 22:09:59 2022] GET /identity/v3/users/353bf7be83974c0e8e94f1044be36966 => generated 275 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:00.175511 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cef9b3-14ca-42ed-a8a6-5e7f703ddb87 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:00.179417 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 63/127] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 20 22:09:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:00.181525 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fa7bad-e09c-4d23-b661-21b6886c62b9 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:00.197577 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:00.288303 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cef9b3-14ca-42ed-a8a6-5e7f703ddb87 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:00.304839 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fa7bad-e09c-4d23-b661-21b6886c62b9 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:00.330408 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284f475e-d4e9-46d4-86d6-b022bb28aad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:00.331413 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284f475e-d4e9-46d4-86d6-b022bb28aad9 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:00.331841 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284f475e-d4e9-46d4-86d6-b022bb28aad9 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:00.332261 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284f475e-d4e9-46d4-86d6-b022bb28aad9 None admin] PATH_INFO: `/v3/users/353bf7be83974c0e8e94f1044be36966` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:00.333674 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284f475e-d4e9-46d4-86d6-b022bb28aad9 None admin] RBAC: Authorizing `identity:get_user(user_id=353bf7be83974c0e8e94f1044be36966)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:00.335562 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284f475e-d4e9-46d4-86d6-b022bb28aad9 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:00.338074 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 65/128] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Sep 20 22:10:00 2022] GET /identity/v3/users/353bf7be83974c0e8e94f1044be36966 => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:00.339009 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284f475e-d4e9-46d4-86d6-b022bb28aad9 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:00.347120 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968f30f3-f041-40b0-9d6a-705564cd2ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:00.347771 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f30f3-f041-40b0-9d6a-705564cd2ec7 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:00.348051 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f30f3-f041-40b0-9d6a-705564cd2ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:00.348322 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f30f3-f041-40b0-9d6a-705564cd2ec7 None admin] PATH_INFO: `/v3/projects/be4987daebfd4f378eb4bc9efc68e66c` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:00.349633 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968f30f3-f041-40b0-9d6a-705564cd2ec7 None admin] RBAC: Authorizing `identity:get_project(project_id=be4987daebfd4f378eb4bc9efc68e66c)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:00.350908 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968f30f3-f041-40b0-9d6a-705564cd2ec7 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:00.352716 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 64/129] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Sep 20 22:10:00 2022] GET /identity/v3/projects/be4987daebfd4f378eb4bc9efc68e66c => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:00.353319 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968f30f3-f041-40b0-9d6a-705564cd2ec7 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:00.374325 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:00.440737 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:00.464767 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284f475e-d4e9-46d4-86d6-b022bb28aad9 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:00.473528 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968f30f3-f041-40b0-9d6a-705564cd2ec7 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:00.507112 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab98dd56-c8a0-4d1e-b059-7ccac21ff93c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:00.508329 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab98dd56-c8a0-4d1e-b059-7ccac21ff93c None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:00.508684 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab98dd56-c8a0-4d1e-b059-7ccac21ff93c None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:00.508963 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab98dd56-c8a0-4d1e-b059-7ccac21ff93c None admin] PATH_INFO: `/v3/projects/ac207cd789b74f988a87a52d5f481c84` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:00.510086 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab98dd56-c8a0-4d1e-b059-7ccac21ff93c None admin] RBAC: Authorizing `identity:get_project(project_id=ac207cd789b74f988a87a52d5f481c84)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:00.511772 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab98dd56-c8a0-4d1e-b059-7ccac21ff93c None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:00.512718 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ad8fc4-6b6f-47a7-84f0-a27a19191aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:00.513613 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ad8fc4-6b6f-47a7-84f0-a27a19191aa9 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:00.514091 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ad8fc4-6b6f-47a7-84f0-a27a19191aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:00.514607 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ad8fc4-6b6f-47a7-84f0-a27a19191aa9 None admin] PATH_INFO: `/v3/users/85f4e64839754c658de5c3fe0e1220a9` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:00.515971 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ad8fc4-6b6f-47a7-84f0-a27a19191aa9 None admin] RBAC: Authorizing `identity:get_user(user_id=85f4e64839754c658de5c3fe0e1220a9)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:00.517605 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ad8fc4-6b6f-47a7-84f0-a27a19191aa9 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:00.518358 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 66/130] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Sep 20 22:10:00 2022] GET /identity/v3/projects/ac207cd789b74f988a87a52d5f481c84 => generated 312 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:00.519207 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab98dd56-c8a0-4d1e-b059-7ccac21ff93c None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:00.519900 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 65/131] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Sep 20 22:10:00 2022] GET /identity/v3/users/85f4e64839754c658de5c3fe0e1220a9 => generated 247 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:00.521105 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ad8fc4-6b6f-47a7-84f0-a27a19191aa9 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:00.617430 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:00.634796 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ad8fc4-6b6f-47a7-84f0-a27a19191aa9 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:00.651160 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab98dd56-c8a0-4d1e-b059-7ccac21ff93c None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:00.671290 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3fde9b-73e4-446c-995b-6689166bc37c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:00.671960 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3fde9b-73e4-446c-995b-6689166bc37c None admin] REQUEST_METHOD: `PUT` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:00.672239 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3fde9b-73e4-446c-995b-6689166bc37c None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:00.672511 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3fde9b-73e4-446c-995b-6689166bc37c None admin] PATH_INFO: `/v3/projects/be4987daebfd4f378eb4bc9efc68e66c/users/353bf7be83974c0e8e94f1044be36966/roles/604444e7ad0d437dbd1f5a6e02b761f5` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:00.674436 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3fde9b-73e4-446c-995b-6689166bc37c None admin] RBAC: Authorizing `identity:create_grant(project_id=be4987daebfd4f378eb4bc9efc68e66c, user_id=353bf7be83974c0e8e94f1044be36966, role_id=604444e7ad0d437dbd1f5a6e02b761f5)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:00.675944 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3fde9b-73e4-446c-995b-6689166bc37c None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:00.691023 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343caa3c-9d68-444f-be34-6094c4c8df64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:00.692081 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343caa3c-9d68-444f-be34-6094c4c8df64 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:00.692616 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343caa3c-9d68-444f-be34-6094c4c8df64 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:00.692904 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 66/132] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Sep 20 22:10:00 2022] PUT /identity/v3/projects/be4987daebfd4f378eb4bc9efc68e66c/users/353bf7be83974c0e8e94f1044be36966/roles/604444e7ad0d437dbd1f5a6e02b761f5 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:10:00.693296 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343caa3c-9d68-444f-be34-6094c4c8df64 None admin] PATH_INFO: `/v3/projects/be4987daebfd4f378eb4bc9efc68e66c` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:00.693837 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3fde9b-73e4-446c-995b-6689166bc37c None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:00.695685 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343caa3c-9d68-444f-be34-6094c4c8df64 None admin] RBAC: Authorizing `identity:get_project(project_id=be4987daebfd4f378eb4bc9efc68e66c)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:00.697556 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343caa3c-9d68-444f-be34-6094c4c8df64 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:00.699926 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 67/133] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Sep 20 22:10:00 2022] GET /identity/v3/projects/be4987daebfd4f378eb4bc9efc68e66c => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:00.701176 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343caa3c-9d68-444f-be34-6094c4c8df64 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:00.727998 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:00.817664 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3fde9b-73e4-446c-995b-6689166bc37c None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:00.822323 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343caa3c-9d68-444f-be34-6094c4c8df64 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:00.856286 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc46e7f-51de-4ddf-a303-cb1d297b4dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:00.856954 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc46e7f-51de-4ddf-a303-cb1d297b4dc1 None admin] REQUEST_METHOD: `PUT` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:00.857236 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc46e7f-51de-4ddf-a303-cb1d297b4dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:00.857512 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc46e7f-51de-4ddf-a303-cb1d297b4dc1 None admin] PATH_INFO: `/v3/projects/ac207cd789b74f988a87a52d5f481c84/users/353bf7be83974c0e8e94f1044be36966/roles/604444e7ad0d437dbd1f5a6e02b761f5` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:00.859828 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc46e7f-51de-4ddf-a303-cb1d297b4dc1 None admin] RBAC: Authorizing `identity:create_grant(project_id=ac207cd789b74f988a87a52d5f481c84, user_id=353bf7be83974c0e8e94f1044be36966, role_id=604444e7ad0d437dbd1f5a6e02b761f5)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:00.861399 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc46e7f-51de-4ddf-a303-cb1d297b4dc1 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:00.861829 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb531bb-cfd6-4379-ae61-0e19033291c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:00.862737 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb531bb-cfd6-4379-ae61-0e19033291c5 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:00.863219 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb531bb-cfd6-4379-ae61-0e19033291c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:00.863752 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb531bb-cfd6-4379-ae61-0e19033291c5 None admin] PATH_INFO: `/v3/projects/be4987daebfd4f378eb4bc9efc68e66c` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:00.865111 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb531bb-cfd6-4379-ae61-0e19033291c5 None admin] RBAC: Authorizing `identity:get_project(project_id=be4987daebfd4f378eb4bc9efc68e66c)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:00.867393 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb531bb-cfd6-4379-ae61-0e19033291c5 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:00.869689 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 68/134] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Sep 20 22:10:00 2022] GET /identity/v3/projects/be4987daebfd4f378eb4bc9efc68e66c => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:00.870781 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb531bb-cfd6-4379-ae61-0e19033291c5 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:00.898559 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 67/135] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Sep 20 22:10:00 2022] PUT /identity/v3/projects/ac207cd789b74f988a87a52d5f481c84/users/353bf7be83974c0e8e94f1044be36966/roles/604444e7ad0d437dbd1f5a6e02b761f5 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:10:00.899454 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc46e7f-51de-4ddf-a303-cb1d297b4dc1 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:00.917562 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:00.985713 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:01.001161 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb531bb-cfd6-4379-ae61-0e19033291c5 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:01.044368 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bc77ec-d7fa-4685-8b92-05474e390d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:01.045197 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bc77ec-d7fa-4685-8b92-05474e390d32 None admin] REQUEST_METHOD: `PUT` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:01.045586 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bc77ec-d7fa-4685-8b92-05474e390d32 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:01.045966 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bc77ec-d7fa-4685-8b92-05474e390d32 None admin] PATH_INFO: `/v3/projects/be4987daebfd4f378eb4bc9efc68e66c/users/353bf7be83974c0e8e94f1044be36966/roles/4e75d58a1e0e4fffa940914b1e5f46de` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:01.048439 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bc77ec-d7fa-4685-8b92-05474e390d32 None admin] RBAC: Authorizing `identity:create_grant(project_id=be4987daebfd4f378eb4bc9efc68e66c, user_id=353bf7be83974c0e8e94f1044be36966, role_id=4e75d58a1e0e4fffa940914b1e5f46de)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:01.050067 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bc77ec-d7fa-4685-8b92-05474e390d32 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:01.076849 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 69/136] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Sep 20 22:10:00 2022] PUT /identity/v3/projects/be4987daebfd4f378eb4bc9efc68e66c/users/353bf7be83974c0e8e94f1044be36966/roles/4e75d58a1e0e4fffa940914b1e5f46de => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:10:01.080070 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13c782a-efc1-4696-9bfc-f86493013641 None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:01.080607 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13c782a-efc1-4696-9bfc-f86493013641 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:01.081970 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13c782a-efc1-4696-9bfc-f86493013641 None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:01.086977 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 70/137] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:10:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:10:01.097295 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f368beb-e8cb-492c-bab9-129c47d94f8c None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:01.097811 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f368beb-e8cb-492c-bab9-129c47d94f8c None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:01.098295 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f368beb-e8cb-492c-bab9-129c47d94f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:01.104997 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc46e7f-51de-4ddf-a303-cb1d297b4dc1 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:01.133282 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-6f368beb-e8cb-492c-bab9-129c47d94f8c None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:10:01.134976 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-6f368beb-e8cb-492c-bab9-129c47d94f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:10:01.183165 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3de49aa-3bbb-46ee-9816-8b3fd91739fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:01.183974 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3de49aa-3bbb-46ee-9816-8b3fd91739fb None admin] REQUEST_METHOD: `PUT` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:01.184259 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3de49aa-3bbb-46ee-9816-8b3fd91739fb None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:01.184535 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3de49aa-3bbb-46ee-9816-8b3fd91739fb None admin] PATH_INFO: `/v3/projects/be4987daebfd4f378eb4bc9efc68e66c/users/85f4e64839754c658de5c3fe0e1220a9/roles/8a829170b29d42d6af589399e51edb0f` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:01.186756 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3de49aa-3bbb-46ee-9816-8b3fd91739fb None admin] RBAC: Authorizing `identity:create_grant(project_id=be4987daebfd4f378eb4bc9efc68e66c, user_id=85f4e64839754c658de5c3fe0e1220a9, role_id=8a829170b29d42d6af589399e51edb0f)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:01.190539 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3de49aa-3bbb-46ee-9816-8b3fd91739fb None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:01.210631 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 68/138] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Sep 20 22:10:00 2022] PUT /identity/v3/projects/be4987daebfd4f378eb4bc9efc68e66c/users/85f4e64839754c658de5c3fe0e1220a9/roles/8a829170b29d42d6af589399e51edb0f => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:10:01.308022 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 71/139] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:10:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 20 22:10:01.354297 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1a1e3a-7bd9-432a-b84e-4432bebda10e None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:01.354841 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1a1e3a-7bd9-432a-b84e-4432bebda10e None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:01.355420 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1a1e3a-7bd9-432a-b84e-4432bebda10e None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:01.356974 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 69/140] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:10:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:10:01.363971 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a46ebf-e23f-474b-8dbf-d9731cbd9ba9 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:01.364472 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a46ebf-e23f-474b-8dbf-d9731cbd9ba9 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:01.364882 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a46ebf-e23f-474b-8dbf-d9731cbd9ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:01.385828 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-01a46ebf-e23f-474b-8dbf-d9731cbd9ba9 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:10:01.387367 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-01a46ebf-e23f-474b-8dbf-d9731cbd9ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:10:01.469719 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 72/141] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:10:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 22:10:01.861569 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1a1e3a-7bd9-432a-b84e-4432bebda10e None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:01.943351 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:01.983431 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1a1e3a-7bd9-432a-b84e-4432bebda10e None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:02.018579 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfdea8f-5fc6-4352-8969-f16d8ee6a09f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:02.019275 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfdea8f-5fc6-4352-8969-f16d8ee6a09f None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:02.019557 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfdea8f-5fc6-4352-8969-f16d8ee6a09f None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:02.019828 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfdea8f-5fc6-4352-8969-f16d8ee6a09f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:02.020995 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfdea8f-5fc6-4352-8969-f16d8ee6a09f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:02.022429 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfdea8f-5fc6-4352-8969-f16d8ee6a09f None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:02.024055 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 70/142] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 20 22:10:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:02.029556 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a46ebf-e23f-474b-8dbf-d9731cbd9ba9 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:02.052517 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:02.064805 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfdea8f-5fc6-4352-8969-f16d8ee6a09f None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:02.202977 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfdea8f-5fc6-4352-8969-f16d8ee6a09f None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:02.241851 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dca6bb-9a5a-42ed-b8a8-9670e54e1ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:02.242691 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dca6bb-9a5a-42ed-b8a8-9670e54e1ddf None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:02.242980 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dca6bb-9a5a-42ed-b8a8-9670e54e1ddf None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:02.243520 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dca6bb-9a5a-42ed-b8a8-9670e54e1ddf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:02.245214 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a46ebf-e23f-474b-8dbf-d9731cbd9ba9 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:02.254202 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dca6bb-9a5a-42ed-b8a8-9670e54e1ddf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 22:10:02.259753 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-75dca6bb-9a5a-42ed-b8a8-9670e54e1ddf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 20 22:10:02.259753 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:10:02.259753 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:10:02.259753 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:10:02.259753 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:10:02.259753 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:10:02.259753 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:10:02.259753 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:10:02.259753 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:10:02.259753 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:10:02.259753 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:10:02.259753 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:10:02.259753 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 22:10:02.259753 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 22:10:02.259753 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 22:10:02.259753 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 22:10:02.260607 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 22:10:02.260607 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 22:10:02.260607 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 22:10:02.260607 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 22:10:02.260607 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:10:02.260607 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:10:02.260607 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:10:02.260607 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:10:02.260607 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:10:02.260607 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:10:02.260607 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:10:02.260607 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:10:02.260607 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:10:02.260607 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:10:02.260607 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:10:02.260607 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:10:02.261500 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:10:02.261500 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:10:02.261500 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:10:02.261500 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:10:02.261500 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 22:10:02.261500 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 22:10:02.261500 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 22:10:02.261500 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 22:10:02.261500 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 22:10:02.261500 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 22:10:02.261500 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 20 22:10:02.261500 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:10:02.261500 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 71/143] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 20 22:10:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:10:02.262809 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:02.267455 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dca6bb-9a5a-42ed-b8a8-9670e54e1ddf None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:02.351928 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec930b7-d6ec-4978-b4d8-c57c514402eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:02.352592 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec930b7-d6ec-4978-b4d8-c57c514402eb None admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:02.352879 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec930b7-d6ec-4978-b4d8-c57c514402eb None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:02.353158 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec930b7-d6ec-4978-b4d8-c57c514402eb None admin] PATH_INFO: `/v3/users` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:02.353850 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec930b7-d6ec-4978-b4d8-c57c514402eb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:02.355377 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec930b7-d6ec-4978-b4d8-c57c514402eb None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:02.419052 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 73/144] 10.222.0.33 () {60 vars in 1132 bytes} [Tue Sep 20 22:10:02 2022] POST /identity/v3/users => generated 283 bytes in 390 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:10:02.488137 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dca6bb-9a5a-42ed-b8a8-9670e54e1ddf None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:02.548204 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a2c304-61f5-4230-9cfc-71042b1f0487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:02.548854 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a2c304-61f5-4230-9cfc-71042b1f0487 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:02.549134 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a2c304-61f5-4230-9cfc-71042b1f0487 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:02.549406 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a2c304-61f5-4230-9cfc-71042b1f0487 None admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:02.550106 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a2c304-61f5-4230-9cfc-71042b1f0487 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:10:02.550412 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a2c304-61f5-4230-9cfc-71042b1f0487 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:02.551877 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a2c304-61f5-4230-9cfc-71042b1f0487 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:02.562358 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 72/145] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Sep 20 22:10:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:02.567957 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec930b7-d6ec-4978-b4d8-c57c514402eb None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:02.675955 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:02.731970 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec930b7-d6ec-4978-b4d8-c57c514402eb None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:02.779218 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0af438-a29a-475d-bfa2-08e2c850f3b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:02.779844 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0af438-a29a-475d-bfa2-08e2c850f3b2 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:02.780123 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0af438-a29a-475d-bfa2-08e2c850f3b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:02.780393 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0af438-a29a-475d-bfa2-08e2c850f3b2 None admin] PATH_INFO: `/v3/users/29e817501e714549bcbc6bff9175dabf` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:02.781528 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0af438-a29a-475d-bfa2-08e2c850f3b2 None admin] RBAC: Authorizing `identity:get_user(user_id=29e817501e714549bcbc6bff9175dabf)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:02.783015 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0af438-a29a-475d-bfa2-08e2c850f3b2 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:02.784886 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 74/146] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Sep 20 22:10:02 2022] GET /identity/v3/users/29e817501e714549bcbc6bff9175dabf => generated 289 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:02.790570 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a2c304-61f5-4230-9cfc-71042b1f0487 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:02.872344 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:02.928462 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a2c304-61f5-4230-9cfc-71042b1f0487 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:02.964699 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8a74d1-1571-4fc9-836a-35a3398e37f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:02.965689 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a74d1-1571-4fc9-836a-35a3398e37f7 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:02.966171 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a74d1-1571-4fc9-836a-35a3398e37f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:02.966676 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a74d1-1571-4fc9-836a-35a3398e37f7 None admin] PATH_INFO: `/v3/projects/be4987daebfd4f378eb4bc9efc68e66c` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:02.968032 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8a74d1-1571-4fc9-836a-35a3398e37f7 None admin] RBAC: Authorizing `identity:get_project(project_id=be4987daebfd4f378eb4bc9efc68e66c)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:02.969676 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8a74d1-1571-4fc9-836a-35a3398e37f7 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:02.971606 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 73/147] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Sep 20 22:10:02 2022] GET /identity/v3/projects/be4987daebfd4f378eb4bc9efc68e66c => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:02.977838 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0af438-a29a-475d-bfa2-08e2c850f3b2 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:03.093741 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0af438-a29a-475d-bfa2-08e2c850f3b2 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:03.133903 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:03.140296 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad49c3b0-24a4-46ee-9ec5-c5db65c0746e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:03.141346 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad49c3b0-24a4-46ee-9ec5-c5db65c0746e None admin] REQUEST_METHOD: `PUT` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:03.141829 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad49c3b0-24a4-46ee-9ec5-c5db65c0746e None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:03.142299 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad49c3b0-24a4-46ee-9ec5-c5db65c0746e None admin] PATH_INFO: `/v3/projects/be4987daebfd4f378eb4bc9efc68e66c/users/29e817501e714549bcbc6bff9175dabf/roles/22cfe7a128b64671998d0ff9c54f8ce4` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:03.144572 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad49c3b0-24a4-46ee-9ec5-c5db65c0746e None admin] RBAC: Authorizing `identity:create_grant(project_id=be4987daebfd4f378eb4bc9efc68e66c, user_id=29e817501e714549bcbc6bff9175dabf, role_id=22cfe7a128b64671998d0ff9c54f8ce4)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:03.146241 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad49c3b0-24a4-46ee-9ec5-c5db65c0746e None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:03.170093 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 75/148] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Sep 20 22:10:02 2022] PUT /identity/v3/projects/be4987daebfd4f378eb4bc9efc68e66c/users/29e817501e714549bcbc6bff9175dabf/roles/22cfe7a128b64671998d0ff9c54f8ce4 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 22:10:03.869007 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083506f6-9391-4d66-a7b1-96779543621d None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:03.869308 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083506f6-9391-4d66-a7b1-96779543621d None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:03.869587 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083506f6-9391-4d66-a7b1-96779543621d None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:03.870961 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 74/149] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:10:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:10:03.877080 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e920e79d-c05b-4b6c-9681-91308566a432 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:03.877366 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e920e79d-c05b-4b6c-9681-91308566a432 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:03.877645 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e920e79d-c05b-4b6c-9681-91308566a432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:03.902467 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-e920e79d-c05b-4b6c-9681-91308566a432 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:10:03.903691 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-e920e79d-c05b-4b6c-9681-91308566a432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:10:03.991532 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 76/150] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:10:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 20 22:10:04.213085 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ffe09-0d41-4954-b850-ecd6ff91f879 None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:04.213563 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ffe09-0d41-4954-b850-ecd6ff91f879 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:04.213563 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ffe09-0d41-4954-b850-ecd6ff91f879 None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:04.214897 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 75/151] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:10:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:10:04.221344 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dca835-8b43-48f1-b803-97be704068d7 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:04.221777 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dca835-8b43-48f1-b803-97be704068d7 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:04.221950 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dca835-8b43-48f1-b803-97be704068d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:04.247542 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-78dca835-8b43-48f1-b803-97be704068d7 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:10:04.248729 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-78dca835-8b43-48f1-b803-97be704068d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:10:04.303240 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f78c131-cd9e-4924-b5ca-c1f7b840398a None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:04.303522 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f78c131-cd9e-4924-b5ca-c1f7b840398a None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:04.303791 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f78c131-cd9e-4924-b5ca-c1f7b840398a None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:04.305984 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 76/152] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:10:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 20 22:10:04.311330 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f871fdff-8afd-4c3b-abcd-076bb13782a6 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:04.311611 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f871fdff-8afd-4c3b-abcd-076bb13782a6 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:04.311886 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f871fdff-8afd-4c3b-abcd-076bb13782a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:04.336669 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-f871fdff-8afd-4c3b-abcd-076bb13782a6 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:10:04.337855 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-f871fdff-8afd-4c3b-abcd-076bb13782a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:10:04.375164 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 77/153] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:10:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 22:10:04.434284 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 77/154] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:10:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 20 22:10:04.506338 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dca835-8b43-48f1-b803-97be704068d7 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:04.560680 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:04.609608 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dca835-8b43-48f1-b803-97be704068d7 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:04.649801 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7245c71-716b-40e9-a958-af2d23921e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:04.650440 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7245c71-716b-40e9-a958-af2d23921e9d None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:04.650742 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7245c71-716b-40e9-a958-af2d23921e9d None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:04.651011 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7245c71-716b-40e9-a958-af2d23921e9d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:04.671393 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7245c71-716b-40e9-a958-af2d23921e9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 22:10:04.676312 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-e7245c71-716b-40e9-a958-af2d23921e9d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 20 22:10:04.676312 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:10:04.676312 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:10:04.676312 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:10:04.676312 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:10:04.676312 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:10:04.676312 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:10:04.676312 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:10:04.676312 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:10:04.676312 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:10:04.676312 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:10:04.676312 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:10:04.676312 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 22:10:04.676312 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 22:10:04.676312 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 22:10:04.676312 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 22:10:04.677220 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 22:10:04.677220 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 22:10:04.677220 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 22:10:04.677220 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 22:10:04.677220 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:10:04.677220 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:10:04.677220 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:10:04.677220 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:10:04.677220 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:10:04.677220 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:10:04.677220 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:10:04.677220 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:10:04.677220 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:10:04.677220 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:10:04.677220 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:10:04.677220 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:10:04.678010 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:10:04.678010 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:10:04.678010 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:10:04.678010 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:10:04.678010 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 22:10:04.678010 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 22:10:04.678010 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 22:10:04.678010 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 22:10:04.678010 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 22:10:04.678010 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 22:10:04.678010 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 20 22:10:04.678010 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:10:04.678010 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 78/155] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 20 22:10:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:10:04.684181 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f871fdff-8afd-4c3b-abcd-076bb13782a6 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:04.751743 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:04.801129 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f871fdff-8afd-4c3b-abcd-076bb13782a6 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:04.858624 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cf83a7-851b-49fc-918d-a31d5714abdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:04.859248 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cf83a7-851b-49fc-918d-a31d5714abdc None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:04.859525 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cf83a7-851b-49fc-918d-a31d5714abdc None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:04.859793 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cf83a7-851b-49fc-918d-a31d5714abdc None admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:04.860457 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cf83a7-851b-49fc-918d-a31d5714abdc None admin] RBAC: Adding query filter params (name=member) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:10:04.860756 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cf83a7-851b-49fc-918d-a31d5714abdc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:04.862177 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cf83a7-851b-49fc-918d-a31d5714abdc None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:04.875616 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 78/156] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Sep 20 22:10:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:04.880940 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7245c71-716b-40e9-a958-af2d23921e9d None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:04.992791 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8225026c-6047-4c89-951e-ae1e3d6994aa None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:04.993126 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8225026c-6047-4c89-951e-ae1e3d6994aa None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:04.993402 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8225026c-6047-4c89-951e-ae1e3d6994aa None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:04.994760 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 79/157] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:10:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 20 22:10:05.008001 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1860e546-3adb-44c0-afcf-900050c2c080 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:05.008568 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1860e546-3adb-44c0-afcf-900050c2c080 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:05.009066 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1860e546-3adb-44c0-afcf-900050c2c080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:05.011541 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7245c71-716b-40e9-a958-af2d23921e9d None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:05.032433 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:05.037111 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-1860e546-3adb-44c0-afcf-900050c2c080 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:10:05.039198 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-1860e546-3adb-44c0-afcf-900050c2c080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:10:05.072229 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46775a4-1432-4916-9718-457887b63564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:05.072795 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46775a4-1432-4916-9718-457887b63564 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:05.073074 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46775a4-1432-4916-9718-457887b63564 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:05.073345 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46775a4-1432-4916-9718-457887b63564 None admin] PATH_INFO: `/v3/users/353bf7be83974c0e8e94f1044be36966` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:05.077408 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46775a4-1432-4916-9718-457887b63564 None admin] RBAC: Authorizing `identity:get_user(user_id=353bf7be83974c0e8e94f1044be36966)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:05.079262 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46775a4-1432-4916-9718-457887b63564 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:05.081158 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 79/158] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Sep 20 22:10:04 2022] GET /identity/v3/users/353bf7be83974c0e8e94f1044be36966 => generated 275 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:05.083486 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46775a4-1432-4916-9718-457887b63564 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:05.205109 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 80/159] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:10:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 20 22:10:05.205990 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1860e546-3adb-44c0-afcf-900050c2c080 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:05.285994 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46775a4-1432-4916-9718-457887b63564 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:05.329182 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:05.361121 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c3db87-c09b-475c-bdee-33738944cb59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:05.362165 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c3db87-c09b-475c-bdee-33738944cb59 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:05.362705 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c3db87-c09b-475c-bdee-33738944cb59 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:05.363185 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c3db87-c09b-475c-bdee-33738944cb59 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:05.381363 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c3db87-c09b-475c-bdee-33738944cb59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 22:10:05.395066 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-28c3db87-c09b-475c-bdee-33738944cb59 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 20 22:10:05.395066 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:10:05.395066 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:10:05.395066 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:10:05.395066 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:10:05.395066 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:10:05.395066 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:10:05.395066 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:10:05.395066 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:10:05.395066 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:10:05.395066 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:10:05.395066 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:10:05.395066 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 22:10:05.395066 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 22:10:05.395066 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 22:10:05.395066 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 22:10:05.396031 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 22:10:05.396031 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 22:10:05.396031 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 22:10:05.396031 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 22:10:05.396031 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:10:05.396031 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:10:05.396031 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:10:05.396031 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:10:05.396031 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:10:05.396031 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:10:05.396031 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:10:05.396031 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:10:05.396031 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:10:05.396031 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:10:05.396031 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:10:05.396031 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:10:05.397246 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:10:05.397246 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:10:05.397246 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:10:05.397246 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:10:05.397246 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 22:10:05.397246 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 22:10:05.397246 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 22:10:05.397246 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 22:10:05.397246 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 22:10:05.397246 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 22:10:05.397246 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 20 22:10:05.397246 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:10:05.397246 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 80/160] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 20 22:10:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 20 22:10:05.397246 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c3db87-c09b-475c-bdee-33738944cb59 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:05.475526 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:05.528700 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1860e546-3adb-44c0-afcf-900050c2c080 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:05.557687 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c3db87-c09b-475c-bdee-33738944cb59 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:05.607859 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658ca0de-e34e-487e-9647-71615dab13b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:05.608511 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658ca0de-e34e-487e-9647-71615dab13b8 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:05.608790 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658ca0de-e34e-487e-9647-71615dab13b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:05.609159 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658ca0de-e34e-487e-9647-71615dab13b8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:05.617962 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db3503a-237d-4c10-af8d-faaa64d7cf11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:05.618611 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db3503a-237d-4c10-af8d-faaa64d7cf11 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:05.618895 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db3503a-237d-4c10-af8d-faaa64d7cf11 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:05.619172 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db3503a-237d-4c10-af8d-faaa64d7cf11 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:05.620443 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658ca0de-e34e-487e-9647-71615dab13b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 22:10:05.625883 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-658ca0de-e34e-487e-9647-71615dab13b8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 20 22:10:05.625883 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:10:05.625883 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:10:05.625883 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:10:05.625883 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:10:05.625883 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:10:05.625883 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:10:05.625883 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:10:05.625883 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:10:05.625883 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:10:05.625883 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:10:05.625883 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:10:05.625883 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 22:10:05.625883 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 22:10:05.625883 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 22:10:05.625883 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 22:10:05.627162 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 22:10:05.627162 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 22:10:05.627162 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 22:10:05.627162 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 22:10:05.627162 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:10:05.627162 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:10:05.627162 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:10:05.627162 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:10:05.627162 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:10:05.627162 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:10:05.627162 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:10:05.627162 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:10:05.627162 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:10:05.627162 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:10:05.627162 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:10:05.627162 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:10:05.629167 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:10:05.629167 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:10:05.629167 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:10:05.629167 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:10:05.629167 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 22:10:05.629167 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 22:10:05.629167 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 22:10:05.629167 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 22:10:05.629167 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 22:10:05.629167 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 22:10:05.629167 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 20 22:10:05.629167 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:10:05.629167 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 81/161] 10.222.0.33 () {56 vars in 1114 bytes} [Tue Sep 20 22:10:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:10:05.629167 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658ca0de-e34e-487e-9647-71615dab13b8 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:05.692557 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db3503a-237d-4c10-af8d-faaa64d7cf11 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:05.694032 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db3503a-237d-4c10-af8d-faaa64d7cf11 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:05.741634 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:05.771930 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:05.777634 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658ca0de-e34e-487e-9647-71615dab13b8 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:05.798031 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 81/162] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 20 22:10:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 592 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 20 22:10:05.798983 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db3503a-237d-4c10-af8d-faaa64d7cf11 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:05.816744 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f63d45b-23c5-42c7-ab49-e0855d17840a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:05.817836 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f63d45b-23c5-42c7-ab49-e0855d17840a None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:05.818417 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f63d45b-23c5-42c7-ab49-e0855d17840a None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:05.818906 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f63d45b-23c5-42c7-ab49-e0855d17840a None admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:05.819761 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f63d45b-23c5-42c7-ab49-e0855d17840a None admin] RBAC: Adding query filter params (name=member) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:10:05.820837 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f63d45b-23c5-42c7-ab49-e0855d17840a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:05.822554 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f63d45b-23c5-42c7-ab49-e0855d17840a None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:05.831870 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 82/163] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Sep 20 22:10:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:05.832911 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f63d45b-23c5-42c7-ab49-e0855d17840a None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:05.910614 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db3503a-237d-4c10-af8d-faaa64d7cf11 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:05.946102 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1219f79-a532-4410-82bd-2dc3d206209d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:05.946810 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1219f79-a532-4410-82bd-2dc3d206209d None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:05.947016 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1219f79-a532-4410-82bd-2dc3d206209d None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:05.947336 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1219f79-a532-4410-82bd-2dc3d206209d None admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:05.948024 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1219f79-a532-4410-82bd-2dc3d206209d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:10:05.948306 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1219f79-a532-4410-82bd-2dc3d206209d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:05.949689 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1219f79-a532-4410-82bd-2dc3d206209d None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:05.960972 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 82/164] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Sep 20 22:10:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:05.961859 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1219f79-a532-4410-82bd-2dc3d206209d None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:05.977303 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f63d45b-23c5-42c7-ab49-e0855d17840a None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:05.981647 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:06.031049 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2220c461-c444-4b78-b1d9-f012996d72e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:06.032123 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2220c461-c444-4b78-b1d9-f012996d72e2 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:06.032600 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2220c461-c444-4b78-b1d9-f012996d72e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:06.033078 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2220c461-c444-4b78-b1d9-f012996d72e2 None admin] PATH_INFO: `/v3/projects/be4987daebfd4f378eb4bc9efc68e66c` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:06.034398 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2220c461-c444-4b78-b1d9-f012996d72e2 None admin] RBAC: Authorizing `identity:get_project(project_id=be4987daebfd4f378eb4bc9efc68e66c)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:06.037584 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2220c461-c444-4b78-b1d9-f012996d72e2 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:06.039671 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 83/165] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Sep 20 22:10:05 2022] GET /identity/v3/projects/be4987daebfd4f378eb4bc9efc68e66c => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:06.041867 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2220c461-c444-4b78-b1d9-f012996d72e2 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:06.127480 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:06.165715 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1219f79-a532-4410-82bd-2dc3d206209d None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:06.235874 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38e6bbc-9ac6-47cd-b71b-ffc76d56c772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:06.236937 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38e6bbc-9ac6-47cd-b71b-ffc76d56c772 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:06.237472 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38e6bbc-9ac6-47cd-b71b-ffc76d56c772 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:06.237944 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38e6bbc-9ac6-47cd-b71b-ffc76d56c772 None admin] PATH_INFO: `/v3/users/353bf7be83974c0e8e94f1044be36966` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:06.239455 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38e6bbc-9ac6-47cd-b71b-ffc76d56c772 None admin] RBAC: Authorizing `identity:get_user(user_id=353bf7be83974c0e8e94f1044be36966)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:06.241121 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38e6bbc-9ac6-47cd-b71b-ffc76d56c772 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:06.242998 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 83/166] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Sep 20 22:10:05 2022] GET /identity/v3/users/353bf7be83974c0e8e94f1044be36966 => generated 275 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:06.244463 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38e6bbc-9ac6-47cd-b71b-ffc76d56c772 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:06.276343 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2220c461-c444-4b78-b1d9-f012996d72e2 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:06.345109 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e96d8ba-5de8-4893-8ca2-1b3f927b0faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:06.345849 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e96d8ba-5de8-4893-8ca2-1b3f927b0faf None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:06.346038 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e96d8ba-5de8-4893-8ca2-1b3f927b0faf None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:06.346286 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e96d8ba-5de8-4893-8ca2-1b3f927b0faf None admin] PATH_INFO: `/v3/users/353bf7be83974c0e8e94f1044be36966` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:06.348329 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e96d8ba-5de8-4893-8ca2-1b3f927b0faf None admin] RBAC: Authorizing `identity:get_user(user_id=353bf7be83974c0e8e94f1044be36966)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:06.349768 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e96d8ba-5de8-4893-8ca2-1b3f927b0faf None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:06.358905 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 84/167] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Sep 20 22:10:06 2022] GET /identity/v3/users/353bf7be83974c0e8e94f1044be36966 => generated 275 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:06.359758 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e96d8ba-5de8-4893-8ca2-1b3f927b0faf None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:06.391223 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:06.412972 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38e6bbc-9ac6-47cd-b71b-ffc76d56c772 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:06.448696 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2136d0c-fa7c-490d-b487-0a94cb536969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:06.449248 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2136d0c-fa7c-490d-b487-0a94cb536969 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:06.449623 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2136d0c-fa7c-490d-b487-0a94cb536969 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:06.449846 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2136d0c-fa7c-490d-b487-0a94cb536969 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:06.461196 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2136d0c-fa7c-490d-b487-0a94cb536969 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 22:10:06.466477 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-d2136d0c-fa7c-490d-b487-0a94cb536969 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 22:10:06.466477 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:10:06.466477 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:10:06.466477 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:10:06.466477 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:10:06.466477 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:10:06.466477 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:10:06.466477 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:10:06.466477 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:10:06.466477 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:10:06.466477 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:10:06.466477 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:10:06.466477 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 22:10:06.466477 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 22:10:06.466477 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 22:10:06.466477 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 22:10:06.467434 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 22:10:06.467434 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 22:10:06.467434 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 22:10:06.467434 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 22:10:06.467434 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:10:06.467434 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:10:06.467434 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:10:06.467434 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:10:06.467434 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:10:06.467434 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:10:06.467434 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:10:06.467434 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:10:06.467434 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:10:06.467434 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:10:06.467434 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:10:06.467434 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:10:06.468245 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:10:06.468245 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:10:06.468245 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:10:06.468245 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:10:06.468245 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 22:10:06.468245 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 22:10:06.468245 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 22:10:06.468245 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 22:10:06.468245 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 22:10:06.468245 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 22:10:06.468245 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 22:10:06.468245 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:10:06.468245 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 84/168] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Sep 20 22:10:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:10:06.468902 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2136d0c-fa7c-490d-b487-0a94cb536969 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:06.562888 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:06.574888 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e96d8ba-5de8-4893-8ca2-1b3f927b0faf None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:06.656365 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db1de80-1fda-4ae1-b4d5-a76982f570cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:06.657252 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db1de80-1fda-4ae1-b4d5-a76982f570cb None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:06.657539 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db1de80-1fda-4ae1-b4d5-a76982f570cb None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:06.657808 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db1de80-1fda-4ae1-b4d5-a76982f570cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:06.658553 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db1de80-1fda-4ae1-b4d5-a76982f570cb None admin] RBAC: Adding query filter params (role.id=604444e7ad0d437dbd1f5a6e02b761f5, scope.project.id=be4987daebfd4f378eb4bc9efc68e66c, user.id=353bf7be83974c0e8e94f1044be36966) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:10:06.658863 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db1de80-1fda-4ae1-b4d5-a76982f570cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:06.660953 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db1de80-1fda-4ae1-b4d5-a76982f570cb None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:06.671836 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 85/169] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Sep 20 22:10:06 2022] GET /identity/v3/role_assignments?user.id=353bf7be83974c0e8e94f1044be36966&scope.project.id=be4987daebfd4f378eb4bc9efc68e66c&role.id=604444e7ad0d437dbd1f5a6e02b761f5 => generated 608 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:06.672669 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db1de80-1fda-4ae1-b4d5-a76982f570cb None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:06.731467 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2136d0c-fa7c-490d-b487-0a94cb536969 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:06.792328 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5516d1f3-3041-4df8-a422-520e4986eb23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:06.792963 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5516d1f3-3041-4df8-a422-520e4986eb23 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:06.793248 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5516d1f3-3041-4df8-a422-520e4986eb23 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:06.793517 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5516d1f3-3041-4df8-a422-520e4986eb23 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:06.802112 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:06.901255 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db1de80-1fda-4ae1-b4d5-a76982f570cb None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:06.908507 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5516d1f3-3041-4df8-a422-520e4986eb23 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:06.909998 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5516d1f3-3041-4df8-a422-520e4986eb23 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:06.981294 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb988390-41ab-438e-8b51-ac0b4a88cb01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:06.981988 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb988390-41ab-438e-8b51-ac0b4a88cb01 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:06.982212 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb988390-41ab-438e-8b51-ac0b4a88cb01 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:06.982484 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb988390-41ab-438e-8b51-ac0b4a88cb01 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:07.066948 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:07.074443 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 85/170] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 20 22:10:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 606 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 20 22:10:07.075264 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5516d1f3-3041-4df8-a422-520e4986eb23 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:07.132946 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:07.145705 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb988390-41ab-438e-8b51-ac0b4a88cb01 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:07.147240 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb988390-41ab-438e-8b51-ac0b4a88cb01 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:07.228737 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5516d1f3-3041-4df8-a422-520e4986eb23 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:07.277222 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 86/171] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 20 22:10:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 605 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 20 22:10:07.278014 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb988390-41ab-438e-8b51-ac0b4a88cb01 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:07.282321 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b0e01b-8bd6-4d21-8c5c-4c95c25128b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:07.283241 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b0e01b-8bd6-4d21-8c5c-4c95c25128b0 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:07.283739 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b0e01b-8bd6-4d21-8c5c-4c95c25128b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:07.284206 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b0e01b-8bd6-4d21-8c5c-4c95c25128b0 None admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:07.285069 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b0e01b-8bd6-4d21-8c5c-4c95c25128b0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:10:07.285571 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b0e01b-8bd6-4d21-8c5c-4c95c25128b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:07.287690 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b0e01b-8bd6-4d21-8c5c-4c95c25128b0 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:07.300148 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 86/172] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 20 22:10:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:07.301648 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086ffb38-6e9e-4f13-98c5-f70301b56e2e None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:07.302104 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086ffb38-6e9e-4f13-98c5-f70301b56e2e None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:07.302586 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086ffb38-6e9e-4f13-98c5-f70301b56e2e None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:07.305752 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 87/173] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:10:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:10:07.307193 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35085bb-e3c8-4b8f-b1c4-6a9f1058313c None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:07.307985 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35085bb-e3c8-4b8f-b1c4-6a9f1058313c None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:07.308429 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35085bb-e3c8-4b8f-b1c4-6a9f1058313c None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:07.310464 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 88/174] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:10:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:10:07.311717 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35085bb-e3c8-4b8f-b1c4-6a9f1058313c None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:07.363645 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:07.420119 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb988390-41ab-438e-8b51-ac0b4a88cb01 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:07.453769 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:07.461289 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35085bb-e3c8-4b8f-b1c4-6a9f1058313c None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:07.472035 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341ab191-cf33-4d49-b5cb-4cd3c6487f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:07.472823 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341ab191-cf33-4d49-b5cb-4cd3c6487f0b None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:07.473114 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341ab191-cf33-4d49-b5cb-4cd3c6487f0b None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:07.473424 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341ab191-cf33-4d49-b5cb-4cd3c6487f0b None admin] PATH_INFO: `/v3/projects/ac207cd789b74f988a87a52d5f481c84` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:07.475488 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341ab191-cf33-4d49-b5cb-4cd3c6487f0b None admin] RBAC: Authorizing `identity:get_project(project_id=ac207cd789b74f988a87a52d5f481c84)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:07.477419 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341ab191-cf33-4d49-b5cb-4cd3c6487f0b None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:07.479406 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 87/175] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Sep 20 22:10:07 2022] GET /identity/v3/projects/ac207cd789b74f988a87a52d5f481c84 => generated 312 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:07.481529 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdb937f-9c79-4531-8c1b-5c6ed2b92b8e None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:07.482007 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdb937f-9c79-4531-8c1b-5c6ed2b92b8e None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:07.482471 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdb937f-9c79-4531-8c1b-5c6ed2b92b8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:07.507135 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-acdb937f-9c79-4531-8c1b-5c6ed2b92b8e None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:10:07.508733 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f835329-60fe-4b03-bc38-5c16497d421f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:07.509082 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-acdb937f-9c79-4531-8c1b-5c6ed2b92b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:10:07.509826 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f835329-60fe-4b03-bc38-5c16497d421f None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:07.510309 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f835329-60fe-4b03-bc38-5c16497d421f None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:07.510812 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f835329-60fe-4b03-bc38-5c16497d421f None admin] PATH_INFO: `/v3/projects/be4987daebfd4f378eb4bc9efc68e66c` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:07.513126 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f835329-60fe-4b03-bc38-5c16497d421f None admin] RBAC: Authorizing `identity:get_project(project_id=be4987daebfd4f378eb4bc9efc68e66c)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:07.514822 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f835329-60fe-4b03-bc38-5c16497d421f None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:07.516664 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 89/176] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Sep 20 22:10:07 2022] GET /identity/v3/projects/be4987daebfd4f378eb4bc9efc68e66c => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:07.517622 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f835329-60fe-4b03-bc38-5c16497d421f None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:07.591985 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 88/177] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:10:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 22:10:07.593598 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa32ec83-8cf3-4609-9308-f417f54e1860 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:07.594098 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa32ec83-8cf3-4609-9308-f417f54e1860 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:07.594608 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa32ec83-8cf3-4609-9308-f417f54e1860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:07.614494 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-fa32ec83-8cf3-4609-9308-f417f54e1860 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:10:07.616153 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-fa32ec83-8cf3-4609-9308-f417f54e1860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:10:07.644865 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f835329-60fe-4b03-bc38-5c16497d421f None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:07.677566 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:07.685591 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291173a2-c56d-4ba5-a6fe-3595f20a23c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:07.686345 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291173a2-c56d-4ba5-a6fe-3595f20a23c3 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:07.686732 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291173a2-c56d-4ba5-a6fe-3595f20a23c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:07.687081 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291173a2-c56d-4ba5-a6fe-3595f20a23c3 None admin] PATH_INFO: `/v3/users/85f4e64839754c658de5c3fe0e1220a9` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:07.688514 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291173a2-c56d-4ba5-a6fe-3595f20a23c3 None admin] RBAC: Authorizing `identity:get_user(user_id=85f4e64839754c658de5c3fe0e1220a9)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:07.690219 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291173a2-c56d-4ba5-a6fe-3595f20a23c3 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:07.692348 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 89/179] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:10:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 22:10:07.692524 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 90/179] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Sep 20 22:10:07 2022] GET /identity/v3/users/85f4e64839754c658de5c3fe0e1220a9 => generated 247 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:07.693504 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291173a2-c56d-4ba5-a6fe-3595f20a23c3 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:07.693620 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa32ec83-8cf3-4609-9308-f417f54e1860 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:07.734539 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:07.808063 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291173a2-c56d-4ba5-a6fe-3595f20a23c3 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:07.828242 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa32ec83-8cf3-4609-9308-f417f54e1860 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:07.844778 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a73edaa-ef92-4e45-8f00-a5ef3613c1ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:07.845425 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a73edaa-ef92-4e45-8f00-a5ef3613c1ef None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:07.845776 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a73edaa-ef92-4e45-8f00-a5ef3613c1ef None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:07.846346 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a73edaa-ef92-4e45-8f00-a5ef3613c1ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:07.847036 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a73edaa-ef92-4e45-8f00-a5ef3613c1ef None admin] RBAC: Adding query filter params (role.id=604444e7ad0d437dbd1f5a6e02b761f5, scope.project.id=ac207cd789b74f988a87a52d5f481c84, user.id=353bf7be83974c0e8e94f1044be36966) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:10:07.847417 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a73edaa-ef92-4e45-8f00-a5ef3613c1ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:07.848919 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a73edaa-ef92-4e45-8f00-a5ef3613c1ef None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:07.856061 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 91/180] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Sep 20 22:10:07 2022] GET /identity/v3/role_assignments?user.id=353bf7be83974c0e8e94f1044be36966&scope.project.id=ac207cd789b74f988a87a52d5f481c84&role.id=604444e7ad0d437dbd1f5a6e02b761f5 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:07.863037 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a73edaa-ef92-4e45-8f00-a5ef3613c1ef None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:07.873100 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494ab381-41ec-47ba-8549-84764eb77a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:07.874191 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ab381-41ec-47ba-8549-84764eb77a3b None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:07.874712 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ab381-41ec-47ba-8549-84764eb77a3b None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:07.875153 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ab381-41ec-47ba-8549-84764eb77a3b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:07.876117 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494ab381-41ec-47ba-8549-84764eb77a3b None admin] RBAC: Adding query filter params (role.id=4e75d58a1e0e4fffa940914b1e5f46de, scope.project.id=be4987daebfd4f378eb4bc9efc68e66c, user.id=353bf7be83974c0e8e94f1044be36966) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:10:07.876657 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494ab381-41ec-47ba-8549-84764eb77a3b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:07.878677 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494ab381-41ec-47ba-8549-84764eb77a3b None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:07.891295 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 90/181] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Sep 20 22:10:07 2022] GET /identity/v3/role_assignments?user.id=353bf7be83974c0e8e94f1044be36966&scope.project.id=be4987daebfd4f378eb4bc9efc68e66c&role.id=4e75d58a1e0e4fffa940914b1e5f46de => generated 608 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:07.895422 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1cc099-dab3-4715-9c5e-c6df94d000c1 None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:07.896152 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1cc099-dab3-4715-9c5e-c6df94d000c1 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:07.898347 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1cc099-dab3-4715-9c5e-c6df94d000c1 None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:07.901566 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 91/182] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:10:07 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:10:07.903223 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cf95f2-79ab-4596-9d52-034d959283d5 None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:07.904768 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cf95f2-79ab-4596-9d52-034d959283d5 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:07.905442 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cf95f2-79ab-4596-9d52-034d959283d5 None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:07.909327 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 92/183] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:10:07 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:10:07.910938 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a227ed-fe8a-4b89-b97b-447d7724543f None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:07.913453 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a227ed-fe8a-4b89-b97b-447d7724543f None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:07.914498 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a227ed-fe8a-4b89-b97b-447d7724543f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:07.949063 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-84a227ed-fe8a-4b89-b97b-447d7724543f None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:10:07.950783 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-84a227ed-fe8a-4b89-b97b-447d7724543f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:10:08.050930 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:08.081452 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:08.086832 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a73edaa-ef92-4e45-8f00-a5ef3613c1ef None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:08.087162 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 93/184] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:10:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 22:10:08.088440 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6542e3e-6902-4a85-9fb8-0d070526e7e4 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:08.088730 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6542e3e-6902-4a85-9fb8-0d070526e7e4 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:08.090823 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6542e3e-6902-4a85-9fb8-0d070526e7e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:08.115506 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-f6542e3e-6902-4a85-9fb8-0d070526e7e4 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:10:08.117636 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-f6542e3e-6902-4a85-9fb8-0d070526e7e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:10:08.129745 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafb3d4c-6470-4be7-8b77-25fb6deaf8a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:08.130365 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafb3d4c-6470-4be7-8b77-25fb6deaf8a6 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:08.131597 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafb3d4c-6470-4be7-8b77-25fb6deaf8a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:08.131870 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafb3d4c-6470-4be7-8b77-25fb6deaf8a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:08.205436 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 94/185] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:10:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 22:10:08.206960 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6542e3e-6902-4a85-9fb8-0d070526e7e4 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:08.223707 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafb3d4c-6470-4be7-8b77-25fb6deaf8a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:08.225738 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafb3d4c-6470-4be7-8b77-25fb6deaf8a6 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:08.344068 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6542e3e-6902-4a85-9fb8-0d070526e7e4 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:08.367660 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:08.371166 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:08.377281 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 92/186] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 20 22:10:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 20 22:10:08.377281 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafb3d4c-6470-4be7-8b77-25fb6deaf8a6 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:08.388741 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2d3b53-1115-4520-9a84-dee1483a1bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:08.389655 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d3b53-1115-4520-9a84-dee1483a1bcc None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:08.390143 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d3b53-1115-4520-9a84-dee1483a1bcc None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:08.390660 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d3b53-1115-4520-9a84-dee1483a1bcc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:08.402628 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2d3b53-1115-4520-9a84-dee1483a1bcc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 22:10:08.407518 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-df2d3b53-1115-4520-9a84-dee1483a1bcc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 22:10:08.407518 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:10:08.407518 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:10:08.407518 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:10:08.407518 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:10:08.407518 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:10:08.407518 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:10:08.407518 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:10:08.407518 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:10:08.407518 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:10:08.407518 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:10:08.407518 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:10:08.407518 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 22:10:08.407518 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 22:10:08.407518 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 22:10:08.407518 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 22:10:08.408376 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 22:10:08.408376 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 22:10:08.408376 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 22:10:08.408376 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 22:10:08.408376 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:10:08.408376 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:10:08.408376 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:10:08.408376 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:10:08.408376 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:10:08.408376 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:10:08.408376 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:10:08.408376 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:10:08.408376 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:10:08.408376 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:10:08.408376 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:10:08.408376 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:10:08.409186 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:10:08.409186 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:10:08.409186 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:10:08.409186 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:10:08.409186 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 22:10:08.409186 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 22:10:08.409186 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 22:10:08.409186 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 22:10:08.409186 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 22:10:08.409186 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 22:10:08.409186 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 22:10:08.409186 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:10:08.409186 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 95/187] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Sep 20 22:10:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:10:08.409833 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2d3b53-1115-4520-9a84-dee1483a1bcc None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:08.492299 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafb3d4c-6470-4be7-8b77-25fb6deaf8a6 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:08.517251 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2d3b53-1115-4520-9a84-dee1483a1bcc None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:08.527904 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475257d9-89da-4a3d-9604-18da1208d344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:08.528530 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475257d9-89da-4a3d-9604-18da1208d344 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:08.528813 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475257d9-89da-4a3d-9604-18da1208d344 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:08.529086 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475257d9-89da-4a3d-9604-18da1208d344 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:08.539465 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475257d9-89da-4a3d-9604-18da1208d344 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 22:10:08.544202 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-475257d9-89da-4a3d-9604-18da1208d344 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 20 22:10:08.544202 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:10:08.544202 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:10:08.544202 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:10:08.544202 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:10:08.544202 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:10:08.544202 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:10:08.544202 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:10:08.544202 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:10:08.544202 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:10:08.544202 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:10:08.544202 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:10:08.544202 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 22:10:08.544202 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 22:10:08.544202 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 22:10:08.544202 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 22:10:08.545087 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 22:10:08.545087 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 22:10:08.545087 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 22:10:08.545087 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 22:10:08.545087 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:10:08.545087 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:10:08.545087 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:10:08.545087 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:10:08.545087 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:10:08.545087 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:10:08.545087 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:10:08.545087 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:10:08.545087 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:10:08.545087 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:10:08.545087 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:10:08.545087 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:10:08.545878 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:10:08.545878 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:10:08.545878 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:10:08.545878 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:10:08.545878 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 22:10:08.545878 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 22:10:08.545878 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 22:10:08.545878 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 22:10:08.545878 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 22:10:08.545878 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 22:10:08.545878 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 20 22:10:08.545878 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:10:08.545878 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 93/188] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 20 22:10:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:10:08.546544 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475257d9-89da-4a3d-9604-18da1208d344 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:08.552488 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a940dd63-2856-4c07-a9ba-c8ee18253f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:08.553199 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a940dd63-2856-4c07-a9ba-c8ee18253f91 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:08.553547 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a940dd63-2856-4c07-a9ba-c8ee18253f91 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:08.553887 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a940dd63-2856-4c07-a9ba-c8ee18253f91 None admin] PATH_INFO: `/v3/projects/be4987daebfd4f378eb4bc9efc68e66c` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:08.555397 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a940dd63-2856-4c07-a9ba-c8ee18253f91 None admin] RBAC: Authorizing `identity:get_project(project_id=be4987daebfd4f378eb4bc9efc68e66c)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:08.556845 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a940dd63-2856-4c07-a9ba-c8ee18253f91 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:08.558468 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 96/189] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Sep 20 22:10:08 2022] GET /identity/v3/projects/be4987daebfd4f378eb4bc9efc68e66c => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:08.559232 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a940dd63-2856-4c07-a9ba-c8ee18253f91 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:08.601804 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:08.603632 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:08.644758 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475257d9-89da-4a3d-9604-18da1208d344 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:08.659112 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a940dd63-2856-4c07-a9ba-c8ee18253f91 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:08.677791 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3900a8c-1281-4df0-86e1-43df5b839143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:08.678405 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3900a8c-1281-4df0-86e1-43df5b839143 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:08.678705 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3900a8c-1281-4df0-86e1-43df5b839143 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:08.678977 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3900a8c-1281-4df0-86e1-43df5b839143 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:08.680377 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3900a8c-1281-4df0-86e1-43df5b839143 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:08.681837 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3900a8c-1281-4df0-86e1-43df5b839143 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:08.683418 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 94/190] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 20 22:10:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:08.684165 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3900a8c-1281-4df0-86e1-43df5b839143 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:08.695510 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba5c327-0e86-45d9-8151-21491075b618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:08.696119 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba5c327-0e86-45d9-8151-21491075b618 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:08.696424 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba5c327-0e86-45d9-8151-21491075b618 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:08.696699 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba5c327-0e86-45d9-8151-21491075b618 None admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:08.697367 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba5c327-0e86-45d9-8151-21491075b618 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:10:08.697673 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba5c327-0e86-45d9-8151-21491075b618 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:08.699087 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba5c327-0e86-45d9-8151-21491075b618 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:08.707184 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 97/191] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 20 22:10:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:08.707954 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba5c327-0e86-45d9-8151-21491075b618 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:08.784660 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3900a8c-1281-4df0-86e1-43df5b839143 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:08.805379 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba5c327-0e86-45d9-8151-21491075b618 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:08.807996 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:08.810346 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:08.820914 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468ef2fd-986e-431c-97ef-482ab7b1ed82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:08.821542 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468ef2fd-986e-431c-97ef-482ab7b1ed82 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:08.821806 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468ef2fd-986e-431c-97ef-482ab7b1ed82 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:08.822070 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468ef2fd-986e-431c-97ef-482ab7b1ed82 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:08.831997 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468ef2fd-986e-431c-97ef-482ab7b1ed82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 22:10:08.836809 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-468ef2fd-986e-431c-97ef-482ab7b1ed82 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 20 22:10:08.836809 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:10:08.836809 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:10:08.836809 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:10:08.836809 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:10:08.836809 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:10:08.836809 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:10:08.836809 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:10:08.836809 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:10:08.836809 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:10:08.836809 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:10:08.836809 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:10:08.836809 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 22:10:08.836809 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 22:10:08.836809 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 22:10:08.836809 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 22:10:08.837654 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 22:10:08.837654 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 22:10:08.837654 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 22:10:08.837654 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 22:10:08.837654 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:10:08.837654 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:10:08.837654 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:10:08.837654 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:10:08.837654 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:10:08.837654 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:10:08.837654 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:10:08.837654 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:10:08.837654 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:10:08.837654 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:10:08.837654 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:10:08.837654 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:10:08.838848 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:10:08.838848 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:10:08.838848 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:10:08.838848 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:10:08.838848 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 22:10:08.838848 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 22:10:08.838848 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 22:10:08.838848 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 22:10:08.838848 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 22:10:08.838848 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 22:10:08.838848 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 20 22:10:08.838848 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:10:08.838848 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 95/192] 10.222.0.33 () {56 vars in 1114 bytes} [Tue Sep 20 22:10:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:10:08.839750 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468ef2fd-986e-431c-97ef-482ab7b1ed82 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:08.843330 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851575b2-bb65-4b80-bc99-fd3a28de4530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:08.843954 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851575b2-bb65-4b80-bc99-fd3a28de4530 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:08.844236 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851575b2-bb65-4b80-bc99-fd3a28de4530 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:08.844510 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851575b2-bb65-4b80-bc99-fd3a28de4530 None admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:08.845179 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851575b2-bb65-4b80-bc99-fd3a28de4530 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:10:08.845484 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851575b2-bb65-4b80-bc99-fd3a28de4530 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:08.846897 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851575b2-bb65-4b80-bc99-fd3a28de4530 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:08.855017 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 98/193] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Sep 20 22:10:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:08.855887 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851575b2-bb65-4b80-bc99-fd3a28de4530 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:08.940817 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468ef2fd-986e-431c-97ef-482ab7b1ed82 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:08.955279 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851575b2-bb65-4b80-bc99-fd3a28de4530 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:08.974993 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1645f2a2-f927-46be-b5d0-e9b64d096252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:08.975592 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1645f2a2-f927-46be-b5d0-e9b64d096252 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:08.975870 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1645f2a2-f927-46be-b5d0-e9b64d096252 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:08.976174 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1645f2a2-f927-46be-b5d0-e9b64d096252 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:08.976892 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1645f2a2-f927-46be-b5d0-e9b64d096252 None admin] RBAC: Adding query filter params (role.id=8a829170b29d42d6af589399e51edb0f, scope.project.id=be4987daebfd4f378eb4bc9efc68e66c, user.id=85f4e64839754c658de5c3fe0e1220a9) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:10:08.977201 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1645f2a2-f927-46be-b5d0-e9b64d096252 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:08.978634 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1645f2a2-f927-46be-b5d0-e9b64d096252 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:08.984151 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 96/194] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Sep 20 22:10:08 2022] GET /identity/v3/role_assignments?user.id=85f4e64839754c658de5c3fe0e1220a9&scope.project.id=be4987daebfd4f378eb4bc9efc68e66c&role.id=8a829170b29d42d6af589399e51edb0f => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:08.985000 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1645f2a2-f927-46be-b5d0-e9b64d096252 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:08.990179 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf810291-f879-4afe-9b13-7d1fe83cf552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:08.991053 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf810291-f879-4afe-9b13-7d1fe83cf552 None admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:08.991470 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf810291-f879-4afe-9b13-7d1fe83cf552 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:08.992449 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf810291-f879-4afe-9b13-7d1fe83cf552 None admin] PATH_INFO: `/v3/users` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:08.993287 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf810291-f879-4afe-9b13-7d1fe83cf552 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:08.994959 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf810291-f879-4afe-9b13-7d1fe83cf552 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:09.022600 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 99/195] 10.222.0.33 () {60 vars in 1132 bytes} [Tue Sep 20 22:10:08 2022] POST /identity/v3/users => generated 297 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:10:09.023804 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf810291-f879-4afe-9b13-7d1fe83cf552 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:09.044356 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:09.084877 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:09.118849 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1645f2a2-f927-46be-b5d0-e9b64d096252 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:09.176081 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7d42dc-fdf0-4337-9fb6-bd40b6754e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:09.176739 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7d42dc-fdf0-4337-9fb6-bd40b6754e52 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:09.177016 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7d42dc-fdf0-4337-9fb6-bd40b6754e52 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:09.177288 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7d42dc-fdf0-4337-9fb6-bd40b6754e52 None admin] PATH_INFO: `/v3/users/6e05faf497204dcda41597aed5e1aa2d` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:09.181822 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf810291-f879-4afe-9b13-7d1fe83cf552 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:09.196158 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7d42dc-fdf0-4337-9fb6-bd40b6754e52 None admin] RBAC: Authorizing `identity:get_user(user_id=6e05faf497204dcda41597aed5e1aa2d)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:09.197919 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7d42dc-fdf0-4337-9fb6-bd40b6754e52 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:09.205288 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 97/196] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Sep 20 22:10:08 2022] GET /identity/v3/users/6e05faf497204dcda41597aed5e1aa2d => generated 283 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:09.206367 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7d42dc-fdf0-4337-9fb6-bd40b6754e52 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:09.239664 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904b3d18-42da-4f6e-8eb1-6e5bce0429b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:09.240533 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904b3d18-42da-4f6e-8eb1-6e5bce0429b7 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:09.240958 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904b3d18-42da-4f6e-8eb1-6e5bce0429b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:09.241372 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904b3d18-42da-4f6e-8eb1-6e5bce0429b7 None admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:09.242917 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904b3d18-42da-4f6e-8eb1-6e5bce0429b7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:10:09.243451 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904b3d18-42da-4f6e-8eb1-6e5bce0429b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:09.245010 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904b3d18-42da-4f6e-8eb1-6e5bce0429b7 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:09.258316 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 100/197] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Sep 20 22:10:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:09.259231 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904b3d18-42da-4f6e-8eb1-6e5bce0429b7 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:09.357322 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7d42dc-fdf0-4337-9fb6-bd40b6754e52 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:09.369575 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:09.374496 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:09.394777 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904b3d18-42da-4f6e-8eb1-6e5bce0429b7 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:09.406297 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b9be7c-4f7d-417c-aa33-a9239479bab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:09.407405 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b9be7c-4f7d-417c-aa33-a9239479bab7 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:09.407640 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b9be7c-4f7d-417c-aa33-a9239479bab7 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:09.407874 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b9be7c-4f7d-417c-aa33-a9239479bab7 None admin] PATH_INFO: `/v3/users/29e817501e714549bcbc6bff9175dabf` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:09.409221 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b9be7c-4f7d-417c-aa33-a9239479bab7 None admin] RBAC: Authorizing `identity:get_user(user_id=29e817501e714549bcbc6bff9175dabf)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:09.411256 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b9be7c-4f7d-417c-aa33-a9239479bab7 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:09.413030 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 98/198] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Sep 20 22:10:09 2022] GET /identity/v3/users/29e817501e714549bcbc6bff9175dabf => generated 289 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:09.414175 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b9be7c-4f7d-417c-aa33-a9239479bab7 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:09.440651 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d4a2d4-43d6-48a4-b42c-af1b8b0cdd43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:09.441284 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d4a2d4-43d6-48a4-b42c-af1b8b0cdd43 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:09.441614 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d4a2d4-43d6-48a4-b42c-af1b8b0cdd43 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:09.442223 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d4a2d4-43d6-48a4-b42c-af1b8b0cdd43 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:09.529289 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d4a2d4-43d6-48a4-b42c-af1b8b0cdd43 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:09.531538 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d4a2d4-43d6-48a4-b42c-af1b8b0cdd43 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:09.534809 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b9be7c-4f7d-417c-aa33-a9239479bab7 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:09.572272 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0df3f9-905c-453d-8573-732e9f02b13e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:09.572916 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0df3f9-905c-453d-8573-732e9f02b13e None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:09.573198 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0df3f9-905c-453d-8573-732e9f02b13e None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:09.573473 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0df3f9-905c-453d-8573-732e9f02b13e None admin] PATH_INFO: `/v3/users/6e05faf497204dcda41597aed5e1aa2d` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:09.574963 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0df3f9-905c-453d-8573-732e9f02b13e None admin] RBAC: Authorizing `identity:get_user(user_id=6e05faf497204dcda41597aed5e1aa2d)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:09.576414 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0df3f9-905c-453d-8573-732e9f02b13e None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:09.578245 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 99/199] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Sep 20 22:10:09 2022] GET /identity/v3/users/6e05faf497204dcda41597aed5e1aa2d => generated 283 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:09.579462 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0df3f9-905c-453d-8573-732e9f02b13e None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:09.633508 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:09.648540 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:09.667025 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 101/200] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 20 22:10:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 20 22:10:09.668125 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d4a2d4-43d6-48a4-b42c-af1b8b0cdd43 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:09.705276 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0df3f9-905c-453d-8573-732e9f02b13e None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:09.750393 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491ba5e7-241b-4969-a6cc-66369c782b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:09.751065 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491ba5e7-241b-4969-a6cc-66369c782b75 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:09.751347 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491ba5e7-241b-4969-a6cc-66369c782b75 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:09.753216 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491ba5e7-241b-4969-a6cc-66369c782b75 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:09.784140 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d4a2d4-43d6-48a4-b42c-af1b8b0cdd43 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:09.821332 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f74976-1920-484b-b8ea-1eb1bdf5d65b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:09.822184 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f74976-1920-484b-b8ea-1eb1bdf5d65b None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:09.822661 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f74976-1920-484b-b8ea-1eb1bdf5d65b None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:09.823076 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f74976-1920-484b-b8ea-1eb1bdf5d65b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:09.829342 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491ba5e7-241b-4969-a6cc-66369c782b75 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:09.830962 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491ba5e7-241b-4969-a6cc-66369c782b75 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:09.878601 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:09.879767 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:09.898091 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f74976-1920-484b-b8ea-1eb1bdf5d65b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:09.900019 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f74976-1920-484b-b8ea-1eb1bdf5d65b None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:09.947056 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 100/201] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 20 22:10:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 20 22:10:09.948664 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491ba5e7-241b-4969-a6cc-66369c782b75 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:10.014156 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 102/202] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 20 22:10:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 20 22:10:10.015198 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f74976-1920-484b-b8ea-1eb1bdf5d65b None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:10.065104 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491ba5e7-241b-4969-a6cc-66369c782b75 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:10.108594 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b2f283-6c73-425e-9326-4cf20164dd3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:10.109260 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b2f283-6c73-425e-9326-4cf20164dd3f None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:10.109548 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b2f283-6c73-425e-9326-4cf20164dd3f None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:10.109823 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b2f283-6c73-425e-9326-4cf20164dd3f None admin] PATH_INFO: `/v3/projects/52f32cd0707b4e2c922768eddcc432e5` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:10.111777 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b2f283-6c73-425e-9326-4cf20164dd3f None admin] RBAC: Authorizing `identity:get_project(project_id=52f32cd0707b4e2c922768eddcc432e5)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:10.112625 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b2f283-6c73-425e-9326-4cf20164dd3f None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:10.114726 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 101/203] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Sep 20 22:10:09 2022] GET /identity/v3/projects/52f32cd0707b4e2c922768eddcc432e5 => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:10.115596 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b2f283-6c73-425e-9326-4cf20164dd3f None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:10.131579 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:10.132954 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:10.156001 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f74976-1920-484b-b8ea-1eb1bdf5d65b None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:10.201509 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c86848-0f1e-4b2a-b0b0-dc44d909894a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:10.202532 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c86848-0f1e-4b2a-b0b0-dc44d909894a None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:10.202986 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c86848-0f1e-4b2a-b0b0-dc44d909894a None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:10.203504 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c86848-0f1e-4b2a-b0b0-dc44d909894a None admin] PATH_INFO: `/v3/projects/be4987daebfd4f378eb4bc9efc68e66c` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:10.204862 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c86848-0f1e-4b2a-b0b0-dc44d909894a None admin] RBAC: Authorizing `identity:get_project(project_id=be4987daebfd4f378eb4bc9efc68e66c)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:10.206679 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c86848-0f1e-4b2a-b0b0-dc44d909894a None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:10.208954 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 103/204] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Sep 20 22:10:10 2022] GET /identity/v3/projects/be4987daebfd4f378eb4bc9efc68e66c => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:10.209903 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c86848-0f1e-4b2a-b0b0-dc44d909894a None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:10.235175 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b2f283-6c73-425e-9326-4cf20164dd3f None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:10.271549 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759ee95d-9e51-4a6c-a2b1-0fbb2f1e4eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:10.272505 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ee95d-9e51-4a6c-a2b1-0fbb2f1e4eb1 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:10.273023 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ee95d-9e51-4a6c-a2b1-0fbb2f1e4eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:10.273568 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ee95d-9e51-4a6c-a2b1-0fbb2f1e4eb1 None admin] PATH_INFO: `/v3/projects/52f32cd0707b4e2c922768eddcc432e5` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:10.274927 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759ee95d-9e51-4a6c-a2b1-0fbb2f1e4eb1 None admin] RBAC: Authorizing `identity:get_project(project_id=52f32cd0707b4e2c922768eddcc432e5)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:10.276584 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759ee95d-9e51-4a6c-a2b1-0fbb2f1e4eb1 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:10.278749 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 102/205] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Sep 20 22:10:10 2022] GET /identity/v3/projects/52f32cd0707b4e2c922768eddcc432e5 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:10.279772 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759ee95d-9e51-4a6c-a2b1-0fbb2f1e4eb1 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:10.345381 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c86848-0f1e-4b2a-b0b0-dc44d909894a None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:10.381035 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334c10e9-7493-490d-84b1-eb58e67f064d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:10.382471 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334c10e9-7493-490d-84b1-eb58e67f064d None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:10.383004 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334c10e9-7493-490d-84b1-eb58e67f064d None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:10.383483 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334c10e9-7493-490d-84b1-eb58e67f064d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:10.384457 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334c10e9-7493-490d-84b1-eb58e67f064d None admin] RBAC: Adding query filter params (role.id=8a829170b29d42d6af589399e51edb0f, scope.project.id=52f32cd0707b4e2c922768eddcc432e5, user.id=6e05faf497204dcda41597aed5e1aa2d) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:10:10.384971 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334c10e9-7493-490d-84b1-eb58e67f064d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:10.386655 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334c10e9-7493-490d-84b1-eb58e67f064d None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:10.389203 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:10.393672 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 104/206] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Sep 20 22:10:10 2022] GET /identity/v3/role_assignments?user.id=6e05faf497204dcda41597aed5e1aa2d&scope.project.id=52f32cd0707b4e2c922768eddcc432e5&role.id=8a829170b29d42d6af589399e51edb0f => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:10.394950 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334c10e9-7493-490d-84b1-eb58e67f064d None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:10.416507 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:10.418998 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759ee95d-9e51-4a6c-a2b1-0fbb2f1e4eb1 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:10.469990 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b114885e-5066-49d4-a7a2-a3d12073a3af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:10.471013 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b114885e-5066-49d4-a7a2-a3d12073a3af None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:10.471508 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b114885e-5066-49d4-a7a2-a3d12073a3af None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:10.471972 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b114885e-5066-49d4-a7a2-a3d12073a3af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:10.472907 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b114885e-5066-49d4-a7a2-a3d12073a3af None admin] RBAC: Adding query filter params (role.id=22cfe7a128b64671998d0ff9c54f8ce4, scope.project.id=be4987daebfd4f378eb4bc9efc68e66c, user.id=29e817501e714549bcbc6bff9175dabf) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:10:10.473433 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b114885e-5066-49d4-a7a2-a3d12073a3af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:10.477530 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b114885e-5066-49d4-a7a2-a3d12073a3af None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:10.496943 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 103/207] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Sep 20 22:10:10 2022] GET /identity/v3/role_assignments?user.id=29e817501e714549bcbc6bff9175dabf&scope.project.id=be4987daebfd4f378eb4bc9efc68e66c&role.id=22cfe7a128b64671998d0ff9c54f8ce4 => generated 608 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:10.529245 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334c10e9-7493-490d-84b1-eb58e67f064d None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:10.572353 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38525f16-f658-4937-af9d-e2b556ea71dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:10.573369 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38525f16-f658-4937-af9d-e2b556ea71dd None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:10.573847 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38525f16-f658-4937-af9d-e2b556ea71dd None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:10.574319 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38525f16-f658-4937-af9d-e2b556ea71dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:10.575353 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38525f16-f658-4937-af9d-e2b556ea71dd None admin] RBAC: Adding query filter params (role.id=4e75d58a1e0e4fffa940914b1e5f46de, scope.project.id=52f32cd0707b4e2c922768eddcc432e5, user.id=6e05faf497204dcda41597aed5e1aa2d) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:10:10.575972 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38525f16-f658-4937-af9d-e2b556ea71dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:10.577736 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38525f16-f658-4937-af9d-e2b556ea71dd None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:10.584838 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 105/208] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Sep 20 22:10:10 2022] GET /identity/v3/role_assignments?user.id=6e05faf497204dcda41597aed5e1aa2d&scope.project.id=52f32cd0707b4e2c922768eddcc432e5&role.id=4e75d58a1e0e4fffa940914b1e5f46de => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:11.563766 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c4e500-7865-443f-9b22-6173e128ab90 None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:11.564745 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c4e500-7865-443f-9b22-6173e128ab90 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:11.565293 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c4e500-7865-443f-9b22-6173e128ab90 None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:11.567141 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 104/209] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:10:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:10:11.572458 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f033c5a3-173d-4ef2-b1db-6e74d14647ef None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:11.572859 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f033c5a3-173d-4ef2-b1db-6e74d14647ef None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:11.573027 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f033c5a3-173d-4ef2-b1db-6e74d14647ef None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:11.573500 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442b8066-7b4f-47f6-9223-73fa4798f53a None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:11.573973 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442b8066-7b4f-47f6-9223-73fa4798f53a None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:11.574358 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 106/210] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:10:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:10:11.574687 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442b8066-7b4f-47f6-9223-73fa4798f53a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:11.579253 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa21263-58a6-4396-a258-20859dbca051 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:11.579542 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa21263-58a6-4396-a258-20859dbca051 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:11.579816 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa21263-58a6-4396-a258-20859dbca051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:11.596055 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-442b8066-7b4f-47f6-9223-73fa4798f53a None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:10:11.597533 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-442b8066-7b4f-47f6-9223-73fa4798f53a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:10:11.602458 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-2fa21263-58a6-4396-a258-20859dbca051 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:10:11.603668 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-2fa21263-58a6-4396-a258-20859dbca051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:10:11.685968 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 105/211] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:10:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 20 22:10:11.702126 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 107/212] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:10:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 20 22:10:11.951412 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442b8066-7b4f-47f6-9223-73fa4798f53a None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:11.982023 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa21263-58a6-4396-a258-20859dbca051 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:11.995146 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:12.036276 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:12.067573 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442b8066-7b4f-47f6-9223-73fa4798f53a None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:12.089370 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa21263-58a6-4396-a258-20859dbca051 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:12.109307 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c2721c-2f87-4d7b-bb10-33c89b1ea049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:12.109951 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c2721c-2f87-4d7b-bb10-33c89b1ea049 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:12.110233 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c2721c-2f87-4d7b-bb10-33c89b1ea049 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:12.110522 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c2721c-2f87-4d7b-bb10-33c89b1ea049 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:12.111757 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c2721c-2f87-4d7b-bb10-33c89b1ea049 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:12.113195 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c2721c-2f87-4d7b-bb10-33c89b1ea049 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:12.115768 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 106/213] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 20 22:10:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:12.121309 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c2721c-2f87-4d7b-bb10-33c89b1ea049 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:12.132148 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b56e35-d91e-45fc-b15c-d36691ade663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:12.132626 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b56e35-d91e-45fc-b15c-d36691ade663 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:12.132906 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b56e35-d91e-45fc-b15c-d36691ade663 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:12.133177 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b56e35-d91e-45fc-b15c-d36691ade663 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:12.143781 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b56e35-d91e-45fc-b15c-d36691ade663 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 22:10:12.149113 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-c5b56e35-d91e-45fc-b15c-d36691ade663 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 20 22:10:12.149113 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:10:12.149113 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:10:12.149113 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:10:12.149113 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:10:12.149113 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:10:12.149113 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:10:12.149113 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:10:12.149113 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:10:12.149113 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:10:12.149113 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:10:12.149113 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:10:12.149113 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 22:10:12.149113 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 22:10:12.149113 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 22:10:12.149113 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 22:10:12.149971 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 22:10:12.149971 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 22:10:12.149971 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 22:10:12.149971 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 22:10:12.149971 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:10:12.149971 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:10:12.149971 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:10:12.149971 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:10:12.149971 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:10:12.149971 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:10:12.149971 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:10:12.149971 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:10:12.149971 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:10:12.149971 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:10:12.149971 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:10:12.149971 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:10:12.155858 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:10:12.155858 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:10:12.155858 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:10:12.155858 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:10:12.155858 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 22:10:12.155858 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 22:10:12.155858 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 22:10:12.155858 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 22:10:12.155858 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 22:10:12.155858 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 22:10:12.155858 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 20 22:10:12.155858 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:10:12.155858 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 108/214] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 20 22:10:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:10:12.156541 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b56e35-d91e-45fc-b15c-d36691ade663 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:12.249056 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:12.252361 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c2721c-2f87-4d7b-bb10-33c89b1ea049 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:12.285884 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b56e35-d91e-45fc-b15c-d36691ade663 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:12.298029 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ec4a00-ced4-4936-a2c1-a70614dcbcb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:12.299653 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec4a00-ced4-4936-a2c1-a70614dcbcb2 None admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:12.300131 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec4a00-ced4-4936-a2c1-a70614dcbcb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:12.300600 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec4a00-ced4-4936-a2c1-a70614dcbcb2 None admin] PATH_INFO: `/v3/users` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:12.301458 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ec4a00-ced4-4936-a2c1-a70614dcbcb2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:12.303137 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ec4a00-ced4-4936-a2c1-a70614dcbcb2 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:12.324737 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:12.333088 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 107/215] 10.222.0.33 () {60 vars in 1132 bytes} [Tue Sep 20 22:10:12 2022] POST /identity/v3/users => generated 297 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:10:12.342303 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e841f1-4eba-4396-8dfd-730584f436fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:12.343068 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e841f1-4eba-4396-8dfd-730584f436fd None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:12.343354 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e841f1-4eba-4396-8dfd-730584f436fd None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:12.343627 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e841f1-4eba-4396-8dfd-730584f436fd None admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:12.344369 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e841f1-4eba-4396-8dfd-730584f436fd None admin] RBAC: Adding query filter params (name=member) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:10:12.344679 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e841f1-4eba-4396-8dfd-730584f436fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:12.346127 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e841f1-4eba-4396-8dfd-730584f436fd None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:12.356547 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 109/216] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Sep 20 22:10:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:12.365751 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ec4a00-ced4-4936-a2c1-a70614dcbcb2 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:12.482910 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ec4a00-ced4-4936-a2c1-a70614dcbcb2 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:12.520431 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3a69cd-9c10-4714-8e93-df2217d71822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:12.521063 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3a69cd-9c10-4714-8e93-df2217d71822 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:12.521342 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3a69cd-9c10-4714-8e93-df2217d71822 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:12.521612 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3a69cd-9c10-4714-8e93-df2217d71822 None admin] PATH_INFO: `/v3/users/c7cd3768564c4ea5ac5dcd1cac8a8ead` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:12.537856 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3a69cd-9c10-4714-8e93-df2217d71822 None admin] RBAC: Authorizing `identity:get_user(user_id=c7cd3768564c4ea5ac5dcd1cac8a8ead)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:12.539383 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3a69cd-9c10-4714-8e93-df2217d71822 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:12.541423 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 108/217] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Sep 20 22:10:12 2022] GET /identity/v3/users/c7cd3768564c4ea5ac5dcd1cac8a8ead => generated 297 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:12.546963 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e841f1-4eba-4396-8dfd-730584f436fd None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:12.659865 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e841f1-4eba-4396-8dfd-730584f436fd None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:12.696676 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:12.703429 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddd965e-a5ca-4628-ac86-1c06e878fed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:12.704058 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddd965e-a5ca-4628-ac86-1c06e878fed3 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:12.704329 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddd965e-a5ca-4628-ac86-1c06e878fed3 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:12.704600 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddd965e-a5ca-4628-ac86-1c06e878fed3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:12.718569 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3ffc29-e4c8-4bda-bc0f-ba368d875525 None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:12.719056 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3ffc29-e4c8-4bda-bc0f-ba368d875525 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:12.719256 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3ffc29-e4c8-4bda-bc0f-ba368d875525 None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:12.720653 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 109/218] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:10:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 20 22:10:12.725861 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce9921-e4e1-459f-8c32-c6d93a98f826 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:12.726653 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce9921-e4e1-459f-8c32-c6d93a98f826 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:12.726934 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce9921-e4e1-459f-8c32-c6d93a98f826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:12.752558 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-6fce9921-e4e1-459f-8c32-c6d93a98f826 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:10:12.753800 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-6fce9921-e4e1-459f-8c32-c6d93a98f826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:10:12.803438 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddd965e-a5ca-4628-ac86-1c06e878fed3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:12.805834 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddd965e-a5ca-4628-ac86-1c06e878fed3 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:12.835953 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:12.862611 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 110/219] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:10:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 22:10:12.892359 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e61564-ab73-421f-ad84-aab035f2881c None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:12.892651 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e61564-ab73-421f-ad84-aab035f2881c None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:12.892900 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e61564-ab73-421f-ad84-aab035f2881c None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:12.894255 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 111/220] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:10:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 20 22:10:12.899344 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4864326-106c-4545-a141-7da8c3fd7e7f None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:12.899791 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4864326-106c-4545-a141-7da8c3fd7e7f None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:12.900203 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4864326-106c-4545-a141-7da8c3fd7e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:12.918933 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-c4864326-106c-4545-a141-7da8c3fd7e7f None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:10:12.920356 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-c4864326-106c-4545-a141-7da8c3fd7e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:10:12.966418 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 110/221] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 20 22:10:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 20 22:10:12.971743 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddd965e-a5ca-4628-ac86-1c06e878fed3 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:13.012592 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 112/222] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:10:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 20 22:10:13.029098 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:13.115375 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddd965e-a5ca-4628-ac86-1c06e878fed3 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:13.151202 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385c342e-9ff5-464b-975d-d24511606a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:13.151832 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385c342e-9ff5-464b-975d-d24511606a4e None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:13.152108 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385c342e-9ff5-464b-975d-d24511606a4e None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:13.152381 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385c342e-9ff5-464b-975d-d24511606a4e None admin] PATH_INFO: `/v3/projects/52f32cd0707b4e2c922768eddcc432e5` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:13.153504 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385c342e-9ff5-464b-975d-d24511606a4e None admin] RBAC: Authorizing `identity:get_project(project_id=52f32cd0707b4e2c922768eddcc432e5)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:13.155043 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385c342e-9ff5-464b-975d-d24511606a4e None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:13.157301 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 111/223] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Sep 20 22:10:12 2022] GET /identity/v3/projects/52f32cd0707b4e2c922768eddcc432e5 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 22:10:13.163429 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4864326-106c-4545-a141-7da8c3fd7e7f None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:13.226486 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385c342e-9ff5-464b-975d-d24511606a4e None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:13.344830 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4864326-106c-4545-a141-7da8c3fd7e7f None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:13.380940 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:13.384950 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:13.385992 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385c342e-9ff5-464b-975d-d24511606a4e None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:13.421980 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af57d092-c6f8-40b5-a0ad-de864f3970ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:13.422646 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af57d092-c6f8-40b5-a0ad-de864f3970ec None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:13.422927 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af57d092-c6f8-40b5-a0ad-de864f3970ec None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:13.423196 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af57d092-c6f8-40b5-a0ad-de864f3970ec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:13.428268 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2be080-5714-4fce-a435-6c48a2bd2be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:13.429677 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2be080-5714-4fce-a435-6c48a2bd2be8 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:13.430173 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2be080-5714-4fce-a435-6c48a2bd2be8 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:13.430682 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2be080-5714-4fce-a435-6c48a2bd2be8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:13.431653 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2be080-5714-4fce-a435-6c48a2bd2be8 None admin] RBAC: Adding query filter params (role.id=604444e7ad0d437dbd1f5a6e02b761f5, scope.project.id=52f32cd0707b4e2c922768eddcc432e5, user.id=c7cd3768564c4ea5ac5dcd1cac8a8ead) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:10:13.432158 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2be080-5714-4fce-a435-6c48a2bd2be8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:13.433852 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2be080-5714-4fce-a435-6c48a2bd2be8 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:13.436080 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af57d092-c6f8-40b5-a0ad-de864f3970ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 22:10:13.440055 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 113/224] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Sep 20 22:10:13 2022] GET /identity/v3/role_assignments?user.id=c7cd3768564c4ea5ac5dcd1cac8a8ead&scope.project.id=52f32cd0707b4e2c922768eddcc432e5&role.id=604444e7ad0d437dbd1f5a6e02b761f5 => generated 259 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:13.445490 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-af57d092-c6f8-40b5-a0ad-de864f3970ec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 22:10:13.445490 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:10:13.445490 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:10:13.445490 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:10:13.445490 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:10:13.445490 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:10:13.445490 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:10:13.445490 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:10:13.445490 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:10:13.445490 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:10:13.445490 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:10:13.445490 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:10:13.445490 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 22:10:13.445490 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 22:10:13.445490 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 22:10:13.445490 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 22:10:13.446411 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 22:10:13.446411 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 22:10:13.446411 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 22:10:13.446411 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 22:10:13.446411 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:10:13.446411 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:10:13.446411 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:10:13.446411 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:10:13.446411 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:10:13.446411 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:10:13.446411 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:10:13.446411 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:10:13.446411 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:10:13.446411 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:10:13.446411 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:10:13.446411 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:10:13.447231 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:10:13.447231 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:10:13.447231 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:10:13.447231 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:10:13.447231 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 22:10:13.447231 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 22:10:13.447231 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 22:10:13.447231 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 22:10:13.447231 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 22:10:13.447231 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 22:10:13.447231 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 22:10:13.447231 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:10:13.447231 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 112/225] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Sep 20 22:10:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 20 22:10:13.447231 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af57d092-c6f8-40b5-a0ad-de864f3970ec None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:13.449533 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2be080-5714-4fce-a435-6c48a2bd2be8 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:13.567018 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af57d092-c6f8-40b5-a0ad-de864f3970ec None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:13.606399 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8b618a-4889-4d9e-8968-ddcfcc44e262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:13.607177 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8b618a-4889-4d9e-8968-ddcfcc44e262 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:13.607458 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8b618a-4889-4d9e-8968-ddcfcc44e262 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:13.607728 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8b618a-4889-4d9e-8968-ddcfcc44e262 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:13.621872 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8b618a-4889-4d9e-8968-ddcfcc44e262 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 22:10:13.628643 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-bc8b618a-4889-4d9e-8968-ddcfcc44e262 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 20 22:10:13.628643 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:10:13.628643 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:10:13.628643 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:10:13.628643 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:10:13.628643 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:10:13.628643 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:10:13.628643 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:10:13.628643 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:10:13.628643 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:10:13.628643 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:10:13.628643 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:10:13.628643 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 22:10:13.628643 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 22:10:13.628643 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 22:10:13.628643 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 22:10:13.629577 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 22:10:13.629577 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 22:10:13.629577 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 22:10:13.629577 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 22:10:13.629577 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:10:13.629577 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:10:13.629577 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:10:13.629577 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:10:13.629577 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:10:13.629577 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:10:13.629577 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:10:13.629577 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:10:13.629577 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:10:13.629577 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:10:13.629577 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:10:13.629577 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:10:13.630354 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:10:13.630354 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:10:13.630354 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:10:13.630354 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:10:13.630354 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 22:10:13.630354 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 22:10:13.630354 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 22:10:13.630354 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 22:10:13.630354 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 22:10:13.630354 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 22:10:13.630354 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 20 22:10:13.630354 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:10:13.630354 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 113/226] 10.222.0.33 () {56 vars in 1114 bytes} [Tue Sep 20 22:10:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:10:13.642475 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8b618a-4889-4d9e-8968-ddcfcc44e262 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:13.688167 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:13.690517 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2be080-5714-4fce-a435-6c48a2bd2be8 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:13.790276 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cc0cd4-9292-44db-b138-66399a6d541b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:13.790907 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cc0cd4-9292-44db-b138-66399a6d541b None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:13.791196 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cc0cd4-9292-44db-b138-66399a6d541b None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:13.791472 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cc0cd4-9292-44db-b138-66399a6d541b None admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:13.794431 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cc0cd4-9292-44db-b138-66399a6d541b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:10:13.795010 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cc0cd4-9292-44db-b138-66399a6d541b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:13.797523 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cc0cd4-9292-44db-b138-66399a6d541b None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:13.815422 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8b618a-4889-4d9e-8968-ddcfcc44e262 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:13.826646 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 114/227] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 20 22:10:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:13.829371 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cc0cd4-9292-44db-b138-66399a6d541b None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:13.884802 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:13.895325 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d75b937-b412-45ac-a81d-e16c7ba1a14d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:13.895883 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d75b937-b412-45ac-a81d-e16c7ba1a14d None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:13.896164 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d75b937-b412-45ac-a81d-e16c7ba1a14d None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:13.896438 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d75b937-b412-45ac-a81d-e16c7ba1a14d None admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:13.898552 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d75b937-b412-45ac-a81d-e16c7ba1a14d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:10:13.898552 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d75b937-b412-45ac-a81d-e16c7ba1a14d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:13.899567 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d75b937-b412-45ac-a81d-e16c7ba1a14d None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:13.916275 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 114/228] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Sep 20 22:10:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 22:10:13.922118 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d75b937-b412-45ac-a81d-e16c7ba1a14d None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:13.957344 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cc0cd4-9292-44db-b138-66399a6d541b None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:14.001849 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b233de-7b58-4de9-b370-80fb3417fb54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:14.002500 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b233de-7b58-4de9-b370-80fb3417fb54 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:14.002805 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b233de-7b58-4de9-b370-80fb3417fb54 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:14.003074 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b233de-7b58-4de9-b370-80fb3417fb54 None admin] PATH_INFO: `/v3/users/6e05faf497204dcda41597aed5e1aa2d` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:14.004224 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b233de-7b58-4de9-b370-80fb3417fb54 None admin] RBAC: Authorizing `identity:get_user(user_id=6e05faf497204dcda41597aed5e1aa2d)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:14.005676 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b233de-7b58-4de9-b370-80fb3417fb54 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:14.012489 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 115/229] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Sep 20 22:10:13 2022] GET /identity/v3/users/6e05faf497204dcda41597aed5e1aa2d => generated 283 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 22:10:14.014536 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b233de-7b58-4de9-b370-80fb3417fb54 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:14.121890 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:14.156871 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b233de-7b58-4de9-b370-80fb3417fb54 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:14.171823 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d75b937-b412-45ac-a81d-e16c7ba1a14d None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:14.184594 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:14.233010 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b848c868-4637-4b78-96b2-cac4876afdf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:14.233988 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b848c868-4637-4b78-96b2-cac4876afdf2 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:14.234479 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b848c868-4637-4b78-96b2-cac4876afdf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:14.234899 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b848c868-4637-4b78-96b2-cac4876afdf2 None admin] PATH_INFO: `/v3/projects/52f32cd0707b4e2c922768eddcc432e5` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:14.236293 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b848c868-4637-4b78-96b2-cac4876afdf2 None admin] RBAC: Authorizing `identity:get_project(project_id=52f32cd0707b4e2c922768eddcc432e5)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:14.237770 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b848c868-4637-4b78-96b2-cac4876afdf2 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:14.242196 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 116/230] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Sep 20 22:10:14 2022] GET /identity/v3/projects/52f32cd0707b4e2c922768eddcc432e5 => generated 302 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:14.247040 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0b1b93-5519-4b07-a3bd-bc5df22814fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:14.247692 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0b1b93-5519-4b07-a3bd-bc5df22814fa None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:14.248003 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0b1b93-5519-4b07-a3bd-bc5df22814fa None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:14.248248 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0b1b93-5519-4b07-a3bd-bc5df22814fa None admin] PATH_INFO: `/v3/users/6e05faf497204dcda41597aed5e1aa2d` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:14.249601 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b848c868-4637-4b78-96b2-cac4876afdf2 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:14.250560 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0b1b93-5519-4b07-a3bd-bc5df22814fa None admin] RBAC: Authorizing `identity:get_user(user_id=6e05faf497204dcda41597aed5e1aa2d)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:14.252022 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0b1b93-5519-4b07-a3bd-bc5df22814fa None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:14.253739 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 115/231] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Sep 20 22:10:13 2022] GET /identity/v3/users/6e05faf497204dcda41597aed5e1aa2d => generated 283 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 22:10:14.263574 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0b1b93-5519-4b07-a3bd-bc5df22814fa None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:14.369662 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b848c868-4637-4b78-96b2-cac4876afdf2 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:14.406106 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2a19d1-1e2f-4bbe-a566-34b73c6568d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:14.406808 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2a19d1-1e2f-4bbe-a566-34b73c6568d9 None admin] REQUEST_METHOD: `PUT` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:14.407432 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2a19d1-1e2f-4bbe-a566-34b73c6568d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:14.407662 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2a19d1-1e2f-4bbe-a566-34b73c6568d9 None admin] PATH_INFO: `/v3/projects/52f32cd0707b4e2c922768eddcc432e5/users/6e05faf497204dcda41597aed5e1aa2d/roles/8a829170b29d42d6af589399e51edb0f` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:14.410209 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2a19d1-1e2f-4bbe-a566-34b73c6568d9 None admin] RBAC: Authorizing `identity:create_grant(project_id=52f32cd0707b4e2c922768eddcc432e5, user_id=6e05faf497204dcda41597aed5e1aa2d, role_id=8a829170b29d42d6af589399e51edb0f)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:14.411720 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2a19d1-1e2f-4bbe-a566-34b73c6568d9 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:14.427831 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 117/232] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Sep 20 22:10:14 2022] PUT /identity/v3/projects/52f32cd0707b4e2c922768eddcc432e5/users/6e05faf497204dcda41597aed5e1aa2d/roles/8a829170b29d42d6af589399e51edb0f => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:10:14.506812 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0b1b93-5519-4b07-a3bd-bc5df22814fa None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:14.563763 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819e3a9a-b9a8-441a-b339-3c23b1094fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:14.564420 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e3a9a-b9a8-441a-b339-3c23b1094fee None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:14.564699 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e3a9a-b9a8-441a-b339-3c23b1094fee None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:14.564964 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e3a9a-b9a8-441a-b339-3c23b1094fee None admin] PATH_INFO: `/v3/projects/52f32cd0707b4e2c922768eddcc432e5` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:14.571391 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819e3a9a-b9a8-441a-b339-3c23b1094fee None admin] RBAC: Authorizing `identity:get_project(project_id=52f32cd0707b4e2c922768eddcc432e5)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:14.572906 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819e3a9a-b9a8-441a-b339-3c23b1094fee None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:14.574709 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 116/233] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Sep 20 22:10:14 2022] GET /identity/v3/projects/52f32cd0707b4e2c922768eddcc432e5 => generated 302 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:14.580899 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2a19d1-1e2f-4bbe-a566-34b73c6568d9 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:14.654916 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:14.734762 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2a19d1-1e2f-4bbe-a566-34b73c6568d9 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:14.774674 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a6fe88-763e-47e8-a1a9-8e24c5a05bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:14.775416 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a6fe88-763e-47e8-a1a9-8e24c5a05bb9 None admin] REQUEST_METHOD: `PUT` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:14.775689 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a6fe88-763e-47e8-a1a9-8e24c5a05bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:14.775965 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a6fe88-763e-47e8-a1a9-8e24c5a05bb9 None admin] PATH_INFO: `/v3/projects/52f32cd0707b4e2c922768eddcc432e5/users/6e05faf497204dcda41597aed5e1aa2d/roles/4e75d58a1e0e4fffa940914b1e5f46de` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:14.778227 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a6fe88-763e-47e8-a1a9-8e24c5a05bb9 None admin] RBAC: Authorizing `identity:create_grant(project_id=52f32cd0707b4e2c922768eddcc432e5, user_id=6e05faf497204dcda41597aed5e1aa2d, role_id=4e75d58a1e0e4fffa940914b1e5f46de)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:14.779709 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a6fe88-763e-47e8-a1a9-8e24c5a05bb9 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:14.802060 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 118/234] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Sep 20 22:10:14 2022] PUT /identity/v3/projects/52f32cd0707b4e2c922768eddcc432e5/users/6e05faf497204dcda41597aed5e1aa2d/roles/4e75d58a1e0e4fffa940914b1e5f46de => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:10:15.207407 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a84640c-0646-4fd9-abaf-6708fa37c239 None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:15.207936 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a84640c-0646-4fd9-abaf-6708fa37c239 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:15.207936 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a84640c-0646-4fd9-abaf-6708fa37c239 None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:15.209557 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 117/235] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:10:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:10:15.215507 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883076ee-6988-4176-86fa-0c594f43d960 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:15.215793 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883076ee-6988-4176-86fa-0c594f43d960 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:15.216065 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883076ee-6988-4176-86fa-0c594f43d960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:15.234295 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-883076ee-6988-4176-86fa-0c594f43d960 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:10:15.235511 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-883076ee-6988-4176-86fa-0c594f43d960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:10:15.308798 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827bcaf5-16df-45d5-b4b7-9a29bbe8db7b None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:15.308798 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827bcaf5-16df-45d5-b4b7-9a29bbe8db7b None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:15.309051 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827bcaf5-16df-45d5-b4b7-9a29bbe8db7b None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:15.310314 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 118/236] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:10:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:10:15.315329 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aa6eae-0265-4a59-9c55-439a1c79f084 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:15.315667 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aa6eae-0265-4a59-9c55-439a1c79f084 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:15.315876 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aa6eae-0265-4a59-9c55-439a1c79f084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:15.338533 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-f8aa6eae-0265-4a59-9c55-439a1c79f084 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:10:15.338533 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-f8aa6eae-0265-4a59-9c55-439a1c79f084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:10:15.341200 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 119/237] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:10:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 22:10:15.361001 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:15.443006 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 119/238] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:10:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 20 22:10:15.652648 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883076ee-6988-4176-86fa-0c594f43d960 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:15.685751 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:15.780245 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883076ee-6988-4176-86fa-0c594f43d960 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:15.825061 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69717e4a-5508-4ca5-b160-cc69643d93b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:15.825807 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69717e4a-5508-4ca5-b160-cc69643d93b2 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:15.825981 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69717e4a-5508-4ca5-b160-cc69643d93b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:15.826288 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69717e4a-5508-4ca5-b160-cc69643d93b2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:15.840834 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69717e4a-5508-4ca5-b160-cc69643d93b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 22:10:15.845663 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-69717e4a-5508-4ca5-b160-cc69643d93b2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 20 22:10:15.845663 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:10:15.845663 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:10:15.845663 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:10:15.845663 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:10:15.845663 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:10:15.845663 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:10:15.845663 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:10:15.845663 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:10:15.845663 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:10:15.845663 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:10:15.845663 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:10:15.845663 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 22:10:15.845663 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 22:10:15.845663 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 22:10:15.845663 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 22:10:15.846543 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 22:10:15.846543 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 22:10:15.846543 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 22:10:15.846543 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 22:10:15.846543 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:10:15.846543 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:10:15.846543 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:10:15.846543 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:10:15.846543 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:10:15.846543 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:10:15.846543 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:10:15.846543 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:10:15.846543 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:10:15.846543 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:10:15.846543 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:10:15.846543 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:10:15.847320 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:10:15.847320 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:10:15.847320 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:10:15.847320 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:10:15.847320 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 22:10:15.847320 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 22:10:15.847320 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 22:10:15.847320 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 22:10:15.847320 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 22:10:15.847320 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 22:10:15.847320 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 20 22:10:15.847320 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:10:15.847320 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 120/239] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 20 22:10:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:10:15.852901 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aa6eae-0265-4a59-9c55-439a1c79f084 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:15.866089 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69717e4a-5508-4ca5-b160-cc69643d93b2 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:15.996073 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:16.023426 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69717e4a-5508-4ca5-b160-cc69643d93b2 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:16.035102 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aa6eae-0265-4a59-9c55-439a1c79f084 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:16.088736 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe45f8d2-835d-49ae-b174-8c83512de900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:16.089451 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45f8d2-835d-49ae-b174-8c83512de900 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:16.089734 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45f8d2-835d-49ae-b174-8c83512de900 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:16.090009 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45f8d2-835d-49ae-b174-8c83512de900 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:16.091796 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe45f8d2-835d-49ae-b174-8c83512de900 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:16.093505 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe45f8d2-835d-49ae-b174-8c83512de900 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:16.095394 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 121/240] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 20 22:10:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 22:10:16.098241 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ec8cc2-704a-4f56-b882-eca98806a247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:16.099044 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec8cc2-704a-4f56-b882-eca98806a247 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:16.099424 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec8cc2-704a-4f56-b882-eca98806a247 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:16.100610 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe45f8d2-835d-49ae-b174-8c83512de900 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:16.101118 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec8cc2-704a-4f56-b882-eca98806a247 None admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:16.102297 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ec8cc2-704a-4f56-b882-eca98806a247 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:10:16.104649 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ec8cc2-704a-4f56-b882-eca98806a247 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:16.106104 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ec8cc2-704a-4f56-b882-eca98806a247 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:16.127310 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 120/241] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Sep 20 22:10:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:16.133240 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ec8cc2-704a-4f56-b882-eca98806a247 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:16.147367 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:16.243366 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ec8cc2-704a-4f56-b882-eca98806a247 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:16.272464 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe45f8d2-835d-49ae-b174-8c83512de900 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:16.296130 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8578c4cd-17bc-4ae8-99c0-afcf330b43d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:16.296978 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8578c4cd-17bc-4ae8-99c0-afcf330b43d3 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:16.297403 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8578c4cd-17bc-4ae8-99c0-afcf330b43d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:16.297818 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8578c4cd-17bc-4ae8-99c0-afcf330b43d3 None admin] PATH_INFO: `/v3/users/74cc566edfb04bcfbb4f7fb3159c8534` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:16.313674 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8578c4cd-17bc-4ae8-99c0-afcf330b43d3 None admin] RBAC: Authorizing `identity:get_user(user_id=74cc566edfb04bcfbb4f7fb3159c8534)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:16.315396 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8578c4cd-17bc-4ae8-99c0-afcf330b43d3 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:16.317523 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 121/242] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Sep 20 22:10:16 2022] GET /identity/v3/users/74cc566edfb04bcfbb4f7fb3159c8534 => generated 297 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:16.318937 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf094e-c4d4-417c-b605-d2c17f3a2fa0 None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:16.319365 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf094e-c4d4-417c-b605-d2c17f3a2fa0 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:16.320413 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf094e-c4d4-417c-b605-d2c17f3a2fa0 None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:16.321792 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 122/243] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:10:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:10:16.325813 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19735d6-0161-464a-ae80-b341a4c97eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:16.325813 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19735d6-0161-464a-ae80-b341a4c97eb7 None admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:16.325813 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19735d6-0161-464a-ae80-b341a4c97eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:16.325813 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19735d6-0161-464a-ae80-b341a4c97eb7 None admin] PATH_INFO: `/v3/users` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:16.326159 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19735d6-0161-464a-ae80-b341a4c97eb7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:16.327031 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19735d6-0161-464a-ae80-b341a4c97eb7 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:16.328490 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df543ef-f4c5-48a1-ba62-6c3bdbb223ba None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:16.328980 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df543ef-f4c5-48a1-ba62-6c3bdbb223ba None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:16.329563 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df543ef-f4c5-48a1-ba62-6c3bdbb223ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:16.350274 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-4df543ef-f4c5-48a1-ba62-6c3bdbb223ba None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:10:16.351661 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 122/244] 10.222.0.33 () {60 vars in 1132 bytes} [Tue Sep 20 22:10:16 2022] POST /identity/v3/users => generated 293 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 20 22:10:16.352373 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-4df543ef-f4c5-48a1-ba62-6c3bdbb223ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:10:16.359237 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19735d6-0161-464a-ae80-b341a4c97eb7 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:16.384284 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:16.493657 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:16.507204 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 123/245] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:10:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 20 22:10:16.550130 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19735d6-0161-464a-ae80-b341a4c97eb7 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:16.585994 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000ae160-14ae-4f70-af0b-4f310b495005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:16.586643 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ae160-14ae-4f70-af0b-4f310b495005 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:16.586931 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ae160-14ae-4f70-af0b-4f310b495005 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:16.587212 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ae160-14ae-4f70-af0b-4f310b495005 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:16.659301 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000ae160-14ae-4f70-af0b-4f310b495005 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:16.660748 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000ae160-14ae-4f70-af0b-4f310b495005 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:16.675161 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:16.763541 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 123/246] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 20 22:10:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 20 22:10:16.769474 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df543ef-f4c5-48a1-ba62-6c3bdbb223ba None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:16.855883 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000ae160-14ae-4f70-af0b-4f310b495005 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:16.901360 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df543ef-f4c5-48a1-ba62-6c3bdbb223ba None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:16.954492 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e27dc82-6b24-451a-84d9-d37d6dd75902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:16.955516 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e27dc82-6b24-451a-84d9-d37d6dd75902 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:16.956095 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e27dc82-6b24-451a-84d9-d37d6dd75902 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:16.956576 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e27dc82-6b24-451a-84d9-d37d6dd75902 None admin] PATH_INFO: `/v3/projects/52f32cd0707b4e2c922768eddcc432e5` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:16.958680 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e27dc82-6b24-451a-84d9-d37d6dd75902 None admin] RBAC: Authorizing `identity:get_project(project_id=52f32cd0707b4e2c922768eddcc432e5)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:16.960398 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e27dc82-6b24-451a-84d9-d37d6dd75902 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:16.963843 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 124/247] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Sep 20 22:10:16 2022] GET /identity/v3/projects/52f32cd0707b4e2c922768eddcc432e5 => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:16.971698 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e27dc82-6b24-451a-84d9-d37d6dd75902 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:16.993258 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000ae160-14ae-4f70-af0b-4f310b495005 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:17.009845 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:17.035312 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8acda6e-5b8a-49c4-92f9-26cc274cf15e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:17.036298 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8acda6e-5b8a-49c4-92f9-26cc274cf15e None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:17.036792 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8acda6e-5b8a-49c4-92f9-26cc274cf15e None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:17.037529 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8acda6e-5b8a-49c4-92f9-26cc274cf15e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:17.048847 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:17.052332 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8acda6e-5b8a-49c4-92f9-26cc274cf15e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 22:10:17.058019 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-c8acda6e-5b8a-49c4-92f9-26cc274cf15e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 20 22:10:17.058019 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:10:17.058019 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:10:17.058019 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:10:17.058019 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:10:17.058019 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:10:17.058019 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:10:17.058019 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:10:17.058019 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:10:17.058019 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:10:17.058019 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:10:17.058019 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:10:17.058019 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 22:10:17.058019 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 22:10:17.058019 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 22:10:17.058019 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 22:10:17.058943 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 22:10:17.058943 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 22:10:17.058943 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 22:10:17.058943 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 22:10:17.058943 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:10:17.058943 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:10:17.058943 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:10:17.058943 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:10:17.058943 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:10:17.058943 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:10:17.058943 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:10:17.058943 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:10:17.058943 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:10:17.058943 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:10:17.058943 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:10:17.058943 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:10:17.059731 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:10:17.059731 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:10:17.059731 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:10:17.059731 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:10:17.059731 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 22:10:17.059731 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 22:10:17.059731 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 22:10:17.059731 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 22:10:17.059731 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 22:10:17.059731 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 22:10:17.059731 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 20 22:10:17.059731 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:10:17.059731 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 124/248] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 20 22:10:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 20 22:10:17.061635 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fb441a-1774-4997-98c3-d015f432d376 None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:17.061635 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fb441a-1774-4997-98c3-d015f432d376 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:17.061789 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fb441a-1774-4997-98c3-d015f432d376 None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:17.063634 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 125/249] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:10:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:10:17.073485 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed61d252-e045-4925-957c-b3ff3ef15b9c None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:17.073768 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed61d252-e045-4925-957c-b3ff3ef15b9c None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:17.074037 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed61d252-e045-4925-957c-b3ff3ef15b9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:17.093806 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-ed61d252-e045-4925-957c-b3ff3ef15b9c None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:10:17.095070 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-ed61d252-e045-4925-957c-b3ff3ef15b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:10:17.098999 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e27dc82-6b24-451a-84d9-d37d6dd75902 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:17.139990 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8bca42-cee5-4d9b-b1e0-2e429d766082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:17.140530 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8bca42-cee5-4d9b-b1e0-2e429d766082 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:17.140813 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8bca42-cee5-4d9b-b1e0-2e429d766082 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:17.141084 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8bca42-cee5-4d9b-b1e0-2e429d766082 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:17.141816 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8bca42-cee5-4d9b-b1e0-2e429d766082 None admin] RBAC: Adding query filter params (role.id=22cfe7a128b64671998d0ff9c54f8ce4, scope.project.id=52f32cd0707b4e2c922768eddcc432e5, user.id=74cc566edfb04bcfbb4f7fb3159c8534) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:10:17.142119 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8bca42-cee5-4d9b-b1e0-2e429d766082 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:17.145861 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8bca42-cee5-4d9b-b1e0-2e429d766082 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:17.152110 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 125/250] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Sep 20 22:10:16 2022] GET /identity/v3/role_assignments?user.id=74cc566edfb04bcfbb4f7fb3159c8534&scope.project.id=52f32cd0707b4e2c922768eddcc432e5&role.id=22cfe7a128b64671998d0ff9c54f8ce4 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:17.152749 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8bca42-cee5-4d9b-b1e0-2e429d766082 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:17.220660 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 126/251] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:10:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 22:10:17.315965 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8bca42-cee5-4d9b-b1e0-2e429d766082 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:17.360014 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:17.367591 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae42aaa-6be0-4c59-be03-95d95c683eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:17.368241 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae42aaa-6be0-4c59-be03-95d95c683eb9 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:17.368522 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae42aaa-6be0-4c59-be03-95d95c683eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:17.368795 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae42aaa-6be0-4c59-be03-95d95c683eb9 None admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:17.369481 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae42aaa-6be0-4c59-be03-95d95c683eb9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:10:17.369790 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae42aaa-6be0-4c59-be03-95d95c683eb9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:17.371239 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae42aaa-6be0-4c59-be03-95d95c683eb9 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:17.386521 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 126/252] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Sep 20 22:10:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:17.392396 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed61d252-e045-4925-957c-b3ff3ef15b9c None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:17.522202 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed61d252-e045-4925-957c-b3ff3ef15b9c None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:17.524739 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:17.558663 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b811bf-5a4c-4dd8-af2c-f2329adac1ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:17.559670 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b811bf-5a4c-4dd8-af2c-f2329adac1ef None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:17.560149 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b811bf-5a4c-4dd8-af2c-f2329adac1ef None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:17.560610 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b811bf-5a4c-4dd8-af2c-f2329adac1ef None admin] PATH_INFO: `/v3/users/c7cd3768564c4ea5ac5dcd1cac8a8ead` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:17.561959 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b811bf-5a4c-4dd8-af2c-f2329adac1ef None admin] RBAC: Authorizing `identity:get_user(user_id=c7cd3768564c4ea5ac5dcd1cac8a8ead)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:17.568063 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b811bf-5a4c-4dd8-af2c-f2329adac1ef None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:17.570557 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 127/253] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Sep 20 22:10:17 2022] GET /identity/v3/users/c7cd3768564c4ea5ac5dcd1cac8a8ead => generated 297 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:17.578445 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae42aaa-6be0-4c59-be03-95d95c683eb9 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:17.677034 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b811bf-5a4c-4dd8-af2c-f2329adac1ef None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:17.746236 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae42aaa-6be0-4c59-be03-95d95c683eb9 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:17.798445 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b811bf-5a4c-4dd8-af2c-f2329adac1ef None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:17.835144 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b93884b-a7f0-40ad-9b3c-c63221feebcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:17.835908 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b08498-da18-4892-8731-25b53f217a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:17.836320 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b93884b-a7f0-40ad-9b3c-c63221feebcb None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:17.836425 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b08498-da18-4892-8731-25b53f217a90 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:17.836594 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b93884b-a7f0-40ad-9b3c-c63221feebcb None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:17.836703 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b08498-da18-4892-8731-25b53f217a90 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:17.836869 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b93884b-a7f0-40ad-9b3c-c63221feebcb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:17.836962 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b08498-da18-4892-8731-25b53f217a90 None admin] PATH_INFO: `/v3/projects/52f32cd0707b4e2c922768eddcc432e5` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:17.843213 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b08498-da18-4892-8731-25b53f217a90 None admin] RBAC: Authorizing `identity:get_project(project_id=52f32cd0707b4e2c922768eddcc432e5)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:17.844689 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b08498-da18-4892-8731-25b53f217a90 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:17.846731 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 127/254] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Sep 20 22:10:17 2022] GET /identity/v3/projects/52f32cd0707b4e2c922768eddcc432e5 => generated 302 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:17.847185 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b93884b-a7f0-40ad-9b3c-c63221feebcb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 22:10:17.847998 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beace882-b746-476b-9b91-5825652d3ed8 None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:17.848290 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beace882-b746-476b-9b91-5825652d3ed8 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:17.848567 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beace882-b746-476b-9b91-5825652d3ed8 None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:17.849778 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 128/255] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:10:17 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:10:17.852864 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-9b93884b-a7f0-40ad-9b3c-c63221feebcb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 22:10:17.852864 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:10:17.852864 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:10:17.852864 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:10:17.852864 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:10:17.852864 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:10:17.852864 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:10:17.852864 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:10:17.852864 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:10:17.852864 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:10:17.852864 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:10:17.852864 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:10:17.852864 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 22:10:17.852864 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 22:10:17.852864 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 22:10:17.852864 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 22:10:17.853721 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 22:10:17.853721 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 22:10:17.853721 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 22:10:17.853721 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 22:10:17.853721 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:10:17.853721 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:10:17.853721 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:10:17.853721 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:10:17.853721 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:10:17.853721 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:10:17.853721 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:10:17.853721 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:10:17.853721 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:10:17.853721 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:10:17.853721 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:10:17.853721 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:10:17.854576 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:10:17.854576 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:10:17.854576 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:10:17.854576 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:10:17.854576 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 22:10:17.854576 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 22:10:17.854576 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 22:10:17.854576 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 22:10:17.854576 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 22:10:17.854576 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 22:10:17.854576 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 22:10:17.854576 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:10:17.854576 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 128/256] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Sep 20 22:10:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:10:17.863395 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beace882-b746-476b-9b91-5825652d3ed8 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:17.863677 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b93884b-a7f0-40ad-9b3c-c63221feebcb None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:17.933582 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:17.986334 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b93884b-a7f0-40ad-9b3c-c63221feebcb None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:18.025622 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:18.051080 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384e92ff-8529-44ff-bb4d-68a972e02a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:18.052739 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384e92ff-8529-44ff-bb4d-68a972e02a5c None admin] REQUEST_METHOD: `PUT` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:18.055500 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384e92ff-8529-44ff-bb4d-68a972e02a5c None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:18.055986 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384e92ff-8529-44ff-bb4d-68a972e02a5c None admin] PATH_INFO: `/v3/projects/52f32cd0707b4e2c922768eddcc432e5/users/c7cd3768564c4ea5ac5dcd1cac8a8ead/roles/604444e7ad0d437dbd1f5a6e02b761f5` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:18.059795 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384e92ff-8529-44ff-bb4d-68a972e02a5c None admin] RBAC: Authorizing `identity:create_grant(project_id=52f32cd0707b4e2c922768eddcc432e5, user_id=c7cd3768564c4ea5ac5dcd1cac8a8ead, role_id=604444e7ad0d437dbd1f5a6e02b761f5)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:18.061970 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384e92ff-8529-44ff-bb4d-68a972e02a5c None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:18.090129 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 129/257] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Sep 20 22:10:17 2022] PUT /identity/v3/projects/52f32cd0707b4e2c922768eddcc432e5/users/c7cd3768564c4ea5ac5dcd1cac8a8ead/roles/604444e7ad0d437dbd1f5a6e02b761f5 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 22:10:18.091831 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f91de39-33f6-424b-8eba-890279e40afb None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:18.092314 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f91de39-33f6-424b-8eba-890279e40afb None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:18.092828 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f91de39-33f6-424b-8eba-890279e40afb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:18.121888 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beace882-b746-476b-9b91-5825652d3ed8 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:18.135572 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-9f91de39-33f6-424b-8eba-890279e40afb None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:10:18.136815 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-9f91de39-33f6-424b-8eba-890279e40afb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:10:18.183392 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6138217-30b3-4ca8-acf5-9bd9e00e0b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:18.184534 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6138217-30b3-4ca8-acf5-9bd9e00e0b29 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:18.185012 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6138217-30b3-4ca8-acf5-9bd9e00e0b29 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:18.185478 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6138217-30b3-4ca8-acf5-9bd9e00e0b29 None admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:18.186360 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6138217-30b3-4ca8-acf5-9bd9e00e0b29 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:10:18.191348 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6138217-30b3-4ca8-acf5-9bd9e00e0b29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:18.193081 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6138217-30b3-4ca8-acf5-9bd9e00e0b29 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:18.211215 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 129/258] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 20 22:10:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:18.212576 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6138217-30b3-4ca8-acf5-9bd9e00e0b29 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:18.340143 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6138217-30b3-4ca8-acf5-9bd9e00e0b29 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:18.365261 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 130/259] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:10:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 22:10:18.373159 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:18.392107 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2db8593-7cea-47f8-9b12-c561e8e6d279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:18.393149 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2db8593-7cea-47f8-9b12-c561e8e6d279 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:18.393650 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2db8593-7cea-47f8-9b12-c561e8e6d279 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:18.398932 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2db8593-7cea-47f8-9b12-c561e8e6d279 None admin] PATH_INFO: `/v3/users/6e05faf497204dcda41597aed5e1aa2d` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:18.400554 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2db8593-7cea-47f8-9b12-c561e8e6d279 None admin] RBAC: Authorizing `identity:get_user(user_id=6e05faf497204dcda41597aed5e1aa2d)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:18.402245 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2db8593-7cea-47f8-9b12-c561e8e6d279 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:18.404140 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 130/260] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Sep 20 22:10:18 2022] GET /identity/v3/users/6e05faf497204dcda41597aed5e1aa2d => generated 283 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:18.409835 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f91de39-33f6-424b-8eba-890279e40afb None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:18.446169 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:18.566174 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f91de39-33f6-424b-8eba-890279e40afb None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:18.613171 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e66973-e9ac-45f0-a5e2-d345ddcd2560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:18.613793 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e66973-e9ac-45f0-a5e2-d345ddcd2560 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:18.614066 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e66973-e9ac-45f0-a5e2-d345ddcd2560 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:18.614349 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e66973-e9ac-45f0-a5e2-d345ddcd2560 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:18.704756 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e66973-e9ac-45f0-a5e2-d345ddcd2560 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:18.706237 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e66973-e9ac-45f0-a5e2-d345ddcd2560 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:18.708596 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2db8593-7cea-47f8-9b12-c561e8e6d279 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:18.737580 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:18.819130 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2db8593-7cea-47f8-9b12-c561e8e6d279 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:18.855564 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c207c3f-58bb-47ea-aa36-446be80c1e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:18.856571 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c207c3f-58bb-47ea-aa36-446be80c1e65 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:18.857154 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c207c3f-58bb-47ea-aa36-446be80c1e65 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:18.857652 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c207c3f-58bb-47ea-aa36-446be80c1e65 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:18.868901 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c207c3f-58bb-47ea-aa36-446be80c1e65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 22:10:18.875094 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-0c207c3f-58bb-47ea-aa36-446be80c1e65 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 20 22:10:18.875094 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:10:18.875094 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:10:18.875094 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:10:18.875094 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:10:18.875094 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:10:18.875094 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:10:18.875094 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:10:18.875094 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:10:18.875094 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:10:18.875094 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:10:18.875094 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:10:18.875094 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 22:10:18.875094 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 22:10:18.875094 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 22:10:18.875094 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 22:10:18.875969 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 22:10:18.875969 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 22:10:18.875969 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 22:10:18.875969 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 22:10:18.875969 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:10:18.875969 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:10:18.875969 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:10:18.875969 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:10:18.875969 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:10:18.875969 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:10:18.875969 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:10:18.875969 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:10:18.875969 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:10:18.875969 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:10:18.875969 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:10:18.875969 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:10:18.876748 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:10:18.876748 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:10:18.876748 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:10:18.876748 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:10:18.876748 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 22:10:18.876748 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 22:10:18.876748 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 22:10:18.876748 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 22:10:18.876748 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 22:10:18.876748 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 22:10:18.876748 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 20 22:10:18.876748 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:10:18.881013 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 131/261] 10.222.0.33 () {56 vars in 1114 bytes} [Tue Sep 20 22:10:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:10:18.887564 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c207c3f-58bb-47ea-aa36-446be80c1e65 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:18.905621 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 131/262] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 20 22:10:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 20 22:10:18.916928 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e66973-e9ac-45f0-a5e2-d345ddcd2560 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:18.951902 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:19.002351 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c207c3f-58bb-47ea-aa36-446be80c1e65 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:19.039335 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8922c0a-62a4-48cb-b5b2-e2910dcd0646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:19.040315 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8922c0a-62a4-48cb-b5b2-e2910dcd0646 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:19.040797 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8922c0a-62a4-48cb-b5b2-e2910dcd0646 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:19.041328 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8922c0a-62a4-48cb-b5b2-e2910dcd0646 None admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:19.042291 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8922c0a-62a4-48cb-b5b2-e2910dcd0646 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:10:19.042936 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8922c0a-62a4-48cb-b5b2-e2910dcd0646 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:19.044545 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8922c0a-62a4-48cb-b5b2-e2910dcd0646 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:19.053660 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 132/263] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Sep 20 22:10:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:19.060076 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8922c0a-62a4-48cb-b5b2-e2910dcd0646 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:19.078042 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e66973-e9ac-45f0-a5e2-d345ddcd2560 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:19.099952 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:19.115158 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7614ee63-b502-4587-b155-859fcba86bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:19.115794 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7614ee63-b502-4587-b155-859fcba86bfb None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:19.116092 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7614ee63-b502-4587-b155-859fcba86bfb None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:19.116333 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7614ee63-b502-4587-b155-859fcba86bfb None admin] PATH_INFO: `/v3/projects/52f32cd0707b4e2c922768eddcc432e5` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:19.117528 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7614ee63-b502-4587-b155-859fcba86bfb None admin] RBAC: Authorizing `identity:get_project(project_id=52f32cd0707b4e2c922768eddcc432e5)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:19.119111 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7614ee63-b502-4587-b155-859fcba86bfb None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:19.121227 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 132/264] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Sep 20 22:10:18 2022] GET /identity/v3/projects/52f32cd0707b4e2c922768eddcc432e5 => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 22:10:19.131045 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7614ee63-b502-4587-b155-859fcba86bfb None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:19.178548 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8922c0a-62a4-48cb-b5b2-e2910dcd0646 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:19.193082 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:19.217340 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8038f7f8-b2e2-4fb9-9c8e-1709cc620c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:19.218650 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8038f7f8-b2e2-4fb9-9c8e-1709cc620c3e None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:19.219129 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8038f7f8-b2e2-4fb9-9c8e-1709cc620c3e None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:19.219596 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8038f7f8-b2e2-4fb9-9c8e-1709cc620c3e None admin] PATH_INFO: `/v3/users/6e05faf497204dcda41597aed5e1aa2d` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:19.221046 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8038f7f8-b2e2-4fb9-9c8e-1709cc620c3e None admin] RBAC: Authorizing `identity:get_user(user_id=6e05faf497204dcda41597aed5e1aa2d)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:19.222885 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8038f7f8-b2e2-4fb9-9c8e-1709cc620c3e None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:19.225151 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 133/265] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Sep 20 22:10:19 2022] GET /identity/v3/users/6e05faf497204dcda41597aed5e1aa2d => generated 283 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:19.230813 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8038f7f8-b2e2-4fb9-9c8e-1709cc620c3e None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:19.246946 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7614ee63-b502-4587-b155-859fcba86bfb None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:19.286080 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299a2d84-d748-4bc7-8f0b-ecc1adbb82c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:19.286664 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299a2d84-d748-4bc7-8f0b-ecc1adbb82c4 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:19.286943 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299a2d84-d748-4bc7-8f0b-ecc1adbb82c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:19.287213 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299a2d84-d748-4bc7-8f0b-ecc1adbb82c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:19.287932 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299a2d84-d748-4bc7-8f0b-ecc1adbb82c4 None admin] RBAC: Adding query filter params (role.id=8a829170b29d42d6af589399e51edb0f, scope.project.id=52f32cd0707b4e2c922768eddcc432e5, user.id=6e05faf497204dcda41597aed5e1aa2d) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:10:19.288237 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299a2d84-d748-4bc7-8f0b-ecc1adbb82c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:19.289685 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299a2d84-d748-4bc7-8f0b-ecc1adbb82c4 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:19.295882 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 133/266] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Sep 20 22:10:19 2022] GET /identity/v3/role_assignments?user.id=6e05faf497204dcda41597aed5e1aa2d&scope.project.id=52f32cd0707b4e2c922768eddcc432e5&role.id=8a829170b29d42d6af589399e51edb0f => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 22:10:19.346540 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8038f7f8-b2e2-4fb9-9c8e-1709cc620c3e None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:19.387445 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1765fbf8-ea4b-48b7-806a-90c75b60cc90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:19.388472 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1765fbf8-ea4b-48b7-806a-90c75b60cc90 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:19.388970 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1765fbf8-ea4b-48b7-806a-90c75b60cc90 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:19.389439 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1765fbf8-ea4b-48b7-806a-90c75b60cc90 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:19.445978 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:19.467919 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1765fbf8-ea4b-48b7-806a-90c75b60cc90 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:19.469568 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1765fbf8-ea4b-48b7-806a-90c75b60cc90 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:19.578330 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 134/267] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 20 22:10:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 20 22:10:19.583722 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299a2d84-d748-4bc7-8f0b-ecc1adbb82c4 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:19.639426 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:19.700952 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299a2d84-d748-4bc7-8f0b-ecc1adbb82c4 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:19.751417 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0853c4c7-9f57-467a-9ae5-38ea70775d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:19.752056 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0853c4c7-9f57-467a-9ae5-38ea70775d54 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:19.752375 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0853c4c7-9f57-467a-9ae5-38ea70775d54 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:19.752649 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0853c4c7-9f57-467a-9ae5-38ea70775d54 None admin] PATH_INFO: `/v3/projects/52f32cd0707b4e2c922768eddcc432e5` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:19.753769 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0853c4c7-9f57-467a-9ae5-38ea70775d54 None admin] RBAC: Authorizing `identity:get_project(project_id=52f32cd0707b4e2c922768eddcc432e5)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:19.755554 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0853c4c7-9f57-467a-9ae5-38ea70775d54 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:19.757607 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 134/268] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Sep 20 22:10:19 2022] GET /identity/v3/projects/52f32cd0707b4e2c922768eddcc432e5 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:19.763541 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1765fbf8-ea4b-48b7-806a-90c75b60cc90 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:19.886883 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:19.896306 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628da28e-1c71-4495-9087-9f8c80aa9d44 None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:19.896584 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628da28e-1c71-4495-9087-9f8c80aa9d44 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:19.896878 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628da28e-1c71-4495-9087-9f8c80aa9d44 None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:19.898384 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 135/269] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:10:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:10:19.900341 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1765fbf8-ea4b-48b7-806a-90c75b60cc90 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:19.903706 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dd3910-0d10-4636-87e4-14f96e956fb6 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:19.903995 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dd3910-0d10-4636-87e4-14f96e956fb6 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:19.904328 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dd3910-0d10-4636-87e4-14f96e956fb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:19.935693 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-21dd3910-0d10-4636-87e4-14f96e956fb6 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:10:19.936927 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-21dd3910-0d10-4636-87e4-14f96e956fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:10:19.952150 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb3fec2-a376-4cde-9c03-ca361718fb6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:19.953117 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb3fec2-a376-4cde-9c03-ca361718fb6c None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:19.953616 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb3fec2-a376-4cde-9c03-ca361718fb6c None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:19.954057 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb3fec2-a376-4cde-9c03-ca361718fb6c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:19.954978 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb3fec2-a376-4cde-9c03-ca361718fb6c None admin] RBAC: Adding query filter params (role.id=4e75d58a1e0e4fffa940914b1e5f46de, scope.project.id=52f32cd0707b4e2c922768eddcc432e5, user.id=6e05faf497204dcda41597aed5e1aa2d) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:10:19.955608 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb3fec2-a376-4cde-9c03-ca361718fb6c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:19.957205 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb3fec2-a376-4cde-9c03-ca361718fb6c None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:19.964539 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 135/270] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Sep 20 22:10:19 2022] GET /identity/v3/role_assignments?user.id=6e05faf497204dcda41597aed5e1aa2d&scope.project.id=52f32cd0707b4e2c922768eddcc432e5&role.id=4e75d58a1e0e4fffa940914b1e5f46de => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:20.080768 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 136/271] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:10:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 20 22:10:20.260355 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb40d860-2ecb-46f5-843d-26a82b85fc80 None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:20.261020 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb40d860-2ecb-46f5-843d-26a82b85fc80 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:20.261496 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb40d860-2ecb-46f5-843d-26a82b85fc80 None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:20.263319 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 136/272] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:10:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:10:20.269140 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb1c040-8f01-4606-a8cc-2ae46d80a24e None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:20.269434 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb1c040-8f01-4606-a8cc-2ae46d80a24e None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:20.269709 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb1c040-8f01-4606-a8cc-2ae46d80a24e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:20.291275 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-dbb1c040-8f01-4606-a8cc-2ae46d80a24e None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:10:20.292483 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-dbb1c040-8f01-4606-a8cc-2ae46d80a24e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:10:20.343304 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:20.367850 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 137/273] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:10:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 22:10:20.392283 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb40d860-2ecb-46f5-843d-26a82b85fc80 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:20.483798 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2309c2c4-3c5a-4a40-95dc-77afe0133ef4 None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:20.484391 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2309c2c4-3c5a-4a40-95dc-77afe0133ef4 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:20.484841 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2309c2c4-3c5a-4a40-95dc-77afe0133ef4 None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:20.486348 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 138/274] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:10:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:10:20.491382 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05847d71-5a20-4193-8c41-131eee22eb6b None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:20.491889 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05847d71-5a20-4193-8c41-131eee22eb6b None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:20.492337 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05847d71-5a20-4193-8c41-131eee22eb6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:20.517062 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-05847d71-5a20-4193-8c41-131eee22eb6b None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:10:20.518314 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-05847d71-5a20-4193-8c41-131eee22eb6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:10:20.539986 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb40d860-2ecb-46f5-843d-26a82b85fc80 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:20.579373 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4988af16-14eb-42c9-afa5-02f274215e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:20.580539 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4988af16-14eb-42c9-afa5-02f274215e79 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:20.581379 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4988af16-14eb-42c9-afa5-02f274215e79 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:20.581829 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4988af16-14eb-42c9-afa5-02f274215e79 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:20.596225 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4988af16-14eb-42c9-afa5-02f274215e79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 22:10:20.599825 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 139/275] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:10:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 20 22:10:20.601528 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-4988af16-14eb-42c9-afa5-02f274215e79 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 20 22:10:20.601528 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:10:20.601528 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:10:20.601528 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:10:20.601528 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:10:20.601528 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:10:20.601528 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:10:20.601528 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:10:20.601528 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:10:20.601528 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:10:20.601528 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:10:20.601528 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:10:20.601528 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 22:10:20.601528 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 22:10:20.601528 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 22:10:20.601528 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 22:10:20.602393 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 22:10:20.602393 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 22:10:20.602393 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 22:10:20.602393 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 22:10:20.602393 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:10:20.602393 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:10:20.602393 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:10:20.602393 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:10:20.602393 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:10:20.602393 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:10:20.602393 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:10:20.602393 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:10:20.602393 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:10:20.602393 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:10:20.602393 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:10:20.602393 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:10:20.603306 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:10:20.603306 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:10:20.603306 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:10:20.603306 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:10:20.603306 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 22:10:20.603306 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 22:10:20.603306 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 22:10:20.603306 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 22:10:20.603306 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 22:10:20.603306 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 22:10:20.603306 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 20 22:10:20.603306 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:10:20.605316 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 137/276] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 20 22:10:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:10:20.610821 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05847d71-5a20-4193-8c41-131eee22eb6b None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:20.651909 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4988af16-14eb-42c9-afa5-02f274215e79 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:20.666846 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:20.725320 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05847d71-5a20-4193-8c41-131eee22eb6b None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:20.736900 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:20.763767 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85acf49-a26b-4462-aaf0-a7ec6c21e0b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:20.764375 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85acf49-a26b-4462-aaf0-a7ec6c21e0b6 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:20.764651 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85acf49-a26b-4462-aaf0-a7ec6c21e0b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:20.764926 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85acf49-a26b-4462-aaf0-a7ec6c21e0b6 None admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:20.765588 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85acf49-a26b-4462-aaf0-a7ec6c21e0b6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:10:20.765890 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85acf49-a26b-4462-aaf0-a7ec6c21e0b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:20.767407 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85acf49-a26b-4462-aaf0-a7ec6c21e0b6 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:20.776673 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 140/277] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Sep 20 22:10:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:20.782229 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85acf49-a26b-4462-aaf0-a7ec6c21e0b6 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:20.804873 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4988af16-14eb-42c9-afa5-02f274215e79 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:20.855632 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59767f80-8e72-4a27-a4ec-0133dd791390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:20.856918 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59767f80-8e72-4a27-a4ec-0133dd791390 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:20.857403 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59767f80-8e72-4a27-a4ec-0133dd791390 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:20.858150 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59767f80-8e72-4a27-a4ec-0133dd791390 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:20.860458 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59767f80-8e72-4a27-a4ec-0133dd791390 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:20.862227 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59767f80-8e72-4a27-a4ec-0133dd791390 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:20.869876 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 138/278] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 20 22:10:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 22:10:20.871694 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59767f80-8e72-4a27-a4ec-0133dd791390 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:20.893914 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85acf49-a26b-4462-aaf0-a7ec6c21e0b6 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:20.936782 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe9d13b-9677-48bf-b230-9b20804a10e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:20.937461 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe9d13b-9677-48bf-b230-9b20804a10e4 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:20.937746 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe9d13b-9677-48bf-b230-9b20804a10e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:20.938046 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe9d13b-9677-48bf-b230-9b20804a10e4 None admin] PATH_INFO: `/v3/users/b5af2b7c914041d6abf15c1c75b49278` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:20.953443 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe9d13b-9677-48bf-b230-9b20804a10e4 None admin] RBAC: Authorizing `identity:get_user(user_id=b5af2b7c914041d6abf15c1c75b49278)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:20.954931 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe9d13b-9677-48bf-b230-9b20804a10e4 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:20.956677 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 141/279] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Sep 20 22:10:20 2022] GET /identity/v3/users/b5af2b7c914041d6abf15c1c75b49278 => generated 293 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 22:10:20.957446 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe9d13b-9677-48bf-b230-9b20804a10e4 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:20.967260 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:20.993301 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:21.000970 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59767f80-8e72-4a27-a4ec-0133dd791390 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:21.037976 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767d69b3-3fe8-45b2-be7a-94b79ab30af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:21.039085 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d69b3-3fe8-45b2-be7a-94b79ab30af3 None admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:21.039371 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d69b3-3fe8-45b2-be7a-94b79ab30af3 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:21.039642 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d69b3-3fe8-45b2-be7a-94b79ab30af3 None admin] PATH_INFO: `/v3/users` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:21.040295 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767d69b3-3fe8-45b2-be7a-94b79ab30af3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:21.042198 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767d69b3-3fe8-45b2-be7a-94b79ab30af3 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:21.065401 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 139/280] 10.222.0.33 () {60 vars in 1132 bytes} [Tue Sep 20 22:10:20 2022] POST /identity/v3/users => generated 293 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 20 22:10:21.067416 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767d69b3-3fe8-45b2-be7a-94b79ab30af3 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:21.070759 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe9d13b-9677-48bf-b230-9b20804a10e4 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:21.126176 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f00b21-bbed-4666-8ddc-8e26684f86f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:21.127415 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f00b21-bbed-4666-8ddc-8e26684f86f7 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:21.127764 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f00b21-bbed-4666-8ddc-8e26684f86f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:21.128048 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f00b21-bbed-4666-8ddc-8e26684f86f7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:21.142584 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f00b21-bbed-4666-8ddc-8e26684f86f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 22:10:21.150392 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-d5f00b21-bbed-4666-8ddc-8e26684f86f7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 20 22:10:21.150392 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:10:21.150392 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:10:21.150392 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:10:21.150392 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:10:21.150392 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:10:21.150392 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:10:21.150392 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:10:21.150392 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:10:21.150392 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:10:21.150392 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:10:21.150392 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:10:21.150392 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 22:10:21.150392 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 22:10:21.150392 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 22:10:21.150392 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 22:10:21.151372 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 22:10:21.151372 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 22:10:21.151372 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 22:10:21.151372 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 22:10:21.151372 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:10:21.151372 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:10:21.151372 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:10:21.151372 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:10:21.151372 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:10:21.151372 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:10:21.151372 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:10:21.151372 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:10:21.151372 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:10:21.151372 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:10:21.151372 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:10:21.151372 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:10:21.152176 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:10:21.152176 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:10:21.152176 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:10:21.152176 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:10:21.152176 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 22:10:21.152176 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 22:10:21.152176 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 22:10:21.152176 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 22:10:21.152176 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 22:10:21.152176 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 22:10:21.152176 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 20 22:10:21.152176 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:10:21.156810 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 142/281] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 20 22:10:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:10:21.157787 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f00b21-bbed-4666-8ddc-8e26684f86f7 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:21.230362 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767d69b3-3fe8-45b2-be7a-94b79ab30af3 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:21.268341 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:21.276972 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:21.285231 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ba56ed-8818-427c-b621-b1482c439fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:21.285420 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ba56ed-8818-427c-b621-b1482c439fa3 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:21.285693 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ba56ed-8818-427c-b621-b1482c439fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:21.285972 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ba56ed-8818-427c-b621-b1482c439fa3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:21.289052 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ba56ed-8818-427c-b621-b1482c439fa3 None admin] RBAC: Adding query filter params (role.id=604444e7ad0d437dbd1f5a6e02b761f5, user.id=b5af2b7c914041d6abf15c1c75b49278, scope.system=all) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:10:21.289052 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ba56ed-8818-427c-b621-b1482c439fa3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:21.290568 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ba56ed-8818-427c-b621-b1482c439fa3 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:21.298697 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f00b21-bbed-4666-8ddc-8e26684f86f7 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:21.306796 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 140/282] 10.222.0.33 () {56 vars in 1308 bytes} [Tue Sep 20 22:10:21 2022] GET /identity/v3/role_assignments?user.id=b5af2b7c914041d6abf15c1c75b49278&scope.system=all&role.id=604444e7ad0d437dbd1f5a6e02b761f5 => generated 226 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:21.333305 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95098b8d-2a10-4ad7-9fec-9f00864dcacd None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:21.333659 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95098b8d-2a10-4ad7-9fec-9f00864dcacd None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:21.333849 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95098b8d-2a10-4ad7-9fec-9f00864dcacd None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:21.335924 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 141/283] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:10:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:10:21.342343 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b2bb94-3663-43ac-b61d-9cc3e797f921 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:21.342672 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b2bb94-3663-43ac-b61d-9cc3e797f921 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:21.342978 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b2bb94-3663-43ac-b61d-9cc3e797f921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:21.364447 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-19b2bb94-3663-43ac-b61d-9cc3e797f921 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:10:21.365509 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd50063-8e76-417d-9b82-e78f8e128bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:21.365856 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-19b2bb94-3663-43ac-b61d-9cc3e797f921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:10:21.366151 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd50063-8e76-417d-9b82-e78f8e128bc5 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:21.368173 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd50063-8e76-417d-9b82-e78f8e128bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:21.368173 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd50063-8e76-417d-9b82-e78f8e128bc5 None admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:21.368173 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd50063-8e76-417d-9b82-e78f8e128bc5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:10:21.368641 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd50063-8e76-417d-9b82-e78f8e128bc5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:21.369778 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd50063-8e76-417d-9b82-e78f8e128bc5 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:21.381586 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 143/284] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Sep 20 22:10:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:21.400197 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd50063-8e76-417d-9b82-e78f8e128bc5 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:21.505298 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 142/285] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:10:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 20 22:10:21.555399 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd50063-8e76-417d-9b82-e78f8e128bc5 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:21.592169 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e6e613-fffa-4a8f-874b-aae23b43ed19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:21.593089 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e6e613-fffa-4a8f-874b-aae23b43ed19 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:21.593540 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e6e613-fffa-4a8f-874b-aae23b43ed19 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:21.593959 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e6e613-fffa-4a8f-874b-aae23b43ed19 None admin] PATH_INFO: `/v3/users/74cc566edfb04bcfbb4f7fb3159c8534` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:21.595294 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e6e613-fffa-4a8f-874b-aae23b43ed19 None admin] RBAC: Authorizing `identity:get_user(user_id=74cc566edfb04bcfbb4f7fb3159c8534)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:21.596878 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e6e613-fffa-4a8f-874b-aae23b43ed19 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:21.599016 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 144/286] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Sep 20 22:10:21 2022] GET /identity/v3/users/74cc566edfb04bcfbb4f7fb3159c8534 => generated 297 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:21.606151 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b2bb94-3663-43ac-b61d-9cc3e797f921 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:21.828405 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b2bb94-3663-43ac-b61d-9cc3e797f921 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:21.859777 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:21.873185 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e6e613-fffa-4a8f-874b-aae23b43ed19 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:21.874979 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5aa8ba-801b-4035-8294-39acce2aeafe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:21.875618 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5aa8ba-801b-4035-8294-39acce2aeafe None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:21.875893 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5aa8ba-801b-4035-8294-39acce2aeafe None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:21.876164 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5aa8ba-801b-4035-8294-39acce2aeafe None admin] PATH_INFO: `/v3/projects/52f32cd0707b4e2c922768eddcc432e5` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:21.879212 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5aa8ba-801b-4035-8294-39acce2aeafe None admin] RBAC: Authorizing `identity:get_project(project_id=52f32cd0707b4e2c922768eddcc432e5)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:21.885592 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5aa8ba-801b-4035-8294-39acce2aeafe None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:21.887844 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 143/287] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Sep 20 22:10:21 2022] GET /identity/v3/projects/52f32cd0707b4e2c922768eddcc432e5 => generated 302 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:21.893128 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5aa8ba-801b-4035-8294-39acce2aeafe None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:21.915198 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:22.017346 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e6e613-fffa-4a8f-874b-aae23b43ed19 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:22.050587 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5aa8ba-801b-4035-8294-39acce2aeafe None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:22.090444 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31af012b-23bc-4333-8623-92fe19576f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:22.091107 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af012b-23bc-4333-8623-92fe19576f6b None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:22.091386 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af012b-23bc-4333-8623-92fe19576f6b None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:22.091659 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af012b-23bc-4333-8623-92fe19576f6b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:22.110833 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31af012b-23bc-4333-8623-92fe19576f6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 22:10:22.118228 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-31af012b-23bc-4333-8623-92fe19576f6b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 20 22:10:22.118228 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:10:22.118228 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:10:22.118228 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:10:22.118228 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:10:22.118228 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:10:22.118228 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:10:22.118228 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:10:22.118228 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:10:22.118228 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:10:22.118228 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:10:22.118228 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:10:22.118228 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 22:10:22.118228 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 22:10:22.118228 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 22:10:22.118228 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 22:10:22.119117 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 22:10:22.119117 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 22:10:22.119117 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 22:10:22.119117 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 22:10:22.119117 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:10:22.119117 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:10:22.119117 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:10:22.119117 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:10:22.119117 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:10:22.119117 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:10:22.119117 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:10:22.119117 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:10:22.119117 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:10:22.119117 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:10:22.119117 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:10:22.119117 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:10:22.119891 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:10:22.119891 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:10:22.119891 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:10:22.119891 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:10:22.119891 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 22:10:22.119891 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 22:10:22.119891 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 22:10:22.119891 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 22:10:22.119891 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 22:10:22.119891 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 22:10:22.119891 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 20 22:10:22.119891 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:10:22.119891 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 145/288] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 20 22:10:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:10:22.122016 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6db2a08-2050-4d48-a1d9-3ae0c4998e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:22.122711 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6db2a08-2050-4d48-a1d9-3ae0c4998e5c None admin] REQUEST_METHOD: `PUT` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:22.122992 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6db2a08-2050-4d48-a1d9-3ae0c4998e5c None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:22.123266 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6db2a08-2050-4d48-a1d9-3ae0c4998e5c None admin] PATH_INFO: `/v3/projects/52f32cd0707b4e2c922768eddcc432e5/users/74cc566edfb04bcfbb4f7fb3159c8534/roles/22cfe7a128b64671998d0ff9c54f8ce4` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:22.125409 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31af012b-23bc-4333-8623-92fe19576f6b None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:22.126412 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6db2a08-2050-4d48-a1d9-3ae0c4998e5c None admin] RBAC: Authorizing `identity:create_grant(project_id=52f32cd0707b4e2c922768eddcc432e5, user_id=74cc566edfb04bcfbb4f7fb3159c8534, role_id=22cfe7a128b64671998d0ff9c54f8ce4)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:22.127938 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6db2a08-2050-4d48-a1d9-3ae0c4998e5c None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:22.157050 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 144/289] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Sep 20 22:10:21 2022] PUT /identity/v3/projects/52f32cd0707b4e2c922768eddcc432e5/users/74cc566edfb04bcfbb4f7fb3159c8534/roles/22cfe7a128b64671998d0ff9c54f8ce4 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 22:10:22.256495 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:22.284919 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31af012b-23bc-4333-8623-92fe19576f6b None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:22.350228 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e109450c-8dc5-48a4-9bbf-742abde362e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:22.351294 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e109450c-8dc5-48a4-9bbf-742abde362e0 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:22.351818 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e109450c-8dc5-48a4-9bbf-742abde362e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:22.352282 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e109450c-8dc5-48a4-9bbf-742abde362e0 None admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:22.353159 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e109450c-8dc5-48a4-9bbf-742abde362e0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:10:22.353656 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e109450c-8dc5-48a4-9bbf-742abde362e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:22.355250 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e109450c-8dc5-48a4-9bbf-742abde362e0 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:22.365925 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 146/290] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Sep 20 22:10:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:22.375834 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6db2a08-2050-4d48-a1d9-3ae0c4998e5c None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:22.434661 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:22.494052 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6db2a08-2050-4d48-a1d9-3ae0c4998e5c None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:22.541870 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7616aa51-fe1c-4ea2-a68c-d64ae5d33d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:22.543345 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7616aa51-fe1c-4ea2-a68c-d64ae5d33d98 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:22.543827 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7616aa51-fe1c-4ea2-a68c-d64ae5d33d98 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:22.544331 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7616aa51-fe1c-4ea2-a68c-d64ae5d33d98 None admin] PATH_INFO: `/v3/users/c7cd3768564c4ea5ac5dcd1cac8a8ead` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:22.545671 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7616aa51-fe1c-4ea2-a68c-d64ae5d33d98 None admin] RBAC: Authorizing `identity:get_user(user_id=c7cd3768564c4ea5ac5dcd1cac8a8ead)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:22.547351 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7616aa51-fe1c-4ea2-a68c-d64ae5d33d98 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:22.549437 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 145/291] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Sep 20 22:10:22 2022] GET /identity/v3/users/c7cd3768564c4ea5ac5dcd1cac8a8ead => generated 297 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:22.556083 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e109450c-8dc5-48a4-9bbf-742abde362e0 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:22.667507 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e109450c-8dc5-48a4-9bbf-742abde362e0 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:22.711836 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ea9130-6965-4e06-8e66-05eb615457bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:22.712797 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ea9130-6965-4e06-8e66-05eb615457bd None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:22.713279 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ea9130-6965-4e06-8e66-05eb615457bd None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:22.713752 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ea9130-6965-4e06-8e66-05eb615457bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:22.736886 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:22.812493 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ea9130-6965-4e06-8e66-05eb615457bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:22.814307 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ea9130-6965-4e06-8e66-05eb615457bd None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:22.932394 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 147/292] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 20 22:10:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 20 22:10:22.938539 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7616aa51-fe1c-4ea2-a68c-d64ae5d33d98 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:23.059244 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7616aa51-fe1c-4ea2-a68c-d64ae5d33d98 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:23.076634 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:23.094386 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcda535-1941-43c4-a6fe-53393cce8ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:23.095059 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcda535-1941-43c4-a6fe-53393cce8ed1 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:23.095391 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcda535-1941-43c4-a6fe-53393cce8ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:23.095669 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcda535-1941-43c4-a6fe-53393cce8ed1 None admin] PATH_INFO: `/v3/projects/52f32cd0707b4e2c922768eddcc432e5` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:23.096797 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcda535-1941-43c4-a6fe-53393cce8ed1 None admin] RBAC: Authorizing `identity:get_project(project_id=52f32cd0707b4e2c922768eddcc432e5)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:23.098256 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcda535-1941-43c4-a6fe-53393cce8ed1 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:23.100088 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 146/293] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Sep 20 22:10:22 2022] GET /identity/v3/projects/52f32cd0707b4e2c922768eddcc432e5 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:23.106482 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ea9130-6965-4e06-8e66-05eb615457bd None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:23.156474 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:23.218568 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ea9130-6965-4e06-8e66-05eb615457bd None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:23.265294 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d44557-994c-4019-acee-0d5b71f25598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:23.265909 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d44557-994c-4019-acee-0d5b71f25598 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:23.266236 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d44557-994c-4019-acee-0d5b71f25598 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:23.266531 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d44557-994c-4019-acee-0d5b71f25598 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:23.267268 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d44557-994c-4019-acee-0d5b71f25598 None admin] RBAC: Adding query filter params (role.id=604444e7ad0d437dbd1f5a6e02b761f5, scope.project.id=52f32cd0707b4e2c922768eddcc432e5, user.id=c7cd3768564c4ea5ac5dcd1cac8a8ead) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:10:23.267581 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d44557-994c-4019-acee-0d5b71f25598 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:23.269021 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d44557-994c-4019-acee-0d5b71f25598 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:23.279251 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 148/294] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Sep 20 22:10:23 2022] GET /identity/v3/role_assignments?user.id=c7cd3768564c4ea5ac5dcd1cac8a8ead&scope.project.id=52f32cd0707b4e2c922768eddcc432e5&role.id=604444e7ad0d437dbd1f5a6e02b761f5 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:23.899779 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82c7ec3-79c0-41c9-bf8e-01639c6a3c75 None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:23.900304 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82c7ec3-79c0-41c9-bf8e-01639c6a3c75 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:23.900304 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82c7ec3-79c0-41c9-bf8e-01639c6a3c75 None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:23.901990 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 147/295] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:10:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:10:23.908008 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2de612b-6946-467c-8a8c-a46ec40d50f3 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:23.908523 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2de612b-6946-467c-8a8c-a46ec40d50f3 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:23.909232 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2de612b-6946-467c-8a8c-a46ec40d50f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:23.931728 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-d2de612b-6946-467c-8a8c-a46ec40d50f3 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:10:23.933309 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-d2de612b-6946-467c-8a8c-a46ec40d50f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:10:24.011091 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 149/296] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:10:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 22:10:24.135544 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf539886-034f-4793-8449-34ed59ed021e None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:24.136211 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf539886-034f-4793-8449-34ed59ed021e None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:24.136688 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf539886-034f-4793-8449-34ed59ed021e None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:24.138522 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 148/297] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:10:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:10:24.144128 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2478591f-e39f-48e7-84e0-8d73a97b37e4 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:24.144567 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2478591f-e39f-48e7-84e0-8d73a97b37e4 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:24.144661 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2478591f-e39f-48e7-84e0-8d73a97b37e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:24.162961 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-2478591f-e39f-48e7-84e0-8d73a97b37e4 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:10:24.164607 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-2478591f-e39f-48e7-84e0-8d73a97b37e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:10:24.195222 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:24.238420 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 150/298] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:10:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 22:10:24.248142 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92987d12-8967-46ae-b4a8-a118d40e5a1b None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:24.248437 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92987d12-8967-46ae-b4a8-a118d40e5a1b None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:24.248716 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92987d12-8967-46ae-b4a8-a118d40e5a1b None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:24.250198 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 149/299] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:10:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:10:24.255593 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161a9450-975b-462a-a68b-2051a03866a9 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:24.256109 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161a9450-975b-462a-a68b-2051a03866a9 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:24.256604 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161a9450-975b-462a-a68b-2051a03866a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:24.275189 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-161a9450-975b-462a-a68b-2051a03866a9 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:10:24.276654 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-161a9450-975b-462a-a68b-2051a03866a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:10:24.284479 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92987d12-8967-46ae-b4a8-a118d40e5a1b None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:24.386584 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 151/300] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:10:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 22:10:24.410395 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92987d12-8967-46ae-b4a8-a118d40e5a1b None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:24.449498 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd26560b-b973-48b5-99f3-4de4b2313cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:24.450467 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd26560b-b973-48b5-99f3-4de4b2313cc6 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:24.450969 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd26560b-b973-48b5-99f3-4de4b2313cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:24.451508 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd26560b-b973-48b5-99f3-4de4b2313cc6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:24.462486 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd26560b-b973-48b5-99f3-4de4b2313cc6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 22:10:24.467745 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-dd26560b-b973-48b5-99f3-4de4b2313cc6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 20 22:10:24.467745 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:10:24.467745 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:10:24.467745 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:10:24.467745 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:10:24.467745 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:10:24.467745 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:10:24.467745 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:10:24.467745 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:10:24.467745 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:10:24.467745 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:10:24.467745 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:10:24.467745 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 22:10:24.467745 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 22:10:24.467745 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 22:10:24.467745 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 22:10:24.468619 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 22:10:24.468619 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 22:10:24.468619 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 22:10:24.468619 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 22:10:24.468619 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:10:24.468619 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:10:24.468619 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:10:24.468619 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:10:24.468619 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:10:24.468619 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:10:24.468619 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:10:24.468619 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:10:24.468619 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:10:24.468619 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:10:24.468619 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:10:24.468619 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:10:24.469399 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:10:24.469399 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:10:24.469399 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:10:24.469399 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:10:24.469399 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 22:10:24.469399 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 22:10:24.469399 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 22:10:24.469399 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 22:10:24.469399 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 22:10:24.469399 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 22:10:24.469399 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 20 22:10:24.469399 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:10:24.471653 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 150/301] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 20 22:10:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 20 22:10:24.478232 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161a9450-975b-462a-a68b-2051a03866a9 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:24.531821 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd26560b-b973-48b5-99f3-4de4b2313cc6 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:24.581245 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:24.583171 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:24.592838 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161a9450-975b-462a-a68b-2051a03866a9 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:24.645417 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd26560b-b973-48b5-99f3-4de4b2313cc6 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:24.650333 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cff7ae-33af-4619-a2b5-94774ea4c949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:24.651362 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cff7ae-33af-4619-a2b5-94774ea4c949 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:24.651840 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cff7ae-33af-4619-a2b5-94774ea4c949 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:24.652313 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cff7ae-33af-4619-a2b5-94774ea4c949 None admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:24.653194 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cff7ae-33af-4619-a2b5-94774ea4c949 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:10:24.653724 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cff7ae-33af-4619-a2b5-94774ea4c949 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:24.656057 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cff7ae-33af-4619-a2b5-94774ea4c949 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:24.671100 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 152/302] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Sep 20 22:10:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:24.672198 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cff7ae-33af-4619-a2b5-94774ea4c949 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:24.694771 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a974c37a-2d87-4a9e-9889-01e92477dae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:24.696170 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a974c37a-2d87-4a9e-9889-01e92477dae3 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:24.696595 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a974c37a-2d87-4a9e-9889-01e92477dae3 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:24.697255 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a974c37a-2d87-4a9e-9889-01e92477dae3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:24.711698 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a974c37a-2d87-4a9e-9889-01e92477dae3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 22:10:24.716768 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-a974c37a-2d87-4a9e-9889-01e92477dae3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 20 22:10:24.716768 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:10:24.716768 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:10:24.716768 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:10:24.716768 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:10:24.716768 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:10:24.716768 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:10:24.716768 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:10:24.716768 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:10:24.716768 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:10:24.716768 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:10:24.716768 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:10:24.716768 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 22:10:24.716768 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 22:10:24.716768 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 22:10:24.716768 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 22:10:24.717808 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 22:10:24.717808 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 22:10:24.717808 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 22:10:24.717808 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 22:10:24.717808 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:10:24.717808 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:10:24.717808 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:10:24.717808 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:10:24.717808 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:10:24.717808 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:10:24.717808 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:10:24.717808 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:10:24.717808 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:10:24.717808 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:10:24.717808 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:10:24.717808 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:10:24.718790 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:10:24.718790 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:10:24.718790 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:10:24.718790 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:10:24.718790 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 22:10:24.718790 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 22:10:24.718790 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 22:10:24.718790 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 22:10:24.718790 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 22:10:24.718790 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 22:10:24.718790 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 20 22:10:24.718790 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:10:24.720763 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 151/303] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 20 22:10:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 20 22:10:24.721670 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a974c37a-2d87-4a9e-9889-01e92477dae3 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:24.781444 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cff7ae-33af-4619-a2b5-94774ea4c949 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:24.815868 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f730f1-eb8f-4950-a534-2ec79cec19d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:24.816492 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f730f1-eb8f-4950-a534-2ec79cec19d8 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:24.816774 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f730f1-eb8f-4950-a534-2ec79cec19d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:24.817049 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f730f1-eb8f-4950-a534-2ec79cec19d8 None admin] PATH_INFO: `/v3/users/e64f975f10544c47834ac3316188bd87` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:24.824009 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a974c37a-2d87-4a9e-9889-01e92477dae3 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:24.830054 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f730f1-eb8f-4950-a534-2ec79cec19d8 None admin] RBAC: Authorizing `identity:get_user(user_id=e64f975f10544c47834ac3316188bd87)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:24.831502 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:24.831612 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f730f1-eb8f-4950-a534-2ec79cec19d8 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:24.833128 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 153/304] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Sep 20 22:10:24 2022] GET /identity/v3/users/e64f975f10544c47834ac3316188bd87 => generated 293 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 22:10:24.833128 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f730f1-eb8f-4950-a534-2ec79cec19d8 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:24.851882 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:24.869919 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0eca29-a077-4d97-b2bd-70dcee17abfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:24.870595 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0eca29-a077-4d97-b2bd-70dcee17abfa None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:24.870873 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0eca29-a077-4d97-b2bd-70dcee17abfa None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:24.871147 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0eca29-a077-4d97-b2bd-70dcee17abfa None admin] PATH_INFO: `/v3/domains/default` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:24.872250 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0eca29-a077-4d97-b2bd-70dcee17abfa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:24.873687 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0eca29-a077-4d97-b2bd-70dcee17abfa None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:24.875454 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 152/305] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 20 22:10:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:24.876402 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bc6407-ebf7-4994-a413-5f3e61c9e070 None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:24.876685 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bc6407-ebf7-4994-a413-5f3e61c9e070 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:24.876959 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bc6407-ebf7-4994-a413-5f3e61c9e070 None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:24.880612 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 153/306] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:10:24 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:10:24.880612 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bc6407-ebf7-4994-a413-5f3e61c9e070 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:24.938363 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f730f1-eb8f-4950-a534-2ec79cec19d8 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:24.972149 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4103e1c5-97d7-4d3f-be21-a342b87ada88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:24.972679 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4103e1c5-97d7-4d3f-be21-a342b87ada88 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:24.972960 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4103e1c5-97d7-4d3f-be21-a342b87ada88 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:24.973228 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4103e1c5-97d7-4d3f-be21-a342b87ada88 None admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:24.973887 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4103e1c5-97d7-4d3f-be21-a342b87ada88 None admin] RBAC: Adding query filter params (name=member) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:10:24.974185 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4103e1c5-97d7-4d3f-be21-a342b87ada88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:24.975601 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4103e1c5-97d7-4d3f-be21-a342b87ada88 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:24.980027 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bc6407-ebf7-4994-a413-5f3e61c9e070 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:24.983504 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 154/307] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Sep 20 22:10:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:24.988204 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4103e1c5-97d7-4d3f-be21-a342b87ada88 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:25.014142 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397e1c2e-132f-4800-86bf-34dc8d5a8378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:25.014781 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397e1c2e-132f-4800-86bf-34dc8d5a8378 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:25.015064 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397e1c2e-132f-4800-86bf-34dc8d5a8378 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:25.015337 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397e1c2e-132f-4800-86bf-34dc8d5a8378 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:25.016059 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397e1c2e-132f-4800-86bf-34dc8d5a8378 None admin] RBAC: Adding query filter params (role.id=22cfe7a128b64671998d0ff9c54f8ce4, user.id=e64f975f10544c47834ac3316188bd87, scope.system=all) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:10:25.016369 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397e1c2e-132f-4800-86bf-34dc8d5a8378 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:25.017791 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397e1c2e-132f-4800-86bf-34dc8d5a8378 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:25.022623 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 154/308] 10.222.0.33 () {56 vars in 1308 bytes} [Tue Sep 20 22:10:24 2022] GET /identity/v3/role_assignments?user.id=e64f975f10544c47834ac3316188bd87&scope.system=all&role.id=22cfe7a128b64671998d0ff9c54f8ce4 => generated 226 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:25.024319 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e6a29-f87e-4d19-8204-35c81a237074 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:25.024604 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e6a29-f87e-4d19-8204-35c81a237074 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:25.024880 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e6a29-f87e-4d19-8204-35c81a237074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:25.051855 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-2a4e6a29-f87e-4d19-8204-35c81a237074 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:10:25.053100 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-2a4e6a29-f87e-4d19-8204-35c81a237074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:10:25.069187 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:25.091644 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:25.095904 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4103e1c5-97d7-4d3f-be21-a342b87ada88 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:25.138586 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 155/309] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:10:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 22:10:25.138785 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6a8260-fd15-42c0-a356-5397d09d7e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:25.138893 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4e6a29-f87e-4d19-8204-35c81a237074 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:25.139017 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6a8260-fd15-42c0-a356-5397d09d7e4c None admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:25.139017 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6a8260-fd15-42c0-a356-5397d09d7e4c None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:25.139017 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6a8260-fd15-42c0-a356-5397d09d7e4c None admin] PATH_INFO: `/v3/groups` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:25.139017 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6a8260-fd15-42c0-a356-5397d09d7e4c None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:25.139017 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6a8260-fd15-42c0-a356-5397d09d7e4c None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:25.166808 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 155/310] 10.222.0.33 () {60 vars in 1134 bytes} [Tue Sep 20 22:10:24 2022] POST /identity/v3/groups => generated 229 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:10:25.283828 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4e6a29-f87e-4d19-8204-35c81a237074 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:25.323514 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ee861e-1b25-45ba-8889-baf4d7d60820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:25.324170 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ee861e-1b25-45ba-8889-baf4d7d60820 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:25.324449 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ee861e-1b25-45ba-8889-baf4d7d60820 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:25.324720 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ee861e-1b25-45ba-8889-baf4d7d60820 None admin] PATH_INFO: `/v3/users/b5af2b7c914041d6abf15c1c75b49278` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:25.325926 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ee861e-1b25-45ba-8889-baf4d7d60820 None admin] RBAC: Authorizing `identity:get_user(user_id=b5af2b7c914041d6abf15c1c75b49278)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:25.327438 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ee861e-1b25-45ba-8889-baf4d7d60820 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:25.329075 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 156/311] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Sep 20 22:10:25 2022] GET /identity/v3/users/b5af2b7c914041d6abf15c1c75b49278 => generated 293 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:25.334952 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6a8260-fd15-42c0-a356-5397d09d7e4c None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:25.419377 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ee861e-1b25-45ba-8889-baf4d7d60820 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:25.450926 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6a8260-fd15-42c0-a356-5397d09d7e4c None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:25.475274 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:25.485902 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ac3264-afea-4be5-a347-bb0fb3273c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:25.486544 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ac3264-afea-4be5-a347-bb0fb3273c7a None admin] REQUEST_METHOD: `PUT` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:25.486835 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ac3264-afea-4be5-a347-bb0fb3273c7a None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:25.487114 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ac3264-afea-4be5-a347-bb0fb3273c7a None admin] PATH_INFO: `/v3/system/users/b5af2b7c914041d6abf15c1c75b49278/roles/604444e7ad0d437dbd1f5a6e02b761f5` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:25.488556 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ac3264-afea-4be5-a347-bb0fb3273c7a None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=b5af2b7c914041d6abf15c1c75b49278, role_id=604444e7ad0d437dbd1f5a6e02b761f5)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:25.489941 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ac3264-afea-4be5-a347-bb0fb3273c7a None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:25.502135 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 156/312] 10.222.0.33 () {58 vars in 1334 bytes} [Tue Sep 20 22:10:25 2022] PUT /identity/v3/system/users/b5af2b7c914041d6abf15c1c75b49278/roles/604444e7ad0d437dbd1f5a6e02b761f5 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:10:25.550447 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ee861e-1b25-45ba-8889-baf4d7d60820 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:25.591201 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1b99c8-5d82-4ee4-a2fc-6eae18e4db7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:25.591854 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1b99c8-5d82-4ee4-a2fc-6eae18e4db7f None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:25.592138 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1b99c8-5d82-4ee4-a2fc-6eae18e4db7f None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:25.592412 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1b99c8-5d82-4ee4-a2fc-6eae18e4db7f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:25.606478 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1b99c8-5d82-4ee4-a2fc-6eae18e4db7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 22:10:25.612647 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-fb1b99c8-5d82-4ee4-a2fc-6eae18e4db7f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 20 22:10:25.612647 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:10:25.612647 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:10:25.612647 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:10:25.612647 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:10:25.612647 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:10:25.612647 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:10:25.612647 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:10:25.612647 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:10:25.612647 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:10:25.612647 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:10:25.612647 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:10:25.612647 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 22:10:25.612647 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 22:10:25.612647 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 22:10:25.612647 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 22:10:25.613567 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 22:10:25.613567 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 22:10:25.613567 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 22:10:25.613567 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 22:10:25.613567 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:10:25.613567 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:10:25.613567 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:10:25.613567 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:10:25.613567 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:10:25.613567 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:10:25.613567 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:10:25.613567 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:10:25.613567 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:10:25.613567 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:10:25.613567 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:10:25.613567 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:10:25.614347 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:10:25.614347 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:10:25.614347 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:10:25.614347 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:10:25.614347 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 22:10:25.614347 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 22:10:25.614347 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 22:10:25.614347 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 22:10:25.614347 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 22:10:25.614347 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 22:10:25.614347 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 20 22:10:25.614347 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:10:25.614347 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 157/313] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 20 22:10:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 20 22:10:25.620345 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ac3264-afea-4be5-a347-bb0fb3273c7a None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:25.623608 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:25.740935 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ac3264-afea-4be5-a347-bb0fb3273c7a None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:25.777261 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ee2990-49dd-4889-92af-5efdf8b10a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:25.777879 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ee2990-49dd-4889-92af-5efdf8b10a07 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:25.778162 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ee2990-49dd-4889-92af-5efdf8b10a07 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:25.778432 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ee2990-49dd-4889-92af-5efdf8b10a07 None admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:25.779135 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ee2990-49dd-4889-92af-5efdf8b10a07 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:10:25.779440 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ee2990-49dd-4889-92af-5efdf8b10a07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:25.780821 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ee2990-49dd-4889-92af-5efdf8b10a07 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:25.790676 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 157/314] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Sep 20 22:10:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:25.800267 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1b99c8-5d82-4ee4-a2fc-6eae18e4db7f None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:25.908038 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:25.915187 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1b99c8-5d82-4ee4-a2fc-6eae18e4db7f None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:25.955973 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f0face-b0f8-4929-b73c-ee5b6b7fb5ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:25.956610 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f0face-b0f8-4929-b73c-ee5b6b7fb5ba None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:25.956886 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f0face-b0f8-4929-b73c-ee5b6b7fb5ba None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:25.957160 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f0face-b0f8-4929-b73c-ee5b6b7fb5ba None admin] PATH_INFO: `/v3/users/74cc566edfb04bcfbb4f7fb3159c8534` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:25.958287 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f0face-b0f8-4929-b73c-ee5b6b7fb5ba None admin] RBAC: Authorizing `identity:get_user(user_id=74cc566edfb04bcfbb4f7fb3159c8534)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:25.959758 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f0face-b0f8-4929-b73c-ee5b6b7fb5ba None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:25.965938 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 158/315] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Sep 20 22:10:25 2022] GET /identity/v3/users/74cc566edfb04bcfbb4f7fb3159c8534 => generated 297 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:25.967324 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ee2990-49dd-4889-92af-5efdf8b10a07 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:26.040787 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:26.081223 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ee2990-49dd-4889-92af-5efdf8b10a07 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:26.116526 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08131f2-3b31-4c58-b12e-37fa8f81a2f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:26.117466 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08131f2-3b31-4c58-b12e-37fa8f81a2f9 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:26.117973 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08131f2-3b31-4c58-b12e-37fa8f81a2f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:26.118439 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08131f2-3b31-4c58-b12e-37fa8f81a2f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:26.189260 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08131f2-3b31-4c58-b12e-37fa8f81a2f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:26.191542 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08131f2-3b31-4c58-b12e-37fa8f81a2f9 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:26.256883 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:26.302055 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 158/316] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 20 22:10:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 20 22:10:26.305731 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f0face-b0f8-4929-b73c-ee5b6b7fb5ba None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:26.412358 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f0face-b0f8-4929-b73c-ee5b6b7fb5ba None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:26.447109 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f689886-2609-4889-ab64-1d221796e2f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:26.447668 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f689886-2609-4889-ab64-1d221796e2f4 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:26.447945 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f689886-2609-4889-ab64-1d221796e2f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:26.448212 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f689886-2609-4889-ab64-1d221796e2f4 None admin] PATH_INFO: `/v3/projects/52f32cd0707b4e2c922768eddcc432e5` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:26.449333 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f689886-2609-4889-ab64-1d221796e2f4 None admin] RBAC: Authorizing `identity:get_project(project_id=52f32cd0707b4e2c922768eddcc432e5)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:26.450789 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f689886-2609-4889-ab64-1d221796e2f4 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:26.452408 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 159/317] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Sep 20 22:10:26 2022] GET /identity/v3/projects/52f32cd0707b4e2c922768eddcc432e5 => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:26.458376 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08131f2-3b31-4c58-b12e-37fa8f81a2f9 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:26.567967 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08131f2-3b31-4c58-b12e-37fa8f81a2f9 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:26.603012 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c605daff-f629-432d-94cc-80d16734aba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:26.603616 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c605daff-f629-432d-94cc-80d16734aba5 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:26.603892 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c605daff-f629-432d-94cc-80d16734aba5 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:26.604160 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c605daff-f629-432d-94cc-80d16734aba5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:26.604880 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c605daff-f629-432d-94cc-80d16734aba5 None admin] RBAC: Adding query filter params (role.id=22cfe7a128b64671998d0ff9c54f8ce4, scope.project.id=52f32cd0707b4e2c922768eddcc432e5, user.id=74cc566edfb04bcfbb4f7fb3159c8534) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:10:26.605187 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c605daff-f629-432d-94cc-80d16734aba5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:26.606689 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c605daff-f629-432d-94cc-80d16734aba5 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:26.612871 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 159/318] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Sep 20 22:10:26 2022] GET /identity/v3/role_assignments?user.id=74cc566edfb04bcfbb4f7fb3159c8534&scope.project.id=52f32cd0707b4e2c922768eddcc432e5&role.id=22cfe7a128b64671998d0ff9c54f8ce4 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:27.280775 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31482f7c-5bc0-44db-99c9-44893b1f3690 None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:27.281057 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31482f7c-5bc0-44db-99c9-44893b1f3690 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:27.281512 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31482f7c-5bc0-44db-99c9-44893b1f3690 None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:27.282928 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 160/319] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:10:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:10:27.288065 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9625864d-0d05-4129-8afb-79d31e2e63d0 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:27.288486 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9625864d-0d05-4129-8afb-79d31e2e63d0 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:27.288680 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9625864d-0d05-4129-8afb-79d31e2e63d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:27.307363 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-9625864d-0d05-4129-8afb-79d31e2e63d0 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:10:27.308555 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-9625864d-0d05-4129-8afb-79d31e2e63d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:10:27.332383 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:27.379048 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 160/320] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:10:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 22:10:27.521009 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b9742b-fd65-4859-9be9-ffccdcfae4df None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:27.521508 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b9742b-fd65-4859-9be9-ffccdcfae4df None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:27.521617 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b9742b-fd65-4859-9be9-ffccdcfae4df None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:27.523114 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 161/321] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:10:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:10:27.528113 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036e64cd-72e0-4fed-b693-b136ac94eab0 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:27.528406 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036e64cd-72e0-4fed-b693-b136ac94eab0 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:27.528683 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036e64cd-72e0-4fed-b693-b136ac94eab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:27.547373 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-036e64cd-72e0-4fed-b693-b136ac94eab0 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:10:27.548497 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-036e64cd-72e0-4fed-b693-b136ac94eab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:10:27.614576 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 161/322] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:10:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 22:10:27.646993 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b9742b-fd65-4859-9be9-ffccdcfae4df None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:27.681560 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:27.755562 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b9742b-fd65-4859-9be9-ffccdcfae4df None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:27.789572 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a514c5-bea0-4d39-b084-9bf123997c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:27.790199 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a514c5-bea0-4d39-b084-9bf123997c69 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:27.790476 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a514c5-bea0-4d39-b084-9bf123997c69 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:27.790772 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a514c5-bea0-4d39-b084-9bf123997c69 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:27.792724 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24636d5-05e1-4e8b-9537-3f471276c040 None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:27.793014 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24636d5-05e1-4e8b-9537-3f471276c040 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:27.793343 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24636d5-05e1-4e8b-9537-3f471276c040 None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:27.794785 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 162/323] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:10:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 20 22:10:27.799505 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2760b8f1-0f86-4498-a243-09e3ffd79f2b None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:27.799738 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2760b8f1-0f86-4498-a243-09e3ffd79f2b None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:27.800015 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2760b8f1-0f86-4498-a243-09e3ffd79f2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:27.801437 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a514c5-bea0-4d39-b084-9bf123997c69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 22:10:27.806559 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-52a514c5-bea0-4d39-b084-9bf123997c69 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 20 22:10:27.806559 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:10:27.806559 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:10:27.806559 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:10:27.806559 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:10:27.806559 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:10:27.806559 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:10:27.806559 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:10:27.806559 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:10:27.806559 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:10:27.806559 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:10:27.806559 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:10:27.806559 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 22:10:27.806559 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 22:10:27.806559 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 22:10:27.806559 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 22:10:27.807411 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 22:10:27.807411 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 22:10:27.807411 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 22:10:27.807411 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 22:10:27.807411 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:10:27.807411 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:10:27.807411 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:10:27.807411 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:10:27.807411 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:10:27.807411 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:10:27.807411 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:10:27.807411 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:10:27.807411 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:10:27.807411 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:10:27.807411 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:10:27.807411 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:10:27.808239 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:10:27.808239 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:10:27.808239 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:10:27.808239 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:10:27.808239 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 22:10:27.808239 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 22:10:27.808239 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 22:10:27.808239 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 22:10:27.808239 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 22:10:27.808239 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 22:10:27.808239 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 20 22:10:27.808239 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:10:27.810658 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 162/324] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 20 22:10:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:10:27.813395 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a514c5-bea0-4d39-b084-9bf123997c69 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:27.824367 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-2760b8f1-0f86-4498-a243-09e3ffd79f2b None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:10:27.825598 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-2760b8f1-0f86-4498-a243-09e3ffd79f2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:10:27.898614 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 163/325] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:10:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 20 22:10:27.899667 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2760b8f1-0f86-4498-a243-09e3ffd79f2b None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:27.914399 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:27.920769 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:27.926907 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a514c5-bea0-4d39-b084-9bf123997c69 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:27.970056 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda4cc3e-4951-41fe-a906-6dc1f61de9af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:27.970695 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4cc3e-4951-41fe-a906-6dc1f61de9af None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:27.971453 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4cc3e-4951-41fe-a906-6dc1f61de9af None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:27.971733 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4cc3e-4951-41fe-a906-6dc1f61de9af None admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:27.972685 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda4cc3e-4951-41fe-a906-6dc1f61de9af None admin] RBAC: Adding query filter params (name=reader) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:10:27.972992 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda4cc3e-4951-41fe-a906-6dc1f61de9af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:27.975274 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda4cc3e-4951-41fe-a906-6dc1f61de9af None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:27.986656 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 163/326] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Sep 20 22:10:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 22:10:27.991801 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda4cc3e-4951-41fe-a906-6dc1f61de9af None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:28.008748 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2760b8f1-0f86-4498-a243-09e3ffd79f2b None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:28.045821 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ade86d-6b1b-4dd1-bd78-865e66f95ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:28.046446 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ade86d-6b1b-4dd1-bd78-865e66f95ddb None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:28.046757 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ade86d-6b1b-4dd1-bd78-865e66f95ddb None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:28.047008 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ade86d-6b1b-4dd1-bd78-865e66f95ddb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:28.048106 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ade86d-6b1b-4dd1-bd78-865e66f95ddb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:28.049576 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ade86d-6b1b-4dd1-bd78-865e66f95ddb None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:28.051280 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 164/327] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 20 22:10:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:28.056801 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ade86d-6b1b-4dd1-bd78-865e66f95ddb None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:28.106789 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda4cc3e-4951-41fe-a906-6dc1f61de9af None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:28.140804 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7387bd74-62fb-4370-bebc-f7ebe01c7b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:28.141431 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7387bd74-62fb-4370-bebc-f7ebe01c7b28 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:28.141705 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7387bd74-62fb-4370-bebc-f7ebe01c7b28 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:28.141978 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7387bd74-62fb-4370-bebc-f7ebe01c7b28 None admin] PATH_INFO: `/v3/users/e64f975f10544c47834ac3316188bd87` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:28.143115 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7387bd74-62fb-4370-bebc-f7ebe01c7b28 None admin] RBAC: Authorizing `identity:get_user(user_id=e64f975f10544c47834ac3316188bd87)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:28.144629 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7387bd74-62fb-4370-bebc-f7ebe01c7b28 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:28.151353 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 164/328] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Sep 20 22:10:27 2022] GET /identity/v3/users/e64f975f10544c47834ac3316188bd87 => generated 293 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 22:10:28.152282 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7387bd74-62fb-4370-bebc-f7ebe01c7b28 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:28.153011 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:28.168552 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ade86d-6b1b-4dd1-bd78-865e66f95ddb None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:28.178196 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:28.202551 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f542fd95-34e2-49c2-9056-292afc32b82f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:28.203151 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f542fd95-34e2-49c2-9056-292afc32b82f None admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:28.203422 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f542fd95-34e2-49c2-9056-292afc32b82f None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:28.203687 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f542fd95-34e2-49c2-9056-292afc32b82f None admin] PATH_INFO: `/v3/groups` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:28.204308 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f542fd95-34e2-49c2-9056-292afc32b82f None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:28.205724 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f542fd95-34e2-49c2-9056-292afc32b82f None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:28.220347 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 165/329] 10.222.0.33 () {60 vars in 1134 bytes} [Tue Sep 20 22:10:28 2022] POST /identity/v3/groups => generated 226 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 20 22:10:28.227664 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f542fd95-34e2-49c2-9056-292afc32b82f None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:28.263002 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7387bd74-62fb-4370-bebc-f7ebe01c7b28 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:28.311745 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3853cde-5a23-4cc5-b186-5ba0304bd7a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:28.312426 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3853cde-5a23-4cc5-b186-5ba0304bd7a8 None admin] REQUEST_METHOD: `PUT` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:28.312709 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3853cde-5a23-4cc5-b186-5ba0304bd7a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:28.312989 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3853cde-5a23-4cc5-b186-5ba0304bd7a8 None admin] PATH_INFO: `/v3/system/users/e64f975f10544c47834ac3316188bd87/roles/22cfe7a128b64671998d0ff9c54f8ce4` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:28.314561 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3853cde-5a23-4cc5-b186-5ba0304bd7a8 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=e64f975f10544c47834ac3316188bd87, role_id=22cfe7a128b64671998d0ff9c54f8ce4)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:28.316048 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3853cde-5a23-4cc5-b186-5ba0304bd7a8 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:28.327313 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 165/330] 10.222.0.33 () {58 vars in 1334 bytes} [Tue Sep 20 22:10:28 2022] PUT /identity/v3/system/users/e64f975f10544c47834ac3316188bd87/roles/22cfe7a128b64671998d0ff9c54f8ce4 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 22:10:28.351174 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f542fd95-34e2-49c2-9056-292afc32b82f None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:28.398614 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef844c7-7601-4f96-b082-70b3198d28ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:28.399267 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef844c7-7601-4f96-b082-70b3198d28ec None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:28.399548 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef844c7-7601-4f96-b082-70b3198d28ec None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:28.399821 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef844c7-7601-4f96-b082-70b3198d28ec None admin] PATH_INFO: `/v3/roles/member` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:28.413234 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef844c7-7601-4f96-b082-70b3198d28ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 22:10:28.418845 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-2ef844c7-7601-4f96-b082-70b3198d28ec None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 20 22:10:28.418845 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:10:28.418845 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:10:28.418845 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:10:28.418845 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:10:28.418845 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:10:28.418845 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:10:28.418845 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:10:28.418845 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:10:28.418845 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:10:28.418845 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:10:28.418845 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:10:28.418845 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 22:10:28.418845 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 22:10:28.418845 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 22:10:28.418845 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 22:10:28.419804 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 22:10:28.419804 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 22:10:28.419804 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 22:10:28.419804 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 22:10:28.419804 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:10:28.419804 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:10:28.419804 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:10:28.419804 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:10:28.419804 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:10:28.419804 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:10:28.419804 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:10:28.419804 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:10:28.419804 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:10:28.419804 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:10:28.419804 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:10:28.419804 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:10:28.420629 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:10:28.420629 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:10:28.420629 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:10:28.420629 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:10:28.420629 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 22:10:28.420629 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 22:10:28.420629 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 22:10:28.420629 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 22:10:28.420629 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 22:10:28.420629 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 22:10:28.420629 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 20 22:10:28.420629 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:10:28.420629 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 166/331] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 20 22:10:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:10:28.426159 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3853cde-5a23-4cc5-b186-5ba0304bd7a8 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:28.525864 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:28.544084 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3853cde-5a23-4cc5-b186-5ba0304bd7a8 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:28.579713 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7b0e83-3e86-4462-9a26-eab770caabb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:28.580244 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7b0e83-3e86-4462-9a26-eab770caabb4 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:28.580522 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7b0e83-3e86-4462-9a26-eab770caabb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:28.580791 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7b0e83-3e86-4462-9a26-eab770caabb4 None admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:28.581453 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7b0e83-3e86-4462-9a26-eab770caabb4 None admin] RBAC: Adding query filter params (name=member) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:10:28.581752 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7b0e83-3e86-4462-9a26-eab770caabb4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:28.583211 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7b0e83-3e86-4462-9a26-eab770caabb4 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:28.592754 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 166/332] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Sep 20 22:10:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:28.598110 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef844c7-7601-4f96-b082-70b3198d28ec None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:28.608041 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:28.706475 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef844c7-7601-4f96-b082-70b3198d28ec None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:28.741673 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b51788-9f92-4176-aee4-f53f12f07388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:28.742394 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b51788-9f92-4176-aee4-f53f12f07388 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:28.742760 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b51788-9f92-4176-aee4-f53f12f07388 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:28.743090 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b51788-9f92-4176-aee4-f53f12f07388 None admin] PATH_INFO: `/v3/users/b5af2b7c914041d6abf15c1c75b49278` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:28.744298 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b51788-9f92-4176-aee4-f53f12f07388 None admin] RBAC: Authorizing `identity:get_user(user_id=b5af2b7c914041d6abf15c1c75b49278)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:28.745785 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b51788-9f92-4176-aee4-f53f12f07388 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:28.747744 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 167/333] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Sep 20 22:10:28 2022] GET /identity/v3/users/b5af2b7c914041d6abf15c1c75b49278 => generated 293 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 22:10:28.753227 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7b0e83-3e86-4462-9a26-eab770caabb4 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:28.863516 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7b0e83-3e86-4462-9a26-eab770caabb4 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:28.908544 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e727d35-6953-4095-b0e9-35701487264f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:28.909156 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e727d35-6953-4095-b0e9-35701487264f None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:28.909438 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e727d35-6953-4095-b0e9-35701487264f None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:28.909706 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e727d35-6953-4095-b0e9-35701487264f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:28.910432 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e727d35-6953-4095-b0e9-35701487264f None admin] RBAC: Adding query filter params (role.id=604444e7ad0d437dbd1f5a6e02b761f5, user.id=b5af2b7c914041d6abf15c1c75b49278, scope.system=all) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:10:28.910814 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e727d35-6953-4095-b0e9-35701487264f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:28.912242 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e727d35-6953-4095-b0e9-35701487264f None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:28.930242 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 167/334] 10.222.0.33 () {56 vars in 1308 bytes} [Tue Sep 20 22:10:28 2022] GET /identity/v3/role_assignments?user.id=b5af2b7c914041d6abf15c1c75b49278&scope.system=all&role.id=604444e7ad0d437dbd1f5a6e02b761f5 => generated 510 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 22:10:30.624518 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94184025-a192-4645-b64d-d1a781c762c3 None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:30.625027 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94184025-a192-4645-b64d-d1a781c762c3 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:30.625128 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94184025-a192-4645-b64d-d1a781c762c3 None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:30.626642 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 168/335] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:10:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:10:30.633250 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1778e46b-0a2c-4053-8fcf-9776d27d1f14 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:30.633675 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1778e46b-0a2c-4053-8fcf-9776d27d1f14 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:30.633847 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1778e46b-0a2c-4053-8fcf-9776d27d1f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:30.647126 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:30.653579 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-1778e46b-0a2c-4053-8fcf-9776d27d1f14 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:10:30.654871 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-1778e46b-0a2c-4053-8fcf-9776d27d1f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:10:30.726772 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 168/336] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:10:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 20 22:10:30.967704 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a198c105-7cf7-4197-8cbf-a041acab90a7 None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:30.968036 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a198c105-7cf7-4197-8cbf-a041acab90a7 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:30.968186 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a198c105-7cf7-4197-8cbf-a041acab90a7 None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:30.969495 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 169/337] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:10:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:10:30.975505 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc219c0-9004-43bc-a2a0-9ff21c36e235 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:30.976480 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc219c0-9004-43bc-a2a0-9ff21c36e235 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:30.976724 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc219c0-9004-43bc-a2a0-9ff21c36e235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:30.999805 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-0bc219c0-9004-43bc-a2a0-9ff21c36e235 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:10:31.000991 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-0bc219c0-9004-43bc-a2a0-9ff21c36e235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:10:31.069050 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9de6139-359c-4562-b805-39a7a49d720c None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:31.070116 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9de6139-359c-4562-b805-39a7a49d720c None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:31.070485 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9de6139-359c-4562-b805-39a7a49d720c None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:31.072201 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 170/338] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:10:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:10:31.078420 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0f1f4f-3ae8-42d5-9586-b2f9e73d8889 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:31.078833 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0f1f4f-3ae8-42d5-9586-b2f9e73d8889 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:31.079171 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0f1f4f-3ae8-42d5-9586-b2f9e73d8889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:31.089011 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 169/339] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:10:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 22:10:31.107832 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-4c0f1f4f-3ae8-42d5-9586-b2f9e73d8889 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:10:31.109014 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-4c0f1f4f-3ae8-42d5-9586-b2f9e73d8889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:10:31.151306 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc219c0-9004-43bc-a2a0-9ff21c36e235 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:31.222026 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 171/340] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:10:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 20 22:10:31.258932 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:31.285351 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc219c0-9004-43bc-a2a0-9ff21c36e235 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:31.336821 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf15079-1d8c-4551-b665-41762c2132b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:31.337466 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf15079-1d8c-4551-b665-41762c2132b2 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:31.337746 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf15079-1d8c-4551-b665-41762c2132b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:31.338019 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf15079-1d8c-4551-b665-41762c2132b2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:31.348521 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf15079-1d8c-4551-b665-41762c2132b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 22:10:31.353975 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-3cf15079-1d8c-4551-b665-41762c2132b2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 20 22:10:31.353975 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:10:31.353975 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:10:31.353975 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:10:31.353975 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:10:31.353975 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:10:31.353975 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:10:31.353975 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:10:31.353975 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:10:31.353975 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:10:31.353975 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:10:31.353975 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:10:31.353975 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 22:10:31.353975 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 22:10:31.353975 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 22:10:31.353975 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 22:10:31.354877 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 22:10:31.354877 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 22:10:31.354877 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 22:10:31.354877 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 22:10:31.354877 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:10:31.354877 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:10:31.354877 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:10:31.354877 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:10:31.354877 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:10:31.354877 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:10:31.354877 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:10:31.354877 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:10:31.354877 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:10:31.354877 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:10:31.354877 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:10:31.354877 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:10:31.355644 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:10:31.355644 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:10:31.355644 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:10:31.355644 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:10:31.355644 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 22:10:31.355644 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 22:10:31.355644 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 22:10:31.355644 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 22:10:31.355644 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 22:10:31.355644 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 22:10:31.355644 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 20 22:10:31.355644 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:10:31.355644 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 170/341] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 20 22:10:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 20 22:10:31.360945 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0f1f4f-3ae8-42d5-9586-b2f9e73d8889 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:31.364512 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:31.482855 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0f1f4f-3ae8-42d5-9586-b2f9e73d8889 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:31.522422 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d63a657-c1bd-4d36-8a4c-d072f76f54af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:31.523627 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d63a657-c1bd-4d36-8a4c-d072f76f54af None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:31.523909 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d63a657-c1bd-4d36-8a4c-d072f76f54af None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:31.524184 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d63a657-c1bd-4d36-8a4c-d072f76f54af None admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:31.524858 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d63a657-c1bd-4d36-8a4c-d072f76f54af None admin] RBAC: Adding query filter params (name=member) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:10:31.525161 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d63a657-c1bd-4d36-8a4c-d072f76f54af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:31.526575 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d63a657-c1bd-4d36-8a4c-d072f76f54af None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:31.535627 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 172/342] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Sep 20 22:10:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:31.541852 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf15079-1d8c-4551-b665-41762c2132b2 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:31.560710 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d63a657-c1bd-4d36-8a4c-d072f76f54af None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:31.646866 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:31.713885 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d63a657-c1bd-4d36-8a4c-d072f76f54af None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:31.744204 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf15079-1d8c-4551-b665-41762c2132b2 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:31.761721 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaa9cf6-0d59-4b1e-b4ed-93250abcd8d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:31.762369 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaa9cf6-0d59-4b1e-b4ed-93250abcd8d9 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:31.762681 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaa9cf6-0d59-4b1e-b4ed-93250abcd8d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:31.762955 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaa9cf6-0d59-4b1e-b4ed-93250abcd8d9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:31.784246 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaa9cf6-0d59-4b1e-b4ed-93250abcd8d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 22:10:31.789962 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-ffaa9cf6-0d59-4b1e-b4ed-93250abcd8d9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 20 22:10:31.789962 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:10:31.789962 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:10:31.789962 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:10:31.789962 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:10:31.789962 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:10:31.789962 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:10:31.789962 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:10:31.789962 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:10:31.789962 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:10:31.789962 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:10:31.789962 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:10:31.789962 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 22:10:31.789962 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 22:10:31.789962 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 22:10:31.789962 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 22:10:31.790864 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 22:10:31.790864 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 22:10:31.790864 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 22:10:31.790864 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 22:10:31.790864 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:10:31.790864 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:10:31.790864 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:10:31.790864 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:10:31.790864 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:10:31.790864 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:10:31.790864 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:10:31.790864 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:10:31.790864 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:10:31.790864 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:10:31.790864 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:10:31.790864 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:10:31.791641 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:10:31.791641 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:10:31.791641 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:10:31.791641 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:10:31.791641 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 22:10:31.791641 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 22:10:31.791641 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 22:10:31.791641 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 22:10:31.791641 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 22:10:31.791641 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 22:10:31.791641 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 20 22:10:31.791641 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:10:31.797495 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:31.799338 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 173/343] 10.222.0.33 () {56 vars in 1114 bytes} [Tue Sep 20 22:10:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:10:31.800222 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaa9cf6-0d59-4b1e-b4ed-93250abcd8d9 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:31.811500 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea38193e-6bbb-4695-b975-3f1d4a5c8f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:31.812183 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea38193e-6bbb-4695-b975-3f1d4a5c8f64 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:31.812401 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea38193e-6bbb-4695-b975-3f1d4a5c8f64 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:31.812674 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea38193e-6bbb-4695-b975-3f1d4a5c8f64 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:31.940949 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea38193e-6bbb-4695-b975-3f1d4a5c8f64 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:31.943093 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea38193e-6bbb-4695-b975-3f1d4a5c8f64 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:31.973121 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaa9cf6-0d59-4b1e-b4ed-93250abcd8d9 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:32.012899 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:32.033592 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec0a81a-ddf5-4bc1-a612-a53e6e3c5a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:32.034136 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec0a81a-ddf5-4bc1-a612-a53e6e3c5a3a None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:32.034419 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec0a81a-ddf5-4bc1-a612-a53e6e3c5a3a None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:32.034713 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec0a81a-ddf5-4bc1-a612-a53e6e3c5a3a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:32.063780 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec0a81a-ddf5-4bc1-a612-a53e6e3c5a3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 22:10:32.069640 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-cec0a81a-ddf5-4bc1-a612-a53e6e3c5a3a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 20 22:10:32.069640 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:10:32.069640 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:10:32.069640 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:10:32.069640 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:10:32.069640 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:10:32.069640 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:10:32.069640 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:10:32.069640 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:10:32.069640 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:10:32.069640 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:10:32.069640 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:10:32.069640 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 22:10:32.069640 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 22:10:32.069640 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 22:10:32.069640 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 22:10:32.070668 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 22:10:32.070668 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 22:10:32.070668 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 22:10:32.070668 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 22:10:32.070668 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:10:32.070668 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:10:32.070668 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:10:32.070668 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:10:32.070668 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:10:32.070668 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:10:32.070668 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:10:32.070668 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:10:32.070668 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:10:32.070668 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:10:32.070668 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:10:32.070668 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:10:32.071558 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:10:32.071558 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:10:32.071558 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:10:32.071558 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:10:32.071558 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 22:10:32.071558 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 22:10:32.071558 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 22:10:32.071558 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 22:10:32.071558 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 22:10:32.071558 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 22:10:32.071558 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 20 22:10:32.071558 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:10:32.071558 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 174/344] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 20 22:10:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:10:32.072236 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec0a81a-ddf5-4bc1-a612-a53e6e3c5a3a None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:32.100076 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 171/345] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 20 22:10:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 559 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 20 22:10:32.101556 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea38193e-6bbb-4695-b975-3f1d4a5c8f64 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:32.152286 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:32.256557 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec0a81a-ddf5-4bc1-a612-a53e6e3c5a3a None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:32.270539 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea38193e-6bbb-4695-b975-3f1d4a5c8f64 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:32.297696 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39af635-fcbe-42cb-b5bd-6b89b7d1d85e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:32.298308 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39af635-fcbe-42cb-b5bd-6b89b7d1d85e None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:32.298628 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39af635-fcbe-42cb-b5bd-6b89b7d1d85e None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:32.298903 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39af635-fcbe-42cb-b5bd-6b89b7d1d85e None admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:32.299568 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39af635-fcbe-42cb-b5bd-6b89b7d1d85e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:10:32.299870 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39af635-fcbe-42cb-b5bd-6b89b7d1d85e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:32.306067 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39af635-fcbe-42cb-b5bd-6b89b7d1d85e None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:32.309692 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78c7353-e678-4de5-bb64-08c5cb3a30b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:32.310307 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78c7353-e678-4de5-bb64-08c5cb3a30b4 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:32.310682 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78c7353-e678-4de5-bb64-08c5cb3a30b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:32.310955 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78c7353-e678-4de5-bb64-08c5cb3a30b4 None admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:32.311053 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 175/346] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Sep 20 22:10:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:32.311623 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78c7353-e678-4de5-bb64-08c5cb3a30b4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:10:32.311922 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78c7353-e678-4de5-bb64-08c5cb3a30b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:32.312021 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39af635-fcbe-42cb-b5bd-6b89b7d1d85e None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:32.313291 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78c7353-e678-4de5-bb64-08c5cb3a30b4 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:32.324306 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 172/347] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Sep 20 22:10:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:32.325840 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6d521d-8fea-4dce-ae27-cadabed49c4d None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:32.326267 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6d521d-8fea-4dce-ae27-cadabed49c4d None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:32.329179 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6d521d-8fea-4dce-ae27-cadabed49c4d None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:32.330834 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 173/348] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:10:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:10:32.331606 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6d521d-8fea-4dce-ae27-cadabed49c4d None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:32.382056 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:32.432429 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39af635-fcbe-42cb-b5bd-6b89b7d1d85e None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:32.433779 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:32.449869 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6d521d-8fea-4dce-ae27-cadabed49c4d None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:32.473070 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3439ecd-a901-4c21-b8e4-7250fed98e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:32.473708 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3439ecd-a901-4c21-b8e4-7250fed98e50 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:32.474311 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3439ecd-a901-4c21-b8e4-7250fed98e50 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:32.474311 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3439ecd-a901-4c21-b8e4-7250fed98e50 None admin] PATH_INFO: `/v3/projects/be4987daebfd4f378eb4bc9efc68e66c` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:32.475412 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3439ecd-a901-4c21-b8e4-7250fed98e50 None admin] RBAC: Authorizing `identity:get_project(project_id=be4987daebfd4f378eb4bc9efc68e66c)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:32.476890 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3439ecd-a901-4c21-b8e4-7250fed98e50 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:32.478891 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 176/349] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Sep 20 22:10:32 2022] GET /identity/v3/projects/be4987daebfd4f378eb4bc9efc68e66c => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:32.479757 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3439ecd-a901-4c21-b8e4-7250fed98e50 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:32.501316 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b363ea-8d7e-42a6-94c7-bdf8c109361c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:32.502328 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b363ea-8d7e-42a6-94c7-bdf8c109361c None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:32.502821 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b363ea-8d7e-42a6-94c7-bdf8c109361c None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:32.503865 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b363ea-8d7e-42a6-94c7-bdf8c109361c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:32.605807 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b363ea-8d7e-42a6-94c7-bdf8c109361c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:32.607294 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b363ea-8d7e-42a6-94c7-bdf8c109361c None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:32.611003 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3439ecd-a901-4c21-b8e4-7250fed98e50 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:32.634864 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:32.669487 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a5f7c2-1d6f-4f6e-a6f5-ef7122d69abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:32.671106 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a5f7c2-1d6f-4f6e-a6f5-ef7122d69abc None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:32.671520 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a5f7c2-1d6f-4f6e-a6f5-ef7122d69abc None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:32.671925 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a5f7c2-1d6f-4f6e-a6f5-ef7122d69abc None admin] PATH_INFO: `/v3/users/e64f975f10544c47834ac3316188bd87` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:32.675410 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a5f7c2-1d6f-4f6e-a6f5-ef7122d69abc None admin] RBAC: Authorizing `identity:get_user(user_id=e64f975f10544c47834ac3316188bd87)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:32.677175 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a5f7c2-1d6f-4f6e-a6f5-ef7122d69abc None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:32.679970 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 177/350] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Sep 20 22:10:32 2022] GET /identity/v3/users/e64f975f10544c47834ac3316188bd87 => generated 293 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:32.681863 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a083edf2-8c86-406d-885c-6db6b58e5ddd None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:32.682286 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a083edf2-8c86-406d-885c-6db6b58e5ddd None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:32.687159 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a083edf2-8c86-406d-885c-6db6b58e5ddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:32.715070 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-a083edf2-8c86-406d-885c-6db6b58e5ddd None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:10:32.717305 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-a083edf2-8c86-406d-885c-6db6b58e5ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:10:32.727238 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:32.748873 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 174/351] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 20 22:10:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 20 22:10:32.750726 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b363ea-8d7e-42a6-94c7-bdf8c109361c None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:32.807321 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 178/352] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:10:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 22:10:32.808522 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a083edf2-8c86-406d-885c-6db6b58e5ddd None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:32.870743 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b363ea-8d7e-42a6-94c7-bdf8c109361c None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:32.909840 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962cb5ef-87ba-43d9-86f7-9da045a74927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:32.910804 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962cb5ef-87ba-43d9-86f7-9da045a74927 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:32.911285 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962cb5ef-87ba-43d9-86f7-9da045a74927 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:32.911748 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962cb5ef-87ba-43d9-86f7-9da045a74927 None admin] PATH_INFO: `/v3/groups/ba043fbb3fa34638a9ca48bbf3e55c92` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:32.912883 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a083edf2-8c86-406d-885c-6db6b58e5ddd None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:32.918728 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962cb5ef-87ba-43d9-86f7-9da045a74927 None admin] RBAC: Authorizing `identity:get_group(group_id=ba043fbb3fa34638a9ca48bbf3e55c92)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:32.920451 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962cb5ef-87ba-43d9-86f7-9da045a74927 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:32.922671 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 175/353] 10.222.0.33 () {56 vars in 1180 bytes} [Tue Sep 20 22:10:32 2022] GET /identity/v3/groups/ba043fbb3fa34638a9ca48bbf3e55c92 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:32.923700 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962cb5ef-87ba-43d9-86f7-9da045a74927 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:32.929818 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:32.953415 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7040dbaf-1cc6-4574-b4b5-3d5fc4494e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:32.954075 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7040dbaf-1cc6-4574-b4b5-3d5fc4494e8d None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:32.954358 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7040dbaf-1cc6-4574-b4b5-3d5fc4494e8d None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:32.954668 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7040dbaf-1cc6-4574-b4b5-3d5fc4494e8d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:32.955625 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7040dbaf-1cc6-4574-b4b5-3d5fc4494e8d None admin] RBAC: Adding query filter params (role.id=22cfe7a128b64671998d0ff9c54f8ce4, user.id=e64f975f10544c47834ac3316188bd87, scope.system=all) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:10:32.955932 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7040dbaf-1cc6-4574-b4b5-3d5fc4494e8d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:32.957426 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7040dbaf-1cc6-4574-b4b5-3d5fc4494e8d None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:32.970490 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 179/354] 10.222.0.33 () {56 vars in 1308 bytes} [Tue Sep 20 22:10:32 2022] GET /identity/v3/role_assignments?user.id=e64f975f10544c47834ac3316188bd87&scope.system=all&role.id=22cfe7a128b64671998d0ff9c54f8ce4 => generated 510 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:32.972220 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8f1551-041b-47ae-9ed0-4ba69d880456 None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:32.972220 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8f1551-041b-47ae-9ed0-4ba69d880456 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:32.972496 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8f1551-041b-47ae-9ed0-4ba69d880456 None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:32.973728 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 180/355] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:10:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:10:32.974443 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8f1551-041b-47ae-9ed0-4ba69d880456 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:32.988381 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:33.045125 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962cb5ef-87ba-43d9-86f7-9da045a74927 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:33.083238 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377df227-d0a2-4205-ac61-ae958c425fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:33.084315 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377df227-d0a2-4205-ac61-ae958c425fa9 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:33.084861 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377df227-d0a2-4205-ac61-ae958c425fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:33.085920 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377df227-d0a2-4205-ac61-ae958c425fa9 None admin] PATH_INFO: `/v3/projects/be4987daebfd4f378eb4bc9efc68e66c` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:33.087302 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377df227-d0a2-4205-ac61-ae958c425fa9 None admin] RBAC: Authorizing `identity:get_project(project_id=be4987daebfd4f378eb4bc9efc68e66c)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:33.089098 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377df227-d0a2-4205-ac61-ae958c425fa9 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:33.090977 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 176/356] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Sep 20 22:10:32 2022] GET /identity/v3/projects/be4987daebfd4f378eb4bc9efc68e66c => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:33.092366 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8f1551-041b-47ae-9ed0-4ba69d880456 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:33.092709 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282bf620-1bc9-48b0-9542-7366f84cd143 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:33.093225 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282bf620-1bc9-48b0-9542-7366f84cd143 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:33.093708 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282bf620-1bc9-48b0-9542-7366f84cd143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:33.113924 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-282bf620-1bc9-48b0-9542-7366f84cd143 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:10:33.115676 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-282bf620-1bc9-48b0-9542-7366f84cd143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:10:33.136645 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d511fe-065f-46a9-9830-a895b8c435a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:33.137195 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d511fe-065f-46a9-9830-a895b8c435a2 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:33.138472 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d511fe-065f-46a9-9830-a895b8c435a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:33.139948 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d511fe-065f-46a9-9830-a895b8c435a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:33.141054 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d511fe-065f-46a9-9830-a895b8c435a2 None admin] RBAC: Adding query filter params (group.id=ba043fbb3fa34638a9ca48bbf3e55c92, role.id=604444e7ad0d437dbd1f5a6e02b761f5, scope.project.id=be4987daebfd4f378eb4bc9efc68e66c) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:10:33.141376 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d511fe-065f-46a9-9830-a895b8c435a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:33.143417 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d511fe-065f-46a9-9830-a895b8c435a2 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:33.156918 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 181/357] 10.222.0.33 () {56 vars in 1376 bytes} [Tue Sep 20 22:10:32 2022] GET /identity/v3/role_assignments?group.id=ba043fbb3fa34638a9ca48bbf3e55c92&scope.project.id=be4987daebfd4f378eb4bc9efc68e66c&role.id=604444e7ad0d437dbd1f5a6e02b761f5 => generated 260 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:33.158303 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d511fe-065f-46a9-9830-a895b8c435a2 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:33.242911 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:33.276135 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 177/358] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:10:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 22:10:33.278185 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282bf620-1bc9-48b0-9542-7366f84cd143 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:33.344809 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d511fe-065f-46a9-9830-a895b8c435a2 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:33.351774 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:33.391852 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf2f395-f91a-4c04-91a8-d929c1dc6492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:33.392410 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf2f395-f91a-4c04-91a8-d929c1dc6492 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:33.392686 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf2f395-f91a-4c04-91a8-d929c1dc6492 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:33.392961 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf2f395-f91a-4c04-91a8-d929c1dc6492 None admin] PATH_INFO: `/v3/groups/ba043fbb3fa34638a9ca48bbf3e55c92` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:33.394087 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf2f395-f91a-4c04-91a8-d929c1dc6492 None admin] RBAC: Authorizing `identity:get_group(group_id=ba043fbb3fa34638a9ca48bbf3e55c92)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:33.395545 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf2f395-f91a-4c04-91a8-d929c1dc6492 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:33.397121 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 182/359] 10.222.0.33 () {56 vars in 1180 bytes} [Tue Sep 20 22:10:33 2022] GET /identity/v3/groups/ba043fbb3fa34638a9ca48bbf3e55c92 => generated 226 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:33.403829 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf2f395-f91a-4c04-91a8-d929c1dc6492 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:33.425658 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282bf620-1bc9-48b0-9542-7366f84cd143 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:33.489965 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a901a6a-e4cb-4405-841f-2ccb7e31abbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:33.490800 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a901a6a-e4cb-4405-841f-2ccb7e31abbc None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:33.491082 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a901a6a-e4cb-4405-841f-2ccb7e31abbc None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:33.491970 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a901a6a-e4cb-4405-841f-2ccb7e31abbc None admin] PATH_INFO: `/v3/roles/member` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:33.506440 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a901a6a-e4cb-4405-841f-2ccb7e31abbc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 22:10:33.511864 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-7a901a6a-e4cb-4405-841f-2ccb7e31abbc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 20 22:10:33.511864 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:10:33.511864 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:10:33.511864 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:10:33.511864 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:10:33.511864 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:10:33.511864 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:10:33.511864 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:10:33.511864 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:10:33.511864 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:10:33.511864 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:10:33.511864 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:10:33.511864 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 22:10:33.511864 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 22:10:33.511864 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 22:10:33.511864 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 22:10:33.512736 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 22:10:33.512736 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 22:10:33.512736 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 22:10:33.512736 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 22:10:33.512736 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:10:33.512736 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:10:33.512736 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:10:33.512736 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:10:33.512736 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:10:33.512736 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:10:33.512736 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:10:33.512736 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:10:33.512736 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:10:33.512736 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:10:33.512736 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:10:33.512736 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:10:33.513586 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:10:33.513586 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:10:33.513586 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:10:33.513586 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:10:33.513586 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 22:10:33.513586 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 22:10:33.513586 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 22:10:33.513586 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 22:10:33.513586 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 22:10:33.513586 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 22:10:33.513586 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 20 22:10:33.513586 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:10:33.513586 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 178/360] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 20 22:10:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:10:33.518921 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a901a6a-e4cb-4405-841f-2ccb7e31abbc None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:33.564237 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf2f395-f91a-4c04-91a8-d929c1dc6492 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:33.567031 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:33.614026 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8475c855-25f7-4d2c-b13b-c4032fcf2aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:33.615038 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8475c855-25f7-4d2c-b13b-c4032fcf2aec None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:33.615544 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8475c855-25f7-4d2c-b13b-c4032fcf2aec None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:33.616009 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8475c855-25f7-4d2c-b13b-c4032fcf2aec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:33.619307 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8475c855-25f7-4d2c-b13b-c4032fcf2aec None admin] RBAC: Adding query filter params (group.id=ba043fbb3fa34638a9ca48bbf3e55c92, role.id=4e75d58a1e0e4fffa940914b1e5f46de, scope.project.id=be4987daebfd4f378eb4bc9efc68e66c) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:10:33.619836 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8475c855-25f7-4d2c-b13b-c4032fcf2aec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:33.621693 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8475c855-25f7-4d2c-b13b-c4032fcf2aec None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:33.632574 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 183/361] 10.222.0.33 () {56 vars in 1376 bytes} [Tue Sep 20 22:10:33 2022] GET /identity/v3/role_assignments?group.id=ba043fbb3fa34638a9ca48bbf3e55c92&scope.project.id=be4987daebfd4f378eb4bc9efc68e66c&role.id=4e75d58a1e0e4fffa940914b1e5f46de => generated 260 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 22:10:33.651919 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a901a6a-e4cb-4405-841f-2ccb7e31abbc None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:33.655278 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8475c855-25f7-4d2c-b13b-c4032fcf2aec None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:33.666079 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:33.705776 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b7f7f3-03ff-48f3-8ba5-8806ef9a6449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:33.706531 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b7f7f3-03ff-48f3-8ba5-8806ef9a6449 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:33.707081 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b7f7f3-03ff-48f3-8ba5-8806ef9a6449 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:33.707359 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b7f7f3-03ff-48f3-8ba5-8806ef9a6449 None admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:33.708068 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b7f7f3-03ff-48f3-8ba5-8806ef9a6449 None admin] RBAC: Adding query filter params (name=member) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:10:33.708372 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b7f7f3-03ff-48f3-8ba5-8806ef9a6449 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:33.709826 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b7f7f3-03ff-48f3-8ba5-8806ef9a6449 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:33.723419 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 179/362] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Sep 20 22:10:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:33.731829 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b7f7f3-03ff-48f3-8ba5-8806ef9a6449 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:33.810449 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8475c855-25f7-4d2c-b13b-c4032fcf2aec None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:33.857613 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc31042-e307-4df6-960f-2a6b23555724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:33.858933 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc31042-e307-4df6-960f-2a6b23555724 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:33.859321 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc31042-e307-4df6-960f-2a6b23555724 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:33.859667 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc31042-e307-4df6-960f-2a6b23555724 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:33.873623 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b7f7f3-03ff-48f3-8ba5-8806ef9a6449 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:33.874613 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc31042-e307-4df6-960f-2a6b23555724 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 22:10:33.883302 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-bbc31042-e307-4df6-960f-2a6b23555724 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 20 22:10:33.883302 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:10:33.883302 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:10:33.883302 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:10:33.883302 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:10:33.883302 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:10:33.883302 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:10:33.883302 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:10:33.883302 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:10:33.883302 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:10:33.883302 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:10:33.883302 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:10:33.883302 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 22:10:33.883302 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 22:10:33.883302 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 22:10:33.883302 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 22:10:33.884234 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 22:10:33.884234 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 22:10:33.884234 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 22:10:33.884234 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 22:10:33.884234 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:10:33.884234 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:10:33.884234 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:10:33.884234 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:10:33.884234 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:10:33.884234 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:10:33.884234 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:10:33.884234 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:10:33.884234 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:10:33.884234 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:10:33.884234 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:10:33.884234 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:10:33.885035 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:10:33.885035 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:10:33.885035 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:10:33.885035 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:10:33.885035 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 22:10:33.885035 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 22:10:33.885035 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 22:10:33.885035 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 22:10:33.885035 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 22:10:33.885035 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 22:10:33.885035 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 20 22:10:33.885035 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:10:33.885035 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 184/363] 10.222.0.33 () {56 vars in 1114 bytes} [Tue Sep 20 22:10:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 20 22:10:33.885688 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865fffa3-0934-4397-9177-0b42fec2a0bd None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:33.886242 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865fffa3-0934-4397-9177-0b42fec2a0bd None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:33.886242 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865fffa3-0934-4397-9177-0b42fec2a0bd None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:33.888466 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 185/364] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:10:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:10:33.890293 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865fffa3-0934-4397-9177-0b42fec2a0bd None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:33.923327 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f245680-0929-43d6-8c2a-bd933de1f103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:33.924663 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f245680-0929-43d6-8c2a-bd933de1f103 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:33.925365 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f245680-0929-43d6-8c2a-bd933de1f103 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:33.926036 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f245680-0929-43d6-8c2a-bd933de1f103 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:33.928220 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:33.981713 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:34.009612 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f245680-0929-43d6-8c2a-bd933de1f103 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:34.011227 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f245680-0929-43d6-8c2a-bd933de1f103 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:34.038741 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865fffa3-0934-4397-9177-0b42fec2a0bd None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:34.082119 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3d7195-65ce-4fe4-8e17-e64aeae43223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:34.082996 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3d7195-65ce-4fe4-8e17-e64aeae43223 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:34.083419 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3d7195-65ce-4fe4-8e17-e64aeae43223 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:34.083859 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3d7195-65ce-4fe4-8e17-e64aeae43223 None admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:34.085541 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3d7195-65ce-4fe4-8e17-e64aeae43223 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:10:34.086644 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3d7195-65ce-4fe4-8e17-e64aeae43223 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:34.088453 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3d7195-65ce-4fe4-8e17-e64aeae43223 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:34.098058 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 186/365] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Sep 20 22:10:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 22:10:34.099665 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b653cc7-c34d-4c30-b39c-dd5e483cbf72 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:34.100139 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b653cc7-c34d-4c30-b39c-dd5e483cbf72 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:34.100584 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b653cc7-c34d-4c30-b39c-dd5e483cbf72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:34.124785 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-9b653cc7-c34d-4c30-b39c-dd5e483cbf72 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:10:34.126036 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-9b653cc7-c34d-4c30-b39c-dd5e483cbf72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:10:34.131162 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 180/366] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 20 22:10:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 20 22:10:34.132790 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f245680-0929-43d6-8c2a-bd933de1f103 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:34.218820 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 187/367] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:10:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 22:10:34.219510 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b653cc7-c34d-4c30-b39c-dd5e483cbf72 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:34.232893 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:34.271206 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:34.275134 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f245680-0929-43d6-8c2a-bd933de1f103 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:34.325558 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89012ef-0e4e-4c85-97ed-861e480c688d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:34.326909 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89012ef-0e4e-4c85-97ed-861e480c688d None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:34.327357 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89012ef-0e4e-4c85-97ed-861e480c688d None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:34.327793 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89012ef-0e4e-4c85-97ed-861e480c688d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:34.454585 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b653cc7-c34d-4c30-b39c-dd5e483cbf72 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:34.464907 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89012ef-0e4e-4c85-97ed-861e480c688d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:34.466635 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89012ef-0e4e-4c85-97ed-861e480c688d None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:34.530678 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a628359b-17a5-4056-8ece-7b595c18a74d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:34.532577 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628359b-17a5-4056-8ece-7b595c18a74d None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:34.533923 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628359b-17a5-4056-8ece-7b595c18a74d None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:34.534437 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628359b-17a5-4056-8ece-7b595c18a74d None admin] PATH_INFO: `/v3/projects/52f32cd0707b4e2c922768eddcc432e5` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:34.538020 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a628359b-17a5-4056-8ece-7b595c18a74d None admin] RBAC: Authorizing `identity:get_project(project_id=52f32cd0707b4e2c922768eddcc432e5)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:34.540631 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a628359b-17a5-4056-8ece-7b595c18a74d None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:34.546865 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 188/368] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Sep 20 22:10:34 2022] GET /identity/v3/projects/52f32cd0707b4e2c922768eddcc432e5 => generated 302 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:34.552694 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a628359b-17a5-4056-8ece-7b595c18a74d None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:34.598377 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:34.633084 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 181/369] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 20 22:10:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 20 22:10:34.634136 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89012ef-0e4e-4c85-97ed-861e480c688d None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:34.670099 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:34.688543 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a628359b-17a5-4056-8ece-7b595c18a74d None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:34.742357 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43ad6f3-e88b-4f33-b944-e54733226005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:34.743291 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ad6f3-e88b-4f33-b944-e54733226005 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:34.743720 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ad6f3-e88b-4f33-b944-e54733226005 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:34.744532 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ad6f3-e88b-4f33-b944-e54733226005 None admin] PATH_INFO: `/v3/groups/ba043fbb3fa34638a9ca48bbf3e55c92` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:34.745866 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43ad6f3-e88b-4f33-b944-e54733226005 None admin] RBAC: Authorizing `identity:get_group(group_id=ba043fbb3fa34638a9ca48bbf3e55c92)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:34.748053 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43ad6f3-e88b-4f33-b944-e54733226005 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:34.750619 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 189/370] 10.222.0.33 () {56 vars in 1180 bytes} [Tue Sep 20 22:10:34 2022] GET /identity/v3/groups/ba043fbb3fa34638a9ca48bbf3e55c92 => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:34.751614 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43ad6f3-e88b-4f33-b944-e54733226005 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:34.761027 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89012ef-0e4e-4c85-97ed-861e480c688d None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:34.800615 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928a34a5-d9cc-45b4-a164-366a728cb82b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:34.801185 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928a34a5-d9cc-45b4-a164-366a728cb82b None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:34.801469 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928a34a5-d9cc-45b4-a164-366a728cb82b None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:34.801742 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928a34a5-d9cc-45b4-a164-366a728cb82b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:34.814080 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928a34a5-d9cc-45b4-a164-366a728cb82b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 22:10:34.819114 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-928a34a5-d9cc-45b4-a164-366a728cb82b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 22:10:34.819114 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:10:34.819114 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:10:34.819114 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:10:34.819114 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:10:34.819114 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:10:34.819114 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:10:34.819114 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:10:34.819114 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:10:34.819114 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:10:34.819114 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:10:34.819114 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:10:34.819114 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 22:10:34.819114 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 22:10:34.819114 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 22:10:34.819114 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 22:10:34.820280 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 22:10:34.820280 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 22:10:34.820280 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 22:10:34.820280 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 22:10:34.820280 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:10:34.820280 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:10:34.820280 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:10:34.820280 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:10:34.820280 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:10:34.820280 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:10:34.820280 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:10:34.820280 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:10:34.820280 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:10:34.820280 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:10:34.820280 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:10:34.820280 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:10:34.824417 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:10:34.824417 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:10:34.824417 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:10:34.824417 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:10:34.824417 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 22:10:34.824417 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 22:10:34.824417 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 22:10:34.824417 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 22:10:34.824417 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 22:10:34.824417 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 22:10:34.824417 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 22:10:34.824417 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:10:34.824417 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 182/371] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Sep 20 22:10:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:10:34.824417 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928a34a5-d9cc-45b4-a164-366a728cb82b None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:34.858653 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:34.884296 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43ad6f3-e88b-4f33-b944-e54733226005 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:34.922488 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167edd58-1d93-4e19-82f2-54c04d6b95dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:34.923409 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167edd58-1d93-4e19-82f2-54c04d6b95dd None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:34.923893 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167edd58-1d93-4e19-82f2-54c04d6b95dd None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:34.924368 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167edd58-1d93-4e19-82f2-54c04d6b95dd None admin] PATH_INFO: `/v3/projects/52f32cd0707b4e2c922768eddcc432e5` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:34.925741 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167edd58-1d93-4e19-82f2-54c04d6b95dd None admin] RBAC: Authorizing `identity:get_project(project_id=52f32cd0707b4e2c922768eddcc432e5)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:34.927305 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167edd58-1d93-4e19-82f2-54c04d6b95dd None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:34.930278 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 190/372] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Sep 20 22:10:34 2022] GET /identity/v3/projects/52f32cd0707b4e2c922768eddcc432e5 => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:34.931290 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167edd58-1d93-4e19-82f2-54c04d6b95dd None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:34.937577 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928a34a5-d9cc-45b4-a164-366a728cb82b None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:34.958789 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:34.984639 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8fcf18-bba4-4788-af49-a0141129531a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:34.985997 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8fcf18-bba4-4788-af49-a0141129531a None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:34.986739 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8fcf18-bba4-4788-af49-a0141129531a None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:34.987231 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8fcf18-bba4-4788-af49-a0141129531a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:34.988421 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8fcf18-bba4-4788-af49-a0141129531a None admin] RBAC: Adding query filter params (group.id=ba043fbb3fa34638a9ca48bbf3e55c92, role.id=604444e7ad0d437dbd1f5a6e02b761f5, scope.project.id=52f32cd0707b4e2c922768eddcc432e5) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:10:34.989543 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8fcf18-bba4-4788-af49-a0141129531a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:34.992445 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8fcf18-bba4-4788-af49-a0141129531a None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:35.000501 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 183/373] 10.222.0.33 () {56 vars in 1376 bytes} [Tue Sep 20 22:10:34 2022] GET /identity/v3/role_assignments?group.id=ba043fbb3fa34638a9ca48bbf3e55c92&scope.project.id=52f32cd0707b4e2c922768eddcc432e5&role.id=604444e7ad0d437dbd1f5a6e02b761f5 => generated 260 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:35.001847 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8fcf18-bba4-4788-af49-a0141129531a None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:35.074322 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167edd58-1d93-4e19-82f2-54c04d6b95dd None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:35.147282 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd30d00-50e2-4a81-9ea5-0b32190ea8f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:35.147922 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd30d00-50e2-4a81-9ea5-0b32190ea8f0 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:35.148207 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd30d00-50e2-4a81-9ea5-0b32190ea8f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:35.148475 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd30d00-50e2-4a81-9ea5-0b32190ea8f0 None admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:35.149147 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd30d00-50e2-4a81-9ea5-0b32190ea8f0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:10:35.149450 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd30d00-50e2-4a81-9ea5-0b32190ea8f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:35.150861 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd30d00-50e2-4a81-9ea5-0b32190ea8f0 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:35.166721 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 191/374] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 20 22:10:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:35.168139 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd30d00-50e2-4a81-9ea5-0b32190ea8f0 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:35.187639 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:35.198091 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8fcf18-bba4-4788-af49-a0141129531a None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:35.271099 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51ac370-2f30-439f-a450-222ec413a07e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:35.271737 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51ac370-2f30-439f-a450-222ec413a07e None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:35.272016 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51ac370-2f30-439f-a450-222ec413a07e None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:35.272290 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51ac370-2f30-439f-a450-222ec413a07e None admin] PATH_INFO: `/v3/groups/ba043fbb3fa34638a9ca48bbf3e55c92` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:35.274023 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51ac370-2f30-439f-a450-222ec413a07e None admin] RBAC: Authorizing `identity:get_group(group_id=ba043fbb3fa34638a9ca48bbf3e55c92)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:35.275561 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51ac370-2f30-439f-a450-222ec413a07e None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:35.277193 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 184/375] 10.222.0.33 () {56 vars in 1180 bytes} [Tue Sep 20 22:10:35 2022] GET /identity/v3/groups/ba043fbb3fa34638a9ca48bbf3e55c92 => generated 226 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:35.285212 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51ac370-2f30-439f-a450-222ec413a07e None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:35.314616 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:35.333578 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd30d00-50e2-4a81-9ea5-0b32190ea8f0 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:35.370397 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00811163-1ccb-4404-9e35-68bb3daec97a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:35.371380 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00811163-1ccb-4404-9e35-68bb3daec97a None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:35.371862 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00811163-1ccb-4404-9e35-68bb3daec97a None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:35.372366 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00811163-1ccb-4404-9e35-68bb3daec97a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:35.445362 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00811163-1ccb-4404-9e35-68bb3daec97a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:35.447208 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00811163-1ccb-4404-9e35-68bb3daec97a None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:35.473939 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51ac370-2f30-439f-a450-222ec413a07e None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:35.566249 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d54a6a3-b323-46f3-895a-d9d045d8559a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:35.566249 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d54a6a3-b323-46f3-895a-d9d045d8559a None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:35.566249 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d54a6a3-b323-46f3-895a-d9d045d8559a None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:35.566249 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d54a6a3-b323-46f3-895a-d9d045d8559a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:35.566958 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d54a6a3-b323-46f3-895a-d9d045d8559a None admin] RBAC: Adding query filter params (group.id=ba043fbb3fa34638a9ca48bbf3e55c92, role.id=4e75d58a1e0e4fffa940914b1e5f46de, scope.project.id=52f32cd0707b4e2c922768eddcc432e5) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:10:35.567262 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d54a6a3-b323-46f3-895a-d9d045d8559a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:35.568697 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d54a6a3-b323-46f3-895a-d9d045d8559a None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:35.578533 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:35.584145 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 185/376] 10.222.0.33 () {56 vars in 1376 bytes} [Tue Sep 20 22:10:35 2022] GET /identity/v3/role_assignments?group.id=ba043fbb3fa34638a9ca48bbf3e55c92&scope.project.id=52f32cd0707b4e2c922768eddcc432e5&role.id=4e75d58a1e0e4fffa940914b1e5f46de => generated 260 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 22:10:35.598432 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 192/377] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 20 22:10:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 20 22:10:35.604644 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d54a6a3-b323-46f3-895a-d9d045d8559a None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:35.655672 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:35.759955 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d54a6a3-b323-46f3-895a-d9d045d8559a None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:35.806904 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd042dca-199a-46cd-9554-e17dc353cfd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:35.807545 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd042dca-199a-46cd-9554-e17dc353cfd6 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:35.807820 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd042dca-199a-46cd-9554-e17dc353cfd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:35.808088 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd042dca-199a-46cd-9554-e17dc353cfd6 None admin] PATH_INFO: `/v3/projects/b201745482554bcb8321485927bbaae5` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:35.809214 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd042dca-199a-46cd-9554-e17dc353cfd6 None admin] RBAC: Authorizing `identity:get_project(project_id=b201745482554bcb8321485927bbaae5)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:35.810688 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd042dca-199a-46cd-9554-e17dc353cfd6 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:35.812611 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 186/378] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Sep 20 22:10:35 2022] GET /identity/v3/projects/b201745482554bcb8321485927bbaae5 => generated 344 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:35.818538 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00811163-1ccb-4404-9e35-68bb3daec97a None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:35.946401 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00811163-1ccb-4404-9e35-68bb3daec97a None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:35.988043 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c2a512-3b70-431f-a17a-b9238a884b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:35.988946 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c2a512-3b70-431f-a17a-b9238a884b19 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:35.989385 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c2a512-3b70-431f-a17a-b9238a884b19 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:35.989805 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c2a512-3b70-431f-a17a-b9238a884b19 None admin] PATH_INFO: `/v3/groups/a0bb4dad3da34b69a496012a8620fbc7` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:35.999693 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c2a512-3b70-431f-a17a-b9238a884b19 None admin] RBAC: Authorizing `identity:get_group(group_id=a0bb4dad3da34b69a496012a8620fbc7)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:36.001442 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c2a512-3b70-431f-a17a-b9238a884b19 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:36.003755 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 193/379] 10.222.0.33 () {56 vars in 1180 bytes} [Tue Sep 20 22:10:35 2022] GET /identity/v3/groups/a0bb4dad3da34b69a496012a8620fbc7 => generated 229 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:36.010658 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd042dca-199a-46cd-9554-e17dc353cfd6 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:36.141957 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f015ef7c-1ef1-4847-89f3-c5e71084efca None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:36.142329 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f015ef7c-1ef1-4847-89f3-c5e71084efca None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:36.142531 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f015ef7c-1ef1-4847-89f3-c5e71084efca None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:36.144130 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 194/380] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:10:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:10:36.149517 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b094a02-2412-4944-9003-786339cb30f0 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:36.149797 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b094a02-2412-4944-9003-786339cb30f0 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:36.150069 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b094a02-2412-4944-9003-786339cb30f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:36.164210 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:36.170387 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd042dca-199a-46cd-9554-e17dc353cfd6 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:36.185088 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-6b094a02-2412-4944-9003-786339cb30f0 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:10:36.186284 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-6b094a02-2412-4944-9003-786339cb30f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:10:36.208768 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0a98b7-73fc-42f9-855f-1b8ba48b7c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:36.209314 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0a98b7-73fc-42f9-855f-1b8ba48b7c82 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:36.209599 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0a98b7-73fc-42f9-855f-1b8ba48b7c82 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:36.209941 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0a98b7-73fc-42f9-855f-1b8ba48b7c82 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:36.210740 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0a98b7-73fc-42f9-855f-1b8ba48b7c82 None admin] RBAC: Adding query filter params (group.id=a0bb4dad3da34b69a496012a8620fbc7, role.id=8a829170b29d42d6af589399e51edb0f, scope.project.id=b201745482554bcb8321485927bbaae5) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:10:36.211054 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0a98b7-73fc-42f9-855f-1b8ba48b7c82 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:36.212512 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0a98b7-73fc-42f9-855f-1b8ba48b7c82 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:36.219145 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 187/381] 10.222.0.33 () {56 vars in 1376 bytes} [Tue Sep 20 22:10:36 2022] GET /identity/v3/role_assignments?group.id=a0bb4dad3da34b69a496012a8620fbc7&scope.project.id=b201745482554bcb8321485927bbaae5&role.id=8a829170b29d42d6af589399e51edb0f => generated 260 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:36.220360 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa27294-dba7-4afb-8fbb-2be02ec750cc None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:36.220639 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa27294-dba7-4afb-8fbb-2be02ec750cc None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:36.220905 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa27294-dba7-4afb-8fbb-2be02ec750cc None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:36.222366 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 188/382] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:10:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:10:36.229152 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d99070-5a43-4d80-aeb6-cc8ebf5d2c06 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:36.229493 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d99070-5a43-4d80-aeb6-cc8ebf5d2c06 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:36.229698 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d99070-5a43-4d80-aeb6-cc8ebf5d2c06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:36.250561 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-15d99070-5a43-4d80-aeb6-cc8ebf5d2c06 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:10:36.251863 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-15d99070-5a43-4d80-aeb6-cc8ebf5d2c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:10:36.293523 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:36.344619 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 189/383] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:10:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 22:10:36.367948 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 195/384] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:10:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 20 22:10:36.688827 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d99070-5a43-4d80-aeb6-cc8ebf5d2c06 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:36.813196 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:36.824099 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d99070-5a43-4d80-aeb6-cc8ebf5d2c06 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:36.828409 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b094a02-2412-4944-9003-786339cb30f0 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:36.890975 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b25d836-8576-42d0-8076-105160a32ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:36.891623 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b25d836-8576-42d0-8076-105160a32ec5 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:36.891904 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b25d836-8576-42d0-8076-105160a32ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:36.892176 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b25d836-8576-42d0-8076-105160a32ec5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:36.917466 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b25d836-8576-42d0-8076-105160a32ec5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 22:10:36.922252 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-2b25d836-8576-42d0-8076-105160a32ec5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 20 22:10:36.922252 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:10:36.922252 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:10:36.922252 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:10:36.922252 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:10:36.922252 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:10:36.922252 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:10:36.922252 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:10:36.922252 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:10:36.922252 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:10:36.922252 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:10:36.922252 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:10:36.922252 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 22:10:36.922252 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 22:10:36.922252 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 22:10:36.922252 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 22:10:36.923160 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 22:10:36.923160 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 22:10:36.923160 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 22:10:36.923160 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 22:10:36.923160 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:10:36.923160 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:10:36.923160 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:10:36.923160 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:10:36.923160 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:10:36.923160 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:10:36.923160 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:10:36.923160 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:10:36.923160 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:10:36.923160 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:10:36.923160 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:10:36.923160 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:10:36.923941 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:10:36.923941 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:10:36.923941 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:10:36.923941 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:10:36.923941 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 22:10:36.923941 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 22:10:36.923941 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 22:10:36.923941 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 22:10:36.923941 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 22:10:36.923941 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 22:10:36.923941 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 20 22:10:36.923941 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:10:36.931139 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 190/385] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 20 22:10:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:10:36.955608 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b25d836-8576-42d0-8076-105160a32ec5 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:36.973982 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b094a02-2412-4944-9003-786339cb30f0 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:37.020759 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4c3c7e-c95e-4672-a22f-0a9f079d3d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:37.021410 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c3c7e-c95e-4672-a22f-0a9f079d3d4a None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:37.021684 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c3c7e-c95e-4672-a22f-0a9f079d3d4a None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:37.021952 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c3c7e-c95e-4672-a22f-0a9f079d3d4a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:37.048645 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4c3c7e-c95e-4672-a22f-0a9f079d3d4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 22:10:37.055599 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-ba4c3c7e-c95e-4672-a22f-0a9f079d3d4a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 20 22:10:37.055599 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:10:37.055599 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:10:37.055599 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:10:37.055599 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:10:37.055599 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:10:37.055599 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:10:37.055599 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:10:37.055599 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:10:37.055599 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:10:37.055599 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:10:37.055599 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:10:37.055599 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 22:10:37.055599 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 22:10:37.055599 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 22:10:37.055599 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 22:10:37.057614 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 22:10:37.057614 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 22:10:37.057614 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 22:10:37.057614 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 22:10:37.057614 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:10:37.057614 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:10:37.057614 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:10:37.057614 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:10:37.057614 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:10:37.057614 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:10:37.057614 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:10:37.057614 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:10:37.057614 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:10:37.057614 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:10:37.057614 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:10:37.057614 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:10:37.059582 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:10:37.059582 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:10:37.059582 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:10:37.059582 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:10:37.059582 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 22:10:37.059582 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 22:10:37.059582 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 22:10:37.059582 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 22:10:37.059582 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 22:10:37.059582 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 22:10:37.059582 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 20 22:10:37.059582 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:10:37.059582 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 196/386] 10.222.0.33 () {56 vars in 1114 bytes} [Tue Sep 20 22:10:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 20 22:10:37.067667 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4c3c7e-c95e-4672-a22f-0a9f079d3d4a None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:37.138878 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:37.175700 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b25d836-8576-42d0-8076-105160a32ec5 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:37.216163 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4c3c7e-c95e-4672-a22f-0a9f079d3d4a None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:37.256660 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851232b4-9f02-4982-ae38-9eafce3e8e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:37.258239 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851232b4-9f02-4982-ae38-9eafce3e8e49 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:37.259205 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851232b4-9f02-4982-ae38-9eafce3e8e49 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:37.259998 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851232b4-9f02-4982-ae38-9eafce3e8e49 None admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:37.261296 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851232b4-9f02-4982-ae38-9eafce3e8e49 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:10:37.262218 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851232b4-9f02-4982-ae38-9eafce3e8e49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:37.264574 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851232b4-9f02-4982-ae38-9eafce3e8e49 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:37.267053 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adac75a-6be0-4fa3-b846-0f9e98c565d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:37.267873 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adac75a-6be0-4fa3-b846-0f9e98c565d8 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:37.268327 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adac75a-6be0-4fa3-b846-0f9e98c565d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:37.268763 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adac75a-6be0-4fa3-b846-0f9e98c565d8 None admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:37.269901 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adac75a-6be0-4fa3-b846-0f9e98c565d8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:10:37.271153 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adac75a-6be0-4fa3-b846-0f9e98c565d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:37.276502 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adac75a-6be0-4fa3-b846-0f9e98c565d8 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:37.286226 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 197/387] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Sep 20 22:10:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 22:10:37.290254 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 191/388] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Sep 20 22:10:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 22:10:37.293425 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851232b4-9f02-4982-ae38-9eafce3e8e49 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:37.305654 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adac75a-6be0-4fa3-b846-0f9e98c565d8 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:37.336729 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:37.436469 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851232b4-9f02-4982-ae38-9eafce3e8e49 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:37.438020 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:37.466934 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adac75a-6be0-4fa3-b846-0f9e98c565d8 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:37.475749 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4fa4b2-7d0c-4260-a79c-a18ba1327b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:37.476400 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4fa4b2-7d0c-4260-a79c-a18ba1327b10 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:37.476681 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4fa4b2-7d0c-4260-a79c-a18ba1327b10 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:37.476958 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4fa4b2-7d0c-4260-a79c-a18ba1327b10 None admin] PATH_INFO: `/v3/groups/ba043fbb3fa34638a9ca48bbf3e55c92` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:37.478101 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4fa4b2-7d0c-4260-a79c-a18ba1327b10 None admin] RBAC: Authorizing `identity:get_group(group_id=ba043fbb3fa34638a9ca48bbf3e55c92)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:37.479639 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4fa4b2-7d0c-4260-a79c-a18ba1327b10 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:37.481550 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 198/389] 10.222.0.33 () {56 vars in 1180 bytes} [Tue Sep 20 22:10:37 2022] GET /identity/v3/groups/ba043fbb3fa34638a9ca48bbf3e55c92 => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:37.486954 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4fa4b2-7d0c-4260-a79c-a18ba1327b10 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:37.526417 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62391430-14e0-4d29-8c1b-fdc15aec8cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:37.527082 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62391430-14e0-4d29-8c1b-fdc15aec8cb2 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:37.527360 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62391430-14e0-4d29-8c1b-fdc15aec8cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:37.527690 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62391430-14e0-4d29-8c1b-fdc15aec8cb2 None admin] PATH_INFO: `/v3/groups/ba043fbb3fa34638a9ca48bbf3e55c92` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:37.530608 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62391430-14e0-4d29-8c1b-fdc15aec8cb2 None admin] RBAC: Authorizing `identity:get_group(group_id=ba043fbb3fa34638a9ca48bbf3e55c92)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:37.532155 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62391430-14e0-4d29-8c1b-fdc15aec8cb2 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:37.534181 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 192/390] 10.222.0.33 () {56 vars in 1180 bytes} [Tue Sep 20 22:10:37 2022] GET /identity/v3/groups/ba043fbb3fa34638a9ca48bbf3e55c92 => generated 226 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 22:10:37.540382 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62391430-14e0-4d29-8c1b-fdc15aec8cb2 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:37.593806 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4fa4b2-7d0c-4260-a79c-a18ba1327b10 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:37.628960 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28e526b-d7ce-4062-b640-5fe457c12fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:37.629598 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28e526b-d7ce-4062-b640-5fe457c12fc3 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:37.629878 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28e526b-d7ce-4062-b640-5fe457c12fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:37.630152 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28e526b-d7ce-4062-b640-5fe457c12fc3 None admin] PATH_INFO: `/v3/projects/be4987daebfd4f378eb4bc9efc68e66c` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:37.631346 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28e526b-d7ce-4062-b640-5fe457c12fc3 None admin] RBAC: Authorizing `identity:get_project(project_id=be4987daebfd4f378eb4bc9efc68e66c)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:37.632870 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28e526b-d7ce-4062-b640-5fe457c12fc3 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:37.634525 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 199/391] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Sep 20 22:10:37 2022] GET /identity/v3/projects/be4987daebfd4f378eb4bc9efc68e66c => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 22:10:37.640141 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28e526b-d7ce-4062-b640-5fe457c12fc3 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:37.678005 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:37.682286 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:37.705186 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62391430-14e0-4d29-8c1b-fdc15aec8cb2 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:37.744743 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28e526b-d7ce-4062-b640-5fe457c12fc3 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:37.755701 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01306f5c-6594-4053-8052-55b3a908782a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:37.756345 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01306f5c-6594-4053-8052-55b3a908782a None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:37.757236 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01306f5c-6594-4053-8052-55b3a908782a None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:37.757437 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01306f5c-6594-4053-8052-55b3a908782a None admin] PATH_INFO: `/v3/projects/be4987daebfd4f378eb4bc9efc68e66c` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:37.762379 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01306f5c-6594-4053-8052-55b3a908782a None admin] RBAC: Authorizing `identity:get_project(project_id=be4987daebfd4f378eb4bc9efc68e66c)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:37.762379 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01306f5c-6594-4053-8052-55b3a908782a None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:37.762941 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 193/392] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Sep 20 22:10:37 2022] GET /identity/v3/projects/be4987daebfd4f378eb4bc9efc68e66c => generated 298 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 22:10:37.768072 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01306f5c-6594-4053-8052-55b3a908782a None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:37.780294 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fc6b05-32cf-43f1-8b49-6a0566d208a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:37.780966 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fc6b05-32cf-43f1-8b49-6a0566d208a9 None admin] REQUEST_METHOD: `PUT` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:37.781245 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fc6b05-32cf-43f1-8b49-6a0566d208a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:37.781516 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fc6b05-32cf-43f1-8b49-6a0566d208a9 None admin] PATH_INFO: `/v3/projects/be4987daebfd4f378eb4bc9efc68e66c/groups/ba043fbb3fa34638a9ca48bbf3e55c92/roles/4e75d58a1e0e4fffa940914b1e5f46de` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:37.783885 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fc6b05-32cf-43f1-8b49-6a0566d208a9 None admin] RBAC: Authorizing `identity:create_grant(project_id=be4987daebfd4f378eb4bc9efc68e66c, group_id=ba043fbb3fa34638a9ca48bbf3e55c92, role_id=4e75d58a1e0e4fffa940914b1e5f46de)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:37.785394 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fc6b05-32cf-43f1-8b49-6a0566d208a9 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:37.809395 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 200/393] 10.222.0.33 () {58 vars in 1442 bytes} [Tue Sep 20 22:10:37 2022] PUT /identity/v3/projects/be4987daebfd4f378eb4bc9efc68e66c/groups/ba043fbb3fa34638a9ca48bbf3e55c92/roles/4e75d58a1e0e4fffa940914b1e5f46de => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 22:10:37.907298 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01306f5c-6594-4053-8052-55b3a908782a None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:37.952388 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452cded4-c7b1-4edf-a025-4d2fb006d43b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:37.953082 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452cded4-c7b1-4edf-a025-4d2fb006d43b None admin] REQUEST_METHOD: `PUT` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:37.953363 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452cded4-c7b1-4edf-a025-4d2fb006d43b None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:37.953637 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452cded4-c7b1-4edf-a025-4d2fb006d43b None admin] PATH_INFO: `/v3/projects/be4987daebfd4f378eb4bc9efc68e66c/groups/ba043fbb3fa34638a9ca48bbf3e55c92/roles/604444e7ad0d437dbd1f5a6e02b761f5` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:37.955692 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452cded4-c7b1-4edf-a025-4d2fb006d43b None admin] RBAC: Authorizing `identity:create_grant(project_id=be4987daebfd4f378eb4bc9efc68e66c, group_id=ba043fbb3fa34638a9ca48bbf3e55c92, role_id=604444e7ad0d437dbd1f5a6e02b761f5)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:37.957149 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452cded4-c7b1-4edf-a025-4d2fb006d43b None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:37.985410 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 194/394] 10.222.0.33 () {58 vars in 1442 bytes} [Tue Sep 20 22:10:37 2022] PUT /identity/v3/projects/be4987daebfd4f378eb4bc9efc68e66c/groups/ba043fbb3fa34638a9ca48bbf3e55c92/roles/604444e7ad0d437dbd1f5a6e02b761f5 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 22:10:38.139629 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905d3d2b-7f06-413f-ad2a-04e19d75514f None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:38.140133 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905d3d2b-7f06-413f-ad2a-04e19d75514f None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:38.140206 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905d3d2b-7f06-413f-ad2a-04e19d75514f None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:38.141734 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 201/395] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:10:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:10:38.148168 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a70f15-5e4c-4d5d-97dc-81d5dfdd3fad None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:38.148492 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a70f15-5e4c-4d5d-97dc-81d5dfdd3fad None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:38.148722 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a70f15-5e4c-4d5d-97dc-81d5dfdd3fad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:38.176241 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-e6a70f15-5e4c-4d5d-97dc-81d5dfdd3fad None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:10:38.177474 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-e6a70f15-5e4c-4d5d-97dc-81d5dfdd3fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:10:38.180322 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:38.263723 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 195/396] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:10:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 22:10:38.495401 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bbedb1-2b91-4cf2-acce-fa2799590c53 None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:38.495747 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bbedb1-2b91-4cf2-acce-fa2799590c53 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:38.495861 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bbedb1-2b91-4cf2-acce-fa2799590c53 None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:38.497477 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 202/397] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:10:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:10:38.505482 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bac620-31d8-4035-8b03-c385308dffca None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:38.505775 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bac620-31d8-4035-8b03-c385308dffca None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:38.506055 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bac620-31d8-4035-8b03-c385308dffca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:38.531749 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-d5bac620-31d8-4035-8b03-c385308dffca None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:10:38.532951 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-d5bac620-31d8-4035-8b03-c385308dffca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:10:38.565222 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bbedb1-2b91-4cf2-acce-fa2799590c53 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:38.650072 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 196/398] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:10:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 22:10:38.707149 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:38.712224 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bbedb1-2b91-4cf2-acce-fa2799590c53 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:38.760011 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1231c3-83c1-4b76-80b2-e0f153598499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:38.760573 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1231c3-83c1-4b76-80b2-e0f153598499 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:38.760856 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1231c3-83c1-4b76-80b2-e0f153598499 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:38.761134 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1231c3-83c1-4b76-80b2-e0f153598499 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:38.778853 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1231c3-83c1-4b76-80b2-e0f153598499 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 22:10:38.783728 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-2f1231c3-83c1-4b76-80b2-e0f153598499 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 20 22:10:38.783728 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:10:38.783728 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:10:38.783728 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:10:38.783728 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:10:38.783728 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:10:38.783728 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:10:38.783728 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:10:38.783728 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:10:38.783728 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:10:38.783728 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:10:38.783728 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:10:38.783728 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 22:10:38.783728 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 22:10:38.783728 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 22:10:38.783728 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 22:10:38.784592 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 22:10:38.784592 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 22:10:38.784592 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 22:10:38.784592 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 22:10:38.784592 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:10:38.784592 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:10:38.784592 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:10:38.784592 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:10:38.784592 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:10:38.784592 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:10:38.784592 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:10:38.784592 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:10:38.784592 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:10:38.784592 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:10:38.784592 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:10:38.784592 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:10:38.785362 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:10:38.785362 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:10:38.785362 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:10:38.785362 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:10:38.785362 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 22:10:38.785362 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 22:10:38.785362 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 22:10:38.785362 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 22:10:38.785362 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 22:10:38.785362 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 22:10:38.785362 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 20 22:10:38.785362 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:10:38.785362 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 203/399] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 20 22:10:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:10:38.791823 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bac620-31d8-4035-8b03-c385308dffca None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:38.874907 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:38.917393 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bac620-31d8-4035-8b03-c385308dffca None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:38.965974 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aa312d-4c07-45c5-9407-73f316e51010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:38.966635 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aa312d-4c07-45c5-9407-73f316e51010 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:38.966918 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aa312d-4c07-45c5-9407-73f316e51010 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:38.967179 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aa312d-4c07-45c5-9407-73f316e51010 None admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:38.967863 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aa312d-4c07-45c5-9407-73f316e51010 None admin] RBAC: Adding query filter params (name=member) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:10:38.968161 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aa312d-4c07-45c5-9407-73f316e51010 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:38.969575 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aa312d-4c07-45c5-9407-73f316e51010 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:38.981605 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1231c3-83c1-4b76-80b2-e0f153598499 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:38.983001 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 197/400] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Sep 20 22:10:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:38.989300 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aa312d-4c07-45c5-9407-73f316e51010 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:39.129154 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1231c3-83c1-4b76-80b2-e0f153598499 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:39.157860 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aa312d-4c07-45c5-9407-73f316e51010 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:39.175522 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79af8e6-8daa-42a5-8121-d61342213601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:39.176774 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79af8e6-8daa-42a5-8121-d61342213601 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:39.177052 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79af8e6-8daa-42a5-8121-d61342213601 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:39.177322 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79af8e6-8daa-42a5-8121-d61342213601 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:39.189952 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79af8e6-8daa-42a5-8121-d61342213601 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 22:10:39.193489 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:39.198022 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-f79af8e6-8daa-42a5-8121-d61342213601 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 20 22:10:39.198022 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:10:39.198022 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:10:39.198022 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:10:39.198022 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:10:39.198022 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:10:39.198022 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:10:39.198022 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:10:39.198022 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:10:39.198022 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:10:39.198022 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:10:39.198022 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:10:39.198022 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 22:10:39.198022 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 22:10:39.198022 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 22:10:39.198022 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 22:10:39.199168 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 22:10:39.199168 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 22:10:39.199168 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 22:10:39.199168 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 22:10:39.199168 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:10:39.199168 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:10:39.199168 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:10:39.199168 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:10:39.199168 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:10:39.199168 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:10:39.199168 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:10:39.199168 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:10:39.199168 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:10:39.199168 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:10:39.199168 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:10:39.199168 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:10:39.199941 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:10:39.199941 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:10:39.199941 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:10:39.199941 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:10:39.199941 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 22:10:39.199941 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 22:10:39.199941 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 22:10:39.199941 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 22:10:39.199941 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 22:10:39.199941 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 22:10:39.199941 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 20 22:10:39.199941 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:10:39.201960 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b877bc-be7b-46d2-b3e9-3b0bed56df0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:39.202615 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 204/401] 10.222.0.33 () {56 vars in 1114 bytes} [Tue Sep 20 22:10:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 20 22:10:39.203000 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b877bc-be7b-46d2-b3e9-3b0bed56df0f None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:39.203384 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b877bc-be7b-46d2-b3e9-3b0bed56df0f None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:39.203723 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b877bc-be7b-46d2-b3e9-3b0bed56df0f None admin] PATH_INFO: `/v3/groups/ba043fbb3fa34638a9ca48bbf3e55c92` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:39.204650 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca7f26a-52d3-4cc8-a2d4-3c7d751f9c9e None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:39.204991 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b877bc-be7b-46d2-b3e9-3b0bed56df0f None admin] RBAC: Authorizing `identity:get_group(group_id=ba043fbb3fa34638a9ca48bbf3e55c92)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:39.205306 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca7f26a-52d3-4cc8-a2d4-3c7d751f9c9e None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:39.205748 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca7f26a-52d3-4cc8-a2d4-3c7d751f9c9e None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:39.210551 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b877bc-be7b-46d2-b3e9-3b0bed56df0f None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:39.210551 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 198/402] 10.222.0.33 () {56 vars in 1180 bytes} [Tue Sep 20 22:10:38 2022] GET /identity/v3/groups/ba043fbb3fa34638a9ca48bbf3e55c92 => generated 226 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:39.211655 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 205/403] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:10:39 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:10:39.214210 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b877bc-be7b-46d2-b3e9-3b0bed56df0f None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:39.214456 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca7f26a-52d3-4cc8-a2d4-3c7d751f9c9e None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:39.238343 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:39.351604 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca7f26a-52d3-4cc8-a2d4-3c7d751f9c9e None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:39.365546 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b877bc-be7b-46d2-b3e9-3b0bed56df0f None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:39.402653 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad39c97a-7363-40f7-bddc-57e999107c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:39.403756 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad39c97a-7363-40f7-bddc-57e999107c86 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:39.404225 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad39c97a-7363-40f7-bddc-57e999107c86 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:39.404686 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad39c97a-7363-40f7-bddc-57e999107c86 None admin] PATH_INFO: `/v3/projects/52f32cd0707b4e2c922768eddcc432e5` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:39.406111 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad39c97a-7363-40f7-bddc-57e999107c86 None admin] RBAC: Authorizing `identity:get_project(project_id=52f32cd0707b4e2c922768eddcc432e5)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:39.407887 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2f4b54-05e2-4e2a-a4b9-506b0a4b63e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:39.408307 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad39c97a-7363-40f7-bddc-57e999107c86 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:39.408508 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2f4b54-05e2-4e2a-a4b9-506b0a4b63e0 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:39.408791 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2f4b54-05e2-4e2a-a4b9-506b0a4b63e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:39.409067 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2f4b54-05e2-4e2a-a4b9-506b0a4b63e0 None admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:39.409741 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2f4b54-05e2-4e2a-a4b9-506b0a4b63e0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:10:39.410047 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2f4b54-05e2-4e2a-a4b9-506b0a4b63e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:39.411222 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 206/404] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Sep 20 22:10:39 2022] GET /identity/v3/projects/52f32cd0707b4e2c922768eddcc432e5 => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 22:10:39.411440 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2f4b54-05e2-4e2a-a4b9-506b0a4b63e0 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:39.413593 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee2e208-a5c0-44c9-bb48-e506180a60c3 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:39.414607 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee2e208-a5c0-44c9-bb48-e506180a60c3 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:39.415079 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee2e208-a5c0-44c9-bb48-e506180a60c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:39.432793 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 199/405] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Sep 20 22:10:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:39.433624 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2f4b54-05e2-4e2a-a4b9-506b0a4b63e0 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:39.440452 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-dee2e208-a5c0-44c9-bb48-e506180a60c3 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:10:39.441862 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-dee2e208-a5c0-44c9-bb48-e506180a60c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:10:39.505159 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:39.517639 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 207/406] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:10:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 22:10:39.518766 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee2e208-a5c0-44c9-bb48-e506180a60c3 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:39.536523 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:39.551040 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2f4b54-05e2-4e2a-a4b9-506b0a4b63e0 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:39.588459 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bb8fdb-bb1f-4c13-9978-58d281bd4d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:39.589142 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bb8fdb-bb1f-4c13-9978-58d281bd4d76 None admin] REQUEST_METHOD: `PUT` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:39.589573 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bb8fdb-bb1f-4c13-9978-58d281bd4d76 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:39.589677 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bb8fdb-bb1f-4c13-9978-58d281bd4d76 None admin] PATH_INFO: `/v3/projects/52f32cd0707b4e2c922768eddcc432e5/groups/ba043fbb3fa34638a9ca48bbf3e55c92/roles/604444e7ad0d437dbd1f5a6e02b761f5` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:39.592353 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bb8fdb-bb1f-4c13-9978-58d281bd4d76 None admin] RBAC: Authorizing `identity:create_grant(project_id=52f32cd0707b4e2c922768eddcc432e5, group_id=ba043fbb3fa34638a9ca48bbf3e55c92, role_id=604444e7ad0d437dbd1f5a6e02b761f5)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:39.593786 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bb8fdb-bb1f-4c13-9978-58d281bd4d76 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:39.612269 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 200/407] 10.222.0.33 () {58 vars in 1442 bytes} [Tue Sep 20 22:10:39 2022] PUT /identity/v3/projects/52f32cd0707b4e2c922768eddcc432e5/groups/ba043fbb3fa34638a9ca48bbf3e55c92/roles/604444e7ad0d437dbd1f5a6e02b761f5 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:10:39.631390 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee2e208-a5c0-44c9-bb48-e506180a60c3 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:39.671117 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deec655e-d8e5-49b5-89fa-2fb5819bfcc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:39.672101 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deec655e-d8e5-49b5-89fa-2fb5819bfcc5 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:39.672594 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deec655e-d8e5-49b5-89fa-2fb5819bfcc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:39.673059 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deec655e-d8e5-49b5-89fa-2fb5819bfcc5 None admin] PATH_INFO: `/v3/groups/ba043fbb3fa34638a9ca48bbf3e55c92` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:39.674531 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deec655e-d8e5-49b5-89fa-2fb5819bfcc5 None admin] RBAC: Authorizing `identity:get_group(group_id=ba043fbb3fa34638a9ca48bbf3e55c92)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:39.676247 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deec655e-d8e5-49b5-89fa-2fb5819bfcc5 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:39.678185 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 208/408] 10.222.0.33 () {56 vars in 1180 bytes} [Tue Sep 20 22:10:39 2022] GET /identity/v3/groups/ba043fbb3fa34638a9ca48bbf3e55c92 => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:39.685173 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bb8fdb-bb1f-4c13-9978-58d281bd4d76 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:39.846420 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bb8fdb-bb1f-4c13-9978-58d281bd4d76 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:39.877878 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:39.881029 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deec655e-d8e5-49b5-89fa-2fb5819bfcc5 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:39.899016 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f24392-11df-410c-99ed-ff0b76f985ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:39.899328 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f24392-11df-410c-99ed-ff0b76f985ae None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:39.899587 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f24392-11df-410c-99ed-ff0b76f985ae None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:39.899859 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f24392-11df-410c-99ed-ff0b76f985ae None admin] PATH_INFO: `/v3/projects/52f32cd0707b4e2c922768eddcc432e5` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:39.903552 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f24392-11df-410c-99ed-ff0b76f985ae None admin] RBAC: Authorizing `identity:get_project(project_id=52f32cd0707b4e2c922768eddcc432e5)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:39.903552 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f24392-11df-410c-99ed-ff0b76f985ae None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:39.905490 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 201/409] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Sep 20 22:10:39 2022] GET /identity/v3/projects/52f32cd0707b4e2c922768eddcc432e5 => generated 302 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:39.910690 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f24392-11df-410c-99ed-ff0b76f985ae None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:39.980166 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:39.999323 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deec655e-d8e5-49b5-89fa-2fb5819bfcc5 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:40.041208 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad70d8fd-6bf6-4431-918c-c2db7b3a5582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:40.041848 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad70d8fd-6bf6-4431-918c-c2db7b3a5582 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:40.042130 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad70d8fd-6bf6-4431-918c-c2db7b3a5582 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:40.042403 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad70d8fd-6bf6-4431-918c-c2db7b3a5582 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:40.063234 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad70d8fd-6bf6-4431-918c-c2db7b3a5582 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 22:10:40.071110 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-ad70d8fd-6bf6-4431-918c-c2db7b3a5582 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 22:10:40.071110 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:10:40.071110 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:10:40.071110 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:10:40.071110 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:10:40.071110 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:10:40.071110 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:10:40.071110 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:10:40.071110 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:10:40.071110 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:10:40.071110 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:10:40.071110 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:10:40.071110 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 22:10:40.071110 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 22:10:40.071110 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 22:10:40.071110 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 22:10:40.071985 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 22:10:40.071985 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 22:10:40.071985 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 22:10:40.071985 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 22:10:40.071985 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:10:40.071985 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:10:40.071985 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:10:40.071985 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:10:40.071985 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:10:40.071985 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:10:40.071985 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:10:40.071985 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:10:40.071985 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:10:40.071985 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:10:40.071985 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:10:40.071985 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:10:40.072786 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:10:40.072786 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:10:40.072786 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:10:40.072786 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:10:40.072786 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 22:10:40.072786 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 22:10:40.072786 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 22:10:40.072786 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 22:10:40.072786 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 22:10:40.072786 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 22:10:40.072786 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 22:10:40.072786 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:10:40.075435 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 209/410] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Sep 20 22:10:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:10:40.081333 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad70d8fd-6bf6-4431-918c-c2db7b3a5582 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:40.100456 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f24392-11df-410c-99ed-ff0b76f985ae None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:40.167213 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e2b736-b5c5-4490-a9fc-fc9924964afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:40.167979 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e2b736-b5c5-4490-a9fc-fc9924964afb None admin] REQUEST_METHOD: `PUT` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:40.168160 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e2b736-b5c5-4490-a9fc-fc9924964afb None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:40.168441 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e2b736-b5c5-4490-a9fc-fc9924964afb None admin] PATH_INFO: `/v3/projects/52f32cd0707b4e2c922768eddcc432e5/groups/ba043fbb3fa34638a9ca48bbf3e55c92/roles/4e75d58a1e0e4fffa940914b1e5f46de` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:40.175807 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e2b736-b5c5-4490-a9fc-fc9924964afb None admin] RBAC: Authorizing `identity:create_grant(project_id=52f32cd0707b4e2c922768eddcc432e5, group_id=ba043fbb3fa34638a9ca48bbf3e55c92, role_id=4e75d58a1e0e4fffa940914b1e5f46de)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:40.177248 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e2b736-b5c5-4490-a9fc-fc9924964afb None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:40.188915 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad70d8fd-6bf6-4431-918c-c2db7b3a5582 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:40.215791 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 202/411] 10.222.0.33 () {58 vars in 1442 bytes} [Tue Sep 20 22:10:39 2022] PUT /identity/v3/projects/52f32cd0707b4e2c922768eddcc432e5/groups/ba043fbb3fa34638a9ca48bbf3e55c92/roles/4e75d58a1e0e4fffa940914b1e5f46de => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 22:10:40.228211 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499eb4d7-0783-4e08-9132-8aead5431bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:40.229315 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499eb4d7-0783-4e08-9132-8aead5431bae None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:40.229795 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499eb4d7-0783-4e08-9132-8aead5431bae None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:40.230320 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499eb4d7-0783-4e08-9132-8aead5431bae None admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:40.231294 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499eb4d7-0783-4e08-9132-8aead5431bae None admin] RBAC: Adding query filter params (name=admin) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:10:40.231890 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499eb4d7-0783-4e08-9132-8aead5431bae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:40.233556 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499eb4d7-0783-4e08-9132-8aead5431bae None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:40.244191 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 210/412] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 20 22:10:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:40.250263 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e2b736-b5c5-4490-a9fc-fc9924964afb None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:40.314892 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:40.377103 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e2b736-b5c5-4490-a9fc-fc9924964afb None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:40.427574 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dbbb6f-8a0a-4993-aff1-f9c47f73117f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:40.429133 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dbbb6f-8a0a-4993-aff1-f9c47f73117f None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:40.429894 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dbbb6f-8a0a-4993-aff1-f9c47f73117f None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:40.430382 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dbbb6f-8a0a-4993-aff1-f9c47f73117f None admin] PATH_INFO: `/v3/groups/a0bb4dad3da34b69a496012a8620fbc7` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:40.433700 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dbbb6f-8a0a-4993-aff1-f9c47f73117f None admin] RBAC: Authorizing `identity:get_group(group_id=a0bb4dad3da34b69a496012a8620fbc7)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:40.435607 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dbbb6f-8a0a-4993-aff1-f9c47f73117f None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:40.437665 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 203/413] 10.222.0.33 () {56 vars in 1180 bytes} [Tue Sep 20 22:10:40 2022] GET /identity/v3/groups/a0bb4dad3da34b69a496012a8620fbc7 => generated 229 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:40.443603 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499eb4d7-0783-4e08-9132-8aead5431bae None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:40.453792 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:40.570168 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499eb4d7-0783-4e08-9132-8aead5431bae None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:40.609273 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf0c547-b19e-48aa-92fc-f9c7092956f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:40.609908 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf0c547-b19e-48aa-92fc-f9c7092956f0 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:40.610184 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf0c547-b19e-48aa-92fc-f9c7092956f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:40.610455 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf0c547-b19e-48aa-92fc-f9c7092956f0 None admin] PATH_INFO: `/v3/projects/b201745482554bcb8321485927bbaae5` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:40.612207 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf0c547-b19e-48aa-92fc-f9c7092956f0 None admin] RBAC: Authorizing `identity:get_project(project_id=b201745482554bcb8321485927bbaae5)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:40.613644 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf0c547-b19e-48aa-92fc-f9c7092956f0 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:40.615289 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 211/414] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Sep 20 22:10:40 2022] GET /identity/v3/projects/b201745482554bcb8321485927bbaae5 => generated 344 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:40.621760 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dbbb6f-8a0a-4993-aff1-f9c47f73117f None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:40.770672 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dbbb6f-8a0a-4993-aff1-f9c47f73117f None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:40.789482 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:40.809987 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a762118c-f17a-4637-9cab-b0034a9facbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:40.811138 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a762118c-f17a-4637-9cab-b0034a9facbf None admin] REQUEST_METHOD: `PUT` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:40.811638 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a762118c-f17a-4637-9cab-b0034a9facbf None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:40.812122 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a762118c-f17a-4637-9cab-b0034a9facbf None admin] PATH_INFO: `/v3/projects/b201745482554bcb8321485927bbaae5/groups/a0bb4dad3da34b69a496012a8620fbc7/roles/8a829170b29d42d6af589399e51edb0f` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:40.814372 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a762118c-f17a-4637-9cab-b0034a9facbf None admin] RBAC: Authorizing `identity:create_grant(project_id=b201745482554bcb8321485927bbaae5, group_id=a0bb4dad3da34b69a496012a8620fbc7, role_id=8a829170b29d42d6af589399e51edb0f)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:40.816184 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a762118c-f17a-4637-9cab-b0034a9facbf None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:40.840968 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 204/415] 10.222.0.33 () {58 vars in 1442 bytes} [Tue Sep 20 22:10:40 2022] PUT /identity/v3/projects/b201745482554bcb8321485927bbaae5/groups/a0bb4dad3da34b69a496012a8620fbc7/roles/8a829170b29d42d6af589399e51edb0f => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:10:40.960551 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88d1688-5aa5-4fda-a33c-7c4adaec1871 None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:40.960831 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88d1688-5aa5-4fda-a33c-7c4adaec1871 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:40.961358 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88d1688-5aa5-4fda-a33c-7c4adaec1871 None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:40.963209 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 212/416] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:10:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:10:40.980534 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1adc86a-f7ea-478c-8655-97982f0dbc42 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:40.981069 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1adc86a-f7ea-478c-8655-97982f0dbc42 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:40.981507 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1adc86a-f7ea-478c-8655-97982f0dbc42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:41.008447 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-c1adc86a-f7ea-478c-8655-97982f0dbc42 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:10:41.009925 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-c1adc86a-f7ea-478c-8655-97982f0dbc42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:10:41.108999 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 205/417] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:10:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 22:10:41.132718 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17454920-6219-4046-8dcc-4a77eb092344 None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:41.133000 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17454920-6219-4046-8dcc-4a77eb092344 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:41.133276 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17454920-6219-4046-8dcc-4a77eb092344 None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:41.134787 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 213/418] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:10:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:10:41.140338 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e4fc56-7a8e-4f05-9272-65b1049fab5d None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:41.140631 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e4fc56-7a8e-4f05-9272-65b1049fab5d None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:41.140908 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e4fc56-7a8e-4f05-9272-65b1049fab5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:41.160135 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-52e4fc56-7a8e-4f05-9272-65b1049fab5d None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:10:41.161331 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-52e4fc56-7a8e-4f05-9272-65b1049fab5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:10:41.234122 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 206/419] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:10:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 22:10:41.529953 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17454920-6219-4046-8dcc-4a77eb092344 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:41.625911 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e4fc56-7a8e-4f05-9272-65b1049fab5d None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:41.640850 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:41.682312 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:41.697299 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17454920-6219-4046-8dcc-4a77eb092344 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:41.764717 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81030ef2-d185-43cd-b9b0-a0883cf09d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:41.765354 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81030ef2-d185-43cd-b9b0-a0883cf09d3d None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:41.765626 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81030ef2-d185-43cd-b9b0-a0883cf09d3d None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:41.765892 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81030ef2-d185-43cd-b9b0-a0883cf09d3d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:41.791117 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81030ef2-d185-43cd-b9b0-a0883cf09d3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 22:10:41.798537 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e4fc56-7a8e-4f05-9272-65b1049fab5d None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:41.804000 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-81030ef2-d185-43cd-b9b0-a0883cf09d3d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 20 22:10:41.804000 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:10:41.804000 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:10:41.804000 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:10:41.804000 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:10:41.804000 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:10:41.804000 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:10:41.804000 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:10:41.804000 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:10:41.804000 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:10:41.804000 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:10:41.804000 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:10:41.804000 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 22:10:41.804000 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 22:10:41.804000 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 22:10:41.804000 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 22:10:41.805159 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 22:10:41.805159 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 22:10:41.805159 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 22:10:41.805159 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 22:10:41.805159 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:10:41.805159 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:10:41.805159 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:10:41.805159 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:10:41.805159 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:10:41.805159 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:10:41.805159 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:10:41.805159 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:10:41.805159 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:10:41.805159 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:10:41.805159 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:10:41.805159 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:10:41.805948 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:10:41.805948 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:10:41.805948 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:10:41.805948 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:10:41.805948 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 22:10:41.805948 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 22:10:41.805948 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 22:10:41.805948 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 22:10:41.805948 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 22:10:41.805948 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 22:10:41.805948 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 20 22:10:41.805948 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:10:41.809247 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 214/420] 10.222.0.33 () {56 vars in 1114 bytes} [Tue Sep 20 22:10:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 20 22:10:41.812897 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81030ef2-d185-43cd-b9b0-a0883cf09d3d None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:41.870472 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4d5ec1-765e-4f43-aafe-87e9ea979f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:41.871149 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4d5ec1-765e-4f43-aafe-87e9ea979f97 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:41.871423 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4d5ec1-765e-4f43-aafe-87e9ea979f97 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:41.871693 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4d5ec1-765e-4f43-aafe-87e9ea979f97 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:41.901255 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4d5ec1-765e-4f43-aafe-87e9ea979f97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 22:10:41.906191 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-bb4d5ec1-765e-4f43-aafe-87e9ea979f97 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 20 22:10:41.906191 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:10:41.906191 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:10:41.906191 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:10:41.906191 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:10:41.906191 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:10:41.906191 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:10:41.906191 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:10:41.906191 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:10:41.906191 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:10:41.906191 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:10:41.906191 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:10:41.906191 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 22:10:41.906191 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 22:10:41.906191 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 22:10:41.906191 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 22:10:41.908310 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 22:10:41.908310 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 22:10:41.908310 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 22:10:41.908310 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 22:10:41.908310 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:10:41.908310 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:10:41.908310 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:10:41.908310 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:10:41.908310 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:10:41.908310 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:10:41.908310 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:10:41.908310 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:10:41.908310 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:10:41.908310 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:10:41.908310 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:10:41.908310 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:10:41.910226 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:10:41.910226 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:10:41.910226 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:10:41.910226 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:10:41.910226 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 22:10:41.910226 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 22:10:41.910226 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 22:10:41.910226 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 22:10:41.910226 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 22:10:41.910226 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 22:10:41.910226 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 20 22:10:41.910226 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:10:41.916006 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 207/421] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 20 22:10:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 20 22:10:41.922673 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4d5ec1-765e-4f43-aafe-87e9ea979f97 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:41.958755 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81030ef2-d185-43cd-b9b0-a0883cf09d3d None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:41.999402 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953f88bf-2312-45bf-a533-8bc477ccd9b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:42.000018 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953f88bf-2312-45bf-a533-8bc477ccd9b5 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:42.000298 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953f88bf-2312-45bf-a533-8bc477ccd9b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:42.000570 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953f88bf-2312-45bf-a533-8bc477ccd9b5 None admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:42.001238 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953f88bf-2312-45bf-a533-8bc477ccd9b5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:10:42.001543 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953f88bf-2312-45bf-a533-8bc477ccd9b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:42.002953 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953f88bf-2312-45bf-a533-8bc477ccd9b5 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:42.009522 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:42.023235 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 215/422] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Sep 20 22:10:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:42.029118 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953f88bf-2312-45bf-a533-8bc477ccd9b5 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:42.145274 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953f88bf-2312-45bf-a533-8bc477ccd9b5 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:42.151859 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:42.172931 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4d5ec1-765e-4f43-aafe-87e9ea979f97 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:42.187566 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a85fab-6a2c-4c72-b578-58b328fb228e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:42.189165 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a85fab-6a2c-4c72-b578-58b328fb228e None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:42.189659 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a85fab-6a2c-4c72-b578-58b328fb228e None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:42.190098 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a85fab-6a2c-4c72-b578-58b328fb228e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:42.262868 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:42.267843 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01070be-e7da-49af-9275-54c918944271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:42.268478 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01070be-e7da-49af-9275-54c918944271 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:42.268759 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01070be-e7da-49af-9275-54c918944271 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:42.269042 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01070be-e7da-49af-9275-54c918944271 None admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:42.269774 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01070be-e7da-49af-9275-54c918944271 None admin] RBAC: Adding query filter params (name=member) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:10:42.270078 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01070be-e7da-49af-9275-54c918944271 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:42.272060 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01070be-e7da-49af-9275-54c918944271 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:42.276418 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a85fab-6a2c-4c72-b578-58b328fb228e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:42.278090 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a85fab-6a2c-4c72-b578-58b328fb228e None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:42.283075 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 208/423] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Sep 20 22:10:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:42.288836 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01070be-e7da-49af-9275-54c918944271 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:42.416491 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 216/424] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 20 22:10:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 20 22:10:42.417713 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778a5c91-2972-4a62-8d68-ec82e7445308 None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:42.418109 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778a5c91-2972-4a62-8d68-ec82e7445308 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:42.418459 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778a5c91-2972-4a62-8d68-ec82e7445308 None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:42.420358 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 217/425] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:10:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:10:42.424827 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778a5c91-2972-4a62-8d68-ec82e7445308 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:42.434084 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01070be-e7da-49af-9275-54c918944271 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:42.478210 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fccda9-ba9d-4a1e-83ab-ecb4ef199271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:42.478954 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fccda9-ba9d-4a1e-83ab-ecb4ef199271 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:42.479348 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fccda9-ba9d-4a1e-83ab-ecb4ef199271 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:42.479688 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fccda9-ba9d-4a1e-83ab-ecb4ef199271 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:42.519015 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:42.533663 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:42.543200 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778a5c91-2972-4a62-8d68-ec82e7445308 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:42.581440 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fccda9-ba9d-4a1e-83ab-ecb4ef199271 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:42.583217 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7af1f5e-d4de-4672-9a5e-96bb8bb5ebca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:42.583343 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fccda9-ba9d-4a1e-83ab-ecb4ef199271 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:42.584262 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7af1f5e-d4de-4672-9a5e-96bb8bb5ebca None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:42.585281 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7af1f5e-d4de-4672-9a5e-96bb8bb5ebca None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:42.585719 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7af1f5e-d4de-4672-9a5e-96bb8bb5ebca None admin] PATH_INFO: `/v3/projects/be4987daebfd4f378eb4bc9efc68e66c` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:42.587290 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7af1f5e-d4de-4672-9a5e-96bb8bb5ebca None admin] RBAC: Authorizing `identity:get_project(project_id=be4987daebfd4f378eb4bc9efc68e66c)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:42.588900 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7af1f5e-d4de-4672-9a5e-96bb8bb5ebca None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:42.591180 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 218/426] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Sep 20 22:10:42 2022] GET /identity/v3/projects/be4987daebfd4f378eb4bc9efc68e66c => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:42.592641 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957754b4-faa1-4b12-91f7-34ed458d4c9c None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:42.593226 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957754b4-faa1-4b12-91f7-34ed458d4c9c None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:42.593683 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957754b4-faa1-4b12-91f7-34ed458d4c9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:42.614730 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-957754b4-faa1-4b12-91f7-34ed458d4c9c None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:10:42.616571 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-957754b4-faa1-4b12-91f7-34ed458d4c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:10:42.694725 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 219/427] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:10:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 22:10:42.696031 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957754b4-faa1-4b12-91f7-34ed458d4c9c None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:42.710911 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 209/428] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 20 22:10:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 20 22:10:42.716139 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fccda9-ba9d-4a1e-83ab-ecb4ef199271 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:42.814857 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:42.879534 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:42.890199 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957754b4-faa1-4b12-91f7-34ed458d4c9c None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:42.892194 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fccda9-ba9d-4a1e-83ab-ecb4ef199271 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:42.928631 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1f5fb7-741e-4111-8475-9194ddd64caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:42.929968 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1f5fb7-741e-4111-8475-9194ddd64caa None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:42.930690 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1f5fb7-741e-4111-8475-9194ddd64caa None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:42.931206 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1f5fb7-741e-4111-8475-9194ddd64caa None admin] PATH_INFO: `/v3/groups/ba043fbb3fa34638a9ca48bbf3e55c92` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:42.932582 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1f5fb7-741e-4111-8475-9194ddd64caa None admin] RBAC: Authorizing `identity:get_group(group_id=ba043fbb3fa34638a9ca48bbf3e55c92)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:42.934287 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1f5fb7-741e-4111-8475-9194ddd64caa None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:42.935949 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e16630-32da-42eb-8446-3191ba5ef6ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:42.936739 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 220/429] 10.222.0.33 () {56 vars in 1180 bytes} [Tue Sep 20 22:10:42 2022] GET /identity/v3/groups/ba043fbb3fa34638a9ca48bbf3e55c92 => generated 226 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:42.936888 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e16630-32da-42eb-8446-3191ba5ef6ef None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:42.937245 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e16630-32da-42eb-8446-3191ba5ef6ef None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:42.937667 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e16630-32da-42eb-8446-3191ba5ef6ef None admin] PATH_INFO: `/v3/projects/be4987daebfd4f378eb4bc9efc68e66c` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:42.938752 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4cb478-2135-4bf5-bf37-ce11c2137ca3 None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:42.939073 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e16630-32da-42eb-8446-3191ba5ef6ef None admin] RBAC: Authorizing `identity:get_project(project_id=be4987daebfd4f378eb4bc9efc68e66c)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:42.939438 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4cb478-2135-4bf5-bf37-ce11c2137ca3 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:42.939910 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4cb478-2135-4bf5-bf37-ce11c2137ca3 None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:42.940689 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e16630-32da-42eb-8446-3191ba5ef6ef None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:42.941605 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 221/430] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:10:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:10:42.942603 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4cb478-2135-4bf5-bf37-ce11c2137ca3 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:42.949510 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 210/431] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Sep 20 22:10:42 2022] GET /identity/v3/projects/be4987daebfd4f378eb4bc9efc68e66c => generated 298 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 22:10:42.950893 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c5b4ba-9173-4809-841a-ab6069b3dbae None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:42.951179 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c5b4ba-9173-4809-841a-ab6069b3dbae None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:42.951454 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c5b4ba-9173-4809-841a-ab6069b3dbae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:42.978537 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-12c5b4ba-9173-4809-841a-ab6069b3dbae None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:10:42.980229 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-12c5b4ba-9173-4809-841a-ab6069b3dbae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:10:43.054810 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4cb478-2135-4bf5-bf37-ce11c2137ca3 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:43.062110 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 211/432] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:10:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 20 22:10:43.062110 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c5b4ba-9173-4809-841a-ab6069b3dbae None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:43.102923 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017cc096-577d-4145-9702-ecaeff617a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:43.103727 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017cc096-577d-4145-9702-ecaeff617a8b None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:43.104001 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017cc096-577d-4145-9702-ecaeff617a8b None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:43.104268 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017cc096-577d-4145-9702-ecaeff617a8b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:43.105050 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017cc096-577d-4145-9702-ecaeff617a8b None admin] RBAC: Adding query filter params (group.id=ba043fbb3fa34638a9ca48bbf3e55c92, role.id=4e75d58a1e0e4fffa940914b1e5f46de, scope.project.id=be4987daebfd4f378eb4bc9efc68e66c) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:10:43.105350 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017cc096-577d-4145-9702-ecaeff617a8b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:43.106865 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017cc096-577d-4145-9702-ecaeff617a8b None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:43.113311 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 222/433] 10.222.0.33 () {56 vars in 1376 bytes} [Tue Sep 20 22:10:42 2022] GET /identity/v3/role_assignments?group.id=ba043fbb3fa34638a9ca48bbf3e55c92&scope.project.id=be4987daebfd4f378eb4bc9efc68e66c&role.id=4e75d58a1e0e4fffa940914b1e5f46de => generated 611 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:43.113985 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017cc096-577d-4145-9702-ecaeff617a8b None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:43.129076 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:43.149957 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:43.237662 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017cc096-577d-4145-9702-ecaeff617a8b None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:43.240347 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c5b4ba-9173-4809-841a-ab6069b3dbae None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:43.278736 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ec3233-2b9e-44f0-9eee-bf095caa1182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:43.279384 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec3233-2b9e-44f0-9eee-bf095caa1182 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:43.279659 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec3233-2b9e-44f0-9eee-bf095caa1182 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:43.279928 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec3233-2b9e-44f0-9eee-bf095caa1182 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:43.292583 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ec3233-2b9e-44f0-9eee-bf095caa1182 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 22:10:43.299250 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-42ec3233-2b9e-44f0-9eee-bf095caa1182 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 20 22:10:43.299250 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:10:43.299250 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:10:43.299250 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:10:43.299250 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:10:43.299250 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:10:43.299250 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:10:43.299250 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:10:43.299250 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:10:43.299250 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:10:43.299250 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:10:43.299250 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:10:43.299250 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 22:10:43.299250 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 22:10:43.299250 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 22:10:43.299250 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 22:10:43.300140 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 22:10:43.300140 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 22:10:43.300140 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 22:10:43.300140 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 22:10:43.300140 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:10:43.300140 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:10:43.300140 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:10:43.300140 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:10:43.300140 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:10:43.300140 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:10:43.300140 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:10:43.300140 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:10:43.300140 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:10:43.300140 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:10:43.300140 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:10:43.300140 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:10:43.300956 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:10:43.300956 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:10:43.300956 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:10:43.300956 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:10:43.300956 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 22:10:43.300956 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 22:10:43.300956 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 22:10:43.300956 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 22:10:43.300956 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 22:10:43.300956 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 22:10:43.300956 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 20 22:10:43.300956 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:10:43.300956 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 223/434] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 20 22:10:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:10:43.311234 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ec3233-2b9e-44f0-9eee-bf095caa1182 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:43.316083 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90905001-d998-4c3f-a6a5-fb7bf756a968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:43.316736 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90905001-d998-4c3f-a6a5-fb7bf756a968 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:43.317020 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90905001-d998-4c3f-a6a5-fb7bf756a968 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:43.317298 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90905001-d998-4c3f-a6a5-fb7bf756a968 None admin] PATH_INFO: `/v3/groups/ba043fbb3fa34638a9ca48bbf3e55c92` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:43.318428 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90905001-d998-4c3f-a6a5-fb7bf756a968 None admin] RBAC: Authorizing `identity:get_group(group_id=ba043fbb3fa34638a9ca48bbf3e55c92)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:43.320667 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90905001-d998-4c3f-a6a5-fb7bf756a968 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:43.322722 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 212/435] 10.222.0.33 () {56 vars in 1180 bytes} [Tue Sep 20 22:10:43 2022] GET /identity/v3/groups/ba043fbb3fa34638a9ca48bbf3e55c92 => generated 226 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:43.328450 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90905001-d998-4c3f-a6a5-fb7bf756a968 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:43.430099 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:43.448910 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ec3233-2b9e-44f0-9eee-bf095caa1182 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:43.454245 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90905001-d998-4c3f-a6a5-fb7bf756a968 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:43.478446 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:43.487594 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805ece21-da40-4a24-970c-ba50158e2178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:43.488361 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805ece21-da40-4a24-970c-ba50158e2178 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:43.488685 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805ece21-da40-4a24-970c-ba50158e2178 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:43.489055 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805ece21-da40-4a24-970c-ba50158e2178 None admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:43.489915 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805ece21-da40-4a24-970c-ba50158e2178 None admin] RBAC: Adding query filter params (name=member) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:10:43.490314 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805ece21-da40-4a24-970c-ba50158e2178 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:43.491792 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4039b712-953a-4668-b7ee-ce8cd09446c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:43.492353 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805ece21-da40-4a24-970c-ba50158e2178 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:43.492448 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4039b712-953a-4668-b7ee-ce8cd09446c8 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:43.492659 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4039b712-953a-4668-b7ee-ce8cd09446c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:43.492926 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4039b712-953a-4668-b7ee-ce8cd09446c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:43.493813 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4039b712-953a-4668-b7ee-ce8cd09446c8 None admin] RBAC: Adding query filter params (group.id=ba043fbb3fa34638a9ca48bbf3e55c92, role.id=604444e7ad0d437dbd1f5a6e02b761f5, scope.project.id=be4987daebfd4f378eb4bc9efc68e66c) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:10:43.494119 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4039b712-953a-4668-b7ee-ce8cd09446c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:43.495889 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4039b712-953a-4668-b7ee-ce8cd09446c8 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:43.505030 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 224/436] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Sep 20 22:10:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 22:10:43.505030 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805ece21-da40-4a24-970c-ba50158e2178 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:43.508049 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 213/437] 10.222.0.33 () {56 vars in 1376 bytes} [Tue Sep 20 22:10:43 2022] GET /identity/v3/role_assignments?group.id=ba043fbb3fa34638a9ca48bbf3e55c92&scope.project.id=be4987daebfd4f378eb4bc9efc68e66c&role.id=604444e7ad0d437dbd1f5a6e02b761f5 => generated 611 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:43.510685 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4039b712-953a-4668-b7ee-ce8cd09446c8 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:43.616001 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805ece21-da40-4a24-970c-ba50158e2178 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:43.627497 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4039b712-953a-4668-b7ee-ce8cd09446c8 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:43.654219 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a418c428-8715-47f8-b649-0c7e973245f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:43.654901 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a418c428-8715-47f8-b649-0c7e973245f6 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:43.655178 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a418c428-8715-47f8-b649-0c7e973245f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:43.655457 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a418c428-8715-47f8-b649-0c7e973245f6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:43.664322 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09328a74-594c-4ef8-9dd9-813b4c839e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:43.664955 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09328a74-594c-4ef8-9dd9-813b4c839e33 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:43.665234 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09328a74-594c-4ef8-9dd9-813b4c839e33 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:43.665505 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09328a74-594c-4ef8-9dd9-813b4c839e33 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:43.667484 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a418c428-8715-47f8-b649-0c7e973245f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 22:10:43.672926 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-a418c428-8715-47f8-b649-0c7e973245f6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 20 22:10:43.672926 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:10:43.672926 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:10:43.672926 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:10:43.672926 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:10:43.672926 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:10:43.672926 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:10:43.672926 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:10:43.672926 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:10:43.672926 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:10:43.672926 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:10:43.672926 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:10:43.672926 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 22:10:43.672926 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 22:10:43.672926 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 22:10:43.672926 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 22:10:43.673862 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 22:10:43.673862 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 22:10:43.673862 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 22:10:43.673862 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 22:10:43.673862 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:10:43.673862 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:10:43.673862 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:10:43.673862 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:10:43.673862 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:10:43.673862 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:10:43.673862 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:10:43.673862 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:10:43.673862 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:10:43.673862 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:10:43.673862 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:10:43.673862 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:10:43.674668 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:10:43.674668 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:10:43.674668 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:10:43.674668 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:10:43.674668 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 22:10:43.674668 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 22:10:43.674668 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 22:10:43.674668 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 22:10:43.674668 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 22:10:43.674668 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 22:10:43.674668 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 20 22:10:43.674668 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:10:43.674668 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 225/438] 10.222.0.33 () {56 vars in 1114 bytes} [Tue Sep 20 22:10:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:10:43.675324 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b32a09b-e528-487f-8d1e-1ec3540238ec None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:43.676064 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b32a09b-e528-487f-8d1e-1ec3540238ec None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:43.676064 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b32a09b-e528-487f-8d1e-1ec3540238ec None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:43.678559 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 226/439] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:10:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:10:43.681812 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b32a09b-e528-487f-8d1e-1ec3540238ec None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:43.695829 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:43.735573 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:43.751139 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09328a74-594c-4ef8-9dd9-813b4c839e33 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:43.752544 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09328a74-594c-4ef8-9dd9-813b4c839e33 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:43.809905 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b32a09b-e528-487f-8d1e-1ec3540238ec None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:43.850811 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b36ea2-6593-43ab-8668-124b422b722b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:43.851426 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b36ea2-6593-43ab-8668-124b422b722b None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:43.851712 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b36ea2-6593-43ab-8668-124b422b722b None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:43.851989 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b36ea2-6593-43ab-8668-124b422b722b None admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:43.852647 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b36ea2-6593-43ab-8668-124b422b722b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:10:43.852953 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b36ea2-6593-43ab-8668-124b422b722b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:43.854331 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b36ea2-6593-43ab-8668-124b422b722b None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:43.864774 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 227/440] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Sep 20 22:10:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:43.866013 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5400fe68-afd4-4f5f-bea9-95cb852214e0 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:43.866297 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5400fe68-afd4-4f5f-bea9-95cb852214e0 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:43.866603 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5400fe68-afd4-4f5f-bea9-95cb852214e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:43.876138 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 214/441] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 20 22:10:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 20 22:10:43.877177 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09328a74-594c-4ef8-9dd9-813b4c839e33 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:43.886176 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-5400fe68-afd4-4f5f-bea9-95cb852214e0 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:10:43.887426 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-5400fe68-afd4-4f5f-bea9-95cb852214e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:10:43.963096 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:43.967949 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 228/442] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:10:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 22:10:43.976783 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5400fe68-afd4-4f5f-bea9-95cb852214e0 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:43.978871 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:44.000506 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09328a74-594c-4ef8-9dd9-813b4c839e33 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:44.042728 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e296bc-ab2d-4c96-bf17-a87ce9498366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:44.043731 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e296bc-ab2d-4c96-bf17-a87ce9498366 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:44.043731 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e296bc-ab2d-4c96-bf17-a87ce9498366 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:44.043892 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e296bc-ab2d-4c96-bf17-a87ce9498366 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:44.109711 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5400fe68-afd4-4f5f-bea9-95cb852214e0 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:44.128864 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e296bc-ab2d-4c96-bf17-a87ce9498366 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:44.130417 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e296bc-ab2d-4c96-bf17-a87ce9498366 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:44.146188 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b672961a-264c-48a5-ac65-b0ac11290850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:44.146917 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b672961a-264c-48a5-ac65-b0ac11290850 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:44.147730 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b672961a-264c-48a5-ac65-b0ac11290850 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:44.148003 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b672961a-264c-48a5-ac65-b0ac11290850 None admin] PATH_INFO: `/v3/projects/52f32cd0707b4e2c922768eddcc432e5` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:44.149154 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b672961a-264c-48a5-ac65-b0ac11290850 None admin] RBAC: Authorizing `identity:get_project(project_id=52f32cd0707b4e2c922768eddcc432e5)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:44.150689 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b672961a-264c-48a5-ac65-b0ac11290850 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:44.156880 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 229/443] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Sep 20 22:10:43 2022] GET /identity/v3/projects/52f32cd0707b4e2c922768eddcc432e5 => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:44.157705 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b672961a-264c-48a5-ac65-b0ac11290850 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:44.227077 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:44.229615 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:44.243168 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 215/444] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 20 22:10:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 20 22:10:44.248649 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e296bc-ab2d-4c96-bf17-a87ce9498366 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:44.263338 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b672961a-264c-48a5-ac65-b0ac11290850 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:44.298497 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a785be-382c-4f9f-ae3e-d5ed975d83c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:44.299156 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a785be-382c-4f9f-ae3e-d5ed975d83c6 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:44.299440 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a785be-382c-4f9f-ae3e-d5ed975d83c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:44.299712 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a785be-382c-4f9f-ae3e-d5ed975d83c6 None admin] PATH_INFO: `/v3/groups/ba043fbb3fa34638a9ca48bbf3e55c92` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:44.301109 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a785be-382c-4f9f-ae3e-d5ed975d83c6 None admin] RBAC: Authorizing `identity:get_group(group_id=ba043fbb3fa34638a9ca48bbf3e55c92)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:44.302580 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a785be-382c-4f9f-ae3e-d5ed975d83c6 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:44.304169 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 230/445] 10.222.0.33 () {56 vars in 1180 bytes} [Tue Sep 20 22:10:44 2022] GET /identity/v3/groups/ba043fbb3fa34638a9ca48bbf3e55c92 => generated 226 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:44.305189 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a785be-382c-4f9f-ae3e-d5ed975d83c6 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:44.349612 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e296bc-ab2d-4c96-bf17-a87ce9498366 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:44.383627 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434f8304-403b-4f2f-a3a9-d867157b1e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:44.384251 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f8304-403b-4f2f-a3a9-d867157b1e57 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:44.384523 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f8304-403b-4f2f-a3a9-d867157b1e57 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:44.384790 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f8304-403b-4f2f-a3a9-d867157b1e57 None admin] PATH_INFO: `/v3/projects/52f32cd0707b4e2c922768eddcc432e5` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:44.385885 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434f8304-403b-4f2f-a3a9-d867157b1e57 None admin] RBAC: Authorizing `identity:get_project(project_id=52f32cd0707b4e2c922768eddcc432e5)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:44.387344 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434f8304-403b-4f2f-a3a9-d867157b1e57 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:44.389417 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 216/446] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Sep 20 22:10:44 2022] GET /identity/v3/projects/52f32cd0707b4e2c922768eddcc432e5 => generated 302 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 22:10:44.389970 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434f8304-403b-4f2f-a3a9-d867157b1e57 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:44.409970 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a785be-382c-4f9f-ae3e-d5ed975d83c6 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:44.443865 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4600aa95-8c1b-49a0-9f51-e272bb36be23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:44.445014 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4600aa95-8c1b-49a0-9f51-e272bb36be23 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:44.445310 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4600aa95-8c1b-49a0-9f51-e272bb36be23 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:44.445576 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4600aa95-8c1b-49a0-9f51-e272bb36be23 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:44.448371 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:44.448492 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:44.456873 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4600aa95-8c1b-49a0-9f51-e272bb36be23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 22:10:44.462191 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-4600aa95-8c1b-49a0-9f51-e272bb36be23 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 22:10:44.462191 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:10:44.462191 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:10:44.462191 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:10:44.462191 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:10:44.462191 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:10:44.462191 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:10:44.462191 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:10:44.462191 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:10:44.462191 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:10:44.462191 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:10:44.462191 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:10:44.462191 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 22:10:44.462191 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 22:10:44.462191 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 22:10:44.462191 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 22:10:44.463288 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 22:10:44.463288 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 22:10:44.463288 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 22:10:44.463288 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 22:10:44.463288 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:10:44.463288 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:10:44.463288 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:10:44.463288 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:10:44.463288 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:10:44.463288 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:10:44.463288 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:10:44.463288 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:10:44.463288 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:10:44.463288 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:10:44.463288 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:10:44.463288 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:10:44.464145 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:10:44.464145 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:10:44.464145 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:10:44.464145 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:10:44.464145 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 22:10:44.464145 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 22:10:44.464145 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 22:10:44.464145 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 22:10:44.464145 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 22:10:44.464145 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 22:10:44.464145 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 22:10:44.464145 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:10:44.464145 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 231/447] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Sep 20 22:10:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:10:44.464145 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4600aa95-8c1b-49a0-9f51-e272bb36be23 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:44.492021 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434f8304-403b-4f2f-a3a9-d867157b1e57 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:44.525587 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca96fd6-3e83-45d8-a3df-cb44c45251e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:44.526193 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca96fd6-3e83-45d8-a3df-cb44c45251e7 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:44.526473 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca96fd6-3e83-45d8-a3df-cb44c45251e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:44.526778 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca96fd6-3e83-45d8-a3df-cb44c45251e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:44.527495 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca96fd6-3e83-45d8-a3df-cb44c45251e7 None admin] RBAC: Adding query filter params (group.id=ba043fbb3fa34638a9ca48bbf3e55c92, role.id=604444e7ad0d437dbd1f5a6e02b761f5, scope.project.id=52f32cd0707b4e2c922768eddcc432e5) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:10:44.527802 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca96fd6-3e83-45d8-a3df-cb44c45251e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:44.529216 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca96fd6-3e83-45d8-a3df-cb44c45251e7 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:44.534756 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 217/448] 10.222.0.33 () {56 vars in 1376 bytes} [Tue Sep 20 22:10:44 2022] GET /identity/v3/role_assignments?group.id=ba043fbb3fa34638a9ca48bbf3e55c92&scope.project.id=52f32cd0707b4e2c922768eddcc432e5&role.id=604444e7ad0d437dbd1f5a6e02b761f5 => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:44.535523 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca96fd6-3e83-45d8-a3df-cb44c45251e7 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:44.568347 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4600aa95-8c1b-49a0-9f51-e272bb36be23 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:44.612614 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ea15f6-dd3c-4d6b-a292-ca27c70501ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:44.613678 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea15f6-dd3c-4d6b-a292-ca27c70501ad None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:44.613678 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea15f6-dd3c-4d6b-a292-ca27c70501ad None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:44.613857 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea15f6-dd3c-4d6b-a292-ca27c70501ad None admin] PATH_INFO: `/v3/groups/ba043fbb3fa34638a9ca48bbf3e55c92` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:44.615056 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ea15f6-dd3c-4d6b-a292-ca27c70501ad None admin] RBAC: Authorizing `identity:get_group(group_id=ba043fbb3fa34638a9ca48bbf3e55c92)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:44.617157 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ea15f6-dd3c-4d6b-a292-ca27c70501ad None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:44.619619 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 232/449] 10.222.0.33 () {56 vars in 1180 bytes} [Tue Sep 20 22:10:44 2022] GET /identity/v3/groups/ba043fbb3fa34638a9ca48bbf3e55c92 => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:44.625001 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ea15f6-dd3c-4d6b-a292-ca27c70501ad None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:44.652778 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca96fd6-3e83-45d8-a3df-cb44c45251e7 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:44.675242 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:44.693795 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:44.694679 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076b024e-9662-41ce-9810-ea1aa0e04d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:44.695252 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b024e-9662-41ce-9810-ea1aa0e04d8d None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:44.695674 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b024e-9662-41ce-9810-ea1aa0e04d8d None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:44.696127 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b024e-9662-41ce-9810-ea1aa0e04d8d None admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:44.696704 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076b024e-9662-41ce-9810-ea1aa0e04d8d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:10:44.697047 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076b024e-9662-41ce-9810-ea1aa0e04d8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:44.698713 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076b024e-9662-41ce-9810-ea1aa0e04d8d None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:44.708181 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 218/450] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 20 22:10:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:44.714297 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076b024e-9662-41ce-9810-ea1aa0e04d8d None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:44.741346 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ea15f6-dd3c-4d6b-a292-ca27c70501ad None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:44.784249 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fee985d-804c-4463-b424-8e76ef12d776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:44.784854 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fee985d-804c-4463-b424-8e76ef12d776 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:44.785167 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fee985d-804c-4463-b424-8e76ef12d776 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:44.785440 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fee985d-804c-4463-b424-8e76ef12d776 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:44.786166 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fee985d-804c-4463-b424-8e76ef12d776 None admin] RBAC: Adding query filter params (group.id=ba043fbb3fa34638a9ca48bbf3e55c92, role.id=4e75d58a1e0e4fffa940914b1e5f46de, scope.project.id=52f32cd0707b4e2c922768eddcc432e5) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:10:44.786483 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fee985d-804c-4463-b424-8e76ef12d776 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:44.787992 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fee985d-804c-4463-b424-8e76ef12d776 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:44.794003 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 233/451] 10.222.0.33 () {56 vars in 1376 bytes} [Tue Sep 20 22:10:44 2022] GET /identity/v3/role_assignments?group.id=ba043fbb3fa34638a9ca48bbf3e55c92&scope.project.id=52f32cd0707b4e2c922768eddcc432e5&role.id=4e75d58a1e0e4fffa940914b1e5f46de => generated 611 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 22:10:44.840216 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076b024e-9662-41ce-9810-ea1aa0e04d8d None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:44.880691 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cb57b0-2ba6-4cff-8d04-6919e16e2bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:44.881320 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cb57b0-2ba6-4cff-8d04-6919e16e2bf6 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:44.882214 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cb57b0-2ba6-4cff-8d04-6919e16e2bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:44.882493 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cb57b0-2ba6-4cff-8d04-6919e16e2bf6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:44.942278 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:44.964375 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cb57b0-2ba6-4cff-8d04-6919e16e2bf6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:44.965908 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cb57b0-2ba6-4cff-8d04-6919e16e2bf6 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:45.066569 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 219/452] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 20 22:10:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 20 22:10:45.072836 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fee985d-804c-4463-b424-8e76ef12d776 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:45.173913 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fee985d-804c-4463-b424-8e76ef12d776 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:45.199469 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:45.207306 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152d464b-3b7e-4aa6-91bd-52fad7367300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:45.207926 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152d464b-3b7e-4aa6-91bd-52fad7367300 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:45.208207 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152d464b-3b7e-4aa6-91bd-52fad7367300 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:45.208479 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152d464b-3b7e-4aa6-91bd-52fad7367300 None admin] PATH_INFO: `/v3/projects/b201745482554bcb8321485927bbaae5` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:45.209615 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152d464b-3b7e-4aa6-91bd-52fad7367300 None admin] RBAC: Authorizing `identity:get_project(project_id=b201745482554bcb8321485927bbaae5)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:45.211095 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152d464b-3b7e-4aa6-91bd-52fad7367300 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:45.212699 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 234/453] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Sep 20 22:10:45 2022] GET /identity/v3/projects/b201745482554bcb8321485927bbaae5 => generated 344 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:45.218213 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cb57b0-2ba6-4cff-8d04-6919e16e2bf6 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:45.297651 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:45.316589 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cb57b0-2ba6-4cff-8d04-6919e16e2bf6 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:45.349014 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39434561-9fb5-4662-ba92-9f1ba68a100a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:45.349638 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39434561-9fb5-4662-ba92-9f1ba68a100a None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:45.350128 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39434561-9fb5-4662-ba92-9f1ba68a100a None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:45.350766 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39434561-9fb5-4662-ba92-9f1ba68a100a None admin] PATH_INFO: `/v3/groups/a0bb4dad3da34b69a496012a8620fbc7` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:45.351913 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39434561-9fb5-4662-ba92-9f1ba68a100a None admin] RBAC: Authorizing `identity:get_group(group_id=a0bb4dad3da34b69a496012a8620fbc7)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:45.353352 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39434561-9fb5-4662-ba92-9f1ba68a100a None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:45.354961 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 220/454] 10.222.0.33 () {56 vars in 1180 bytes} [Tue Sep 20 22:10:45 2022] GET /identity/v3/groups/a0bb4dad3da34b69a496012a8620fbc7 => generated 229 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:45.360823 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152d464b-3b7e-4aa6-91bd-52fad7367300 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:45.456466 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152d464b-3b7e-4aa6-91bd-52fad7367300 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:45.488322 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61353ee9-fecd-438f-b2b1-b9c57121070c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:45.488905 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61353ee9-fecd-438f-b2b1-b9c57121070c None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:45.489182 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61353ee9-fecd-438f-b2b1-b9c57121070c None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:45.489454 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61353ee9-fecd-438f-b2b1-b9c57121070c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:45.490168 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61353ee9-fecd-438f-b2b1-b9c57121070c None admin] RBAC: Adding query filter params (group.id=a0bb4dad3da34b69a496012a8620fbc7, role.id=8a829170b29d42d6af589399e51edb0f, scope.project.id=b201745482554bcb8321485927bbaae5) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:10:45.490477 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61353ee9-fecd-438f-b2b1-b9c57121070c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:45.492469 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61353ee9-fecd-438f-b2b1-b9c57121070c None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:45.497916 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 235/455] 10.222.0.33 () {56 vars in 1376 bytes} [Tue Sep 20 22:10:45 2022] GET /identity/v3/role_assignments?group.id=a0bb4dad3da34b69a496012a8620fbc7&scope.project.id=b201745482554bcb8321485927bbaae5&role.id=8a829170b29d42d6af589399e51edb0f => generated 611 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:48.101738 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84afa8cc-9b16-47e8-912b-b3589789370f None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:48.102250 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84afa8cc-9b16-47e8-912b-b3589789370f None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:48.102250 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84afa8cc-9b16-47e8-912b-b3589789370f None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:48.103909 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 221/456] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:10:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:10:48.108961 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f1158a-8508-4bf9-9145-ebf726d16dc4 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:48.109349 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f1158a-8508-4bf9-9145-ebf726d16dc4 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:48.109508 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f1158a-8508-4bf9-9145-ebf726d16dc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:48.132903 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-68f1158a-8508-4bf9-9145-ebf726d16dc4 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:10:48.134070 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-68f1158a-8508-4bf9-9145-ebf726d16dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:10:48.209121 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:48.221583 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 236/457] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:10:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 20 22:10:48.505799 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a43c38b-e55d-48d2-a3e5-664df737312a None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:48.505986 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a43c38b-e55d-48d2-a3e5-664df737312a None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:48.506252 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a43c38b-e55d-48d2-a3e5-664df737312a None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:48.508483 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 222/458] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:10:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:10:48.513426 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f77cbf2-466e-4e7c-8d72-f950f882edb9 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:48.513709 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f77cbf2-466e-4e7c-8d72-f950f882edb9 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:48.513979 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f77cbf2-466e-4e7c-8d72-f950f882edb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:48.533933 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb1c655-284f-40f8-b81b-ad47622e2db1 None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:48.534226 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb1c655-284f-40f8-b81b-ad47622e2db1 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:48.534523 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb1c655-284f-40f8-b81b-ad47622e2db1 None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:48.536165 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 223/459] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:10:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:10:48.536270 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-8f77cbf2-466e-4e7c-8d72-f950f882edb9 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:10:48.537340 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-8f77cbf2-466e-4e7c-8d72-f950f882edb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:10:48.545163 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cfad1b-9b19-43d5-97f8-5329699713f3 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:48.545450 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cfad1b-9b19-43d5-97f8-5329699713f3 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:48.545730 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cfad1b-9b19-43d5-97f8-5329699713f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:48.579116 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-76cfad1b-9b19-43d5-97f8-5329699713f3 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:10:48.580308 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-76cfad1b-9b19-43d5-97f8-5329699713f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:10:48.646246 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 237/460] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:10:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 22:10:48.647758 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f77cbf2-466e-4e7c-8d72-f950f882edb9 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:48.689864 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 224/461] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:10:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 20 22:10:48.792343 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f77cbf2-466e-4e7c-8d72-f950f882edb9 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:48.816739 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:48.836643 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0ec80d-d071-478d-b636-57ce0a73645f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:48.837277 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ec80d-d071-478d-b636-57ce0a73645f None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:48.837553 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ec80d-d071-478d-b636-57ce0a73645f None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:48.837815 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ec80d-d071-478d-b636-57ce0a73645f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:48.853737 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0ec80d-d071-478d-b636-57ce0a73645f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:48.855288 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0ec80d-d071-478d-b636-57ce0a73645f None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:48.871500 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-2b0ec80d-d071-478d-b636-57ce0a73645f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:10:48.871500 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:10:48.871500 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:10:48.871500 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:10:48.871500 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:10:48.871500 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:10:48.871500 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:10:48.871500 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:10:48.871500 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:10:48.871500 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:10:48.871500 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:10:48.871500 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:10:48.871500 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 22:10:48.871500 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 22:10:48.871500 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 22:10:48.871500 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 22:10:48.872484 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:10:48.872484 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:10:48.872484 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:10:48.872484 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:10:48.872484 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:10:48.872484 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:10:48.872484 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:10:48.872484 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:10:48.872484 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:10:48.872484 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:10:48.872484 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:10:48.872484 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:10:48.872484 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:10:48.872484 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:10:48.872484 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:10:48.872484 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:10:48.872484 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 22:10:48.873342 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 22:10:48.873342 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:10:48.873342 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:10:48.873342 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 238/462] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 20 22:10:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:10:48.879088 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cfad1b-9b19-43d5-97f8-5329699713f3 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:48.974703 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0ec80d-d071-478d-b636-57ce0a73645f None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:49.002876 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:49.026497 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cfad1b-9b19-43d5-97f8-5329699713f3 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:49.072232 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b7ce80-fcbe-4cbd-ac91-18fbffbfdade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:49.072738 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b7ce80-fcbe-4cbd-ac91-18fbffbfdade None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:49.073123 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b7ce80-fcbe-4cbd-ac91-18fbffbfdade None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:49.073500 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b7ce80-fcbe-4cbd-ac91-18fbffbfdade None admin] PATH_INFO: `/v3/domains` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:49.074365 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b7ce80-fcbe-4cbd-ac91-18fbffbfdade None admin] RBAC: Adding query filter params (name=Default) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:10:49.074695 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b7ce80-fcbe-4cbd-ac91-18fbffbfdade None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:49.076177 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b7ce80-fcbe-4cbd-ac91-18fbffbfdade None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:49.089007 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 225/463] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 20 22:10:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:49.090303 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6cdcf1-40f6-4f98-9365-2c2a16dd0c4b None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:49.090630 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6cdcf1-40f6-4f98-9365-2c2a16dd0c4b None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:49.090909 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6cdcf1-40f6-4f98-9365-2c2a16dd0c4b None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:49.092396 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 226/464] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:10:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:10:49.093201 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6cdcf1-40f6-4f98-9365-2c2a16dd0c4b None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:49.100171 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0ec80d-d071-478d-b636-57ce0a73645f None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:49.135361 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d61dac-cabb-495b-80e1-2cca5c15b3aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:49.135977 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d61dac-cabb-495b-80e1-2cca5c15b3aa None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:49.136297 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d61dac-cabb-495b-80e1-2cca5c15b3aa None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:49.136511 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d61dac-cabb-495b-80e1-2cca5c15b3aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:49.148499 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d61dac-cabb-495b-80e1-2cca5c15b3aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:49.149925 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d61dac-cabb-495b-80e1-2cca5c15b3aa None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:49.164290 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-55d61dac-cabb-495b-80e1-2cca5c15b3aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:10:49.164290 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:10:49.164290 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:10:49.164290 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:10:49.164290 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:10:49.164290 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:10:49.164290 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:10:49.164290 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:10:49.164290 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:10:49.164290 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:10:49.164290 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:10:49.164290 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:10:49.164290 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 22:10:49.164290 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 22:10:49.164290 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 22:10:49.164290 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 22:10:49.165231 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:10:49.165231 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:10:49.165231 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:10:49.165231 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:10:49.165231 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:10:49.165231 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:10:49.165231 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:10:49.165231 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:10:49.165231 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:10:49.165231 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:10:49.165231 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:10:49.165231 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:10:49.165231 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:10:49.165231 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:10:49.165231 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:10:49.165231 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:10:49.165231 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 22:10:49.166700 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 22:10:49.166700 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:10:49.166700 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:10:49.166700 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 239/465] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 20 22:10:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 20 22:10:49.166700 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d61dac-cabb-495b-80e1-2cca5c15b3aa None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:49.193160 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:49.208688 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6cdcf1-40f6-4f98-9365-2c2a16dd0c4b None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:49.243810 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3661b404-c45f-4816-b59e-c3cd37c5466b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:49.244450 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3661b404-c45f-4816-b59e-c3cd37c5466b None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:49.244733 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3661b404-c45f-4816-b59e-c3cd37c5466b None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:49.245007 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3661b404-c45f-4816-b59e-c3cd37c5466b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:49.254189 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:49.256216 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3661b404-c45f-4816-b59e-c3cd37c5466b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:49.258375 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3661b404-c45f-4816-b59e-c3cd37c5466b None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:49.277810 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-3661b404-c45f-4816-b59e-c3cd37c5466b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:10:49.277810 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:10:49.277810 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:10:49.277810 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:10:49.277810 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:10:49.277810 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:10:49.277810 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:10:49.277810 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:10:49.277810 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:10:49.277810 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:10:49.277810 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:10:49.277810 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:10:49.277810 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 22:10:49.277810 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 22:10:49.277810 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 22:10:49.277810 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 22:10:49.278792 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:10:49.278792 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:10:49.278792 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:10:49.278792 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:10:49.278792 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:10:49.278792 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:10:49.278792 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:10:49.278792 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:10:49.278792 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:10:49.278792 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:10:49.278792 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:10:49.278792 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:10:49.278792 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:10:49.278792 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:10:49.278792 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:10:49.278792 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:10:49.278792 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 22:10:49.279637 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 22:10:49.279637 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:10:49.279637 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:10:49.279637 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 227/466] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 20 22:10:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:10:49.279637 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88a12e-a947-4623-b345-1ea805b43046 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:49.279637 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88a12e-a947-4623-b345-1ea805b43046 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:49.279637 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88a12e-a947-4623-b345-1ea805b43046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:49.286749 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d61dac-cabb-495b-80e1-2cca5c15b3aa None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:49.305149 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-9f88a12e-a947-4623-b345-1ea805b43046 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:10:49.305290 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-9f88a12e-a947-4623-b345-1ea805b43046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:10:49.327836 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71394bbd-f273-4593-be6e-11b205e3a6e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:49.328800 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71394bbd-f273-4593-be6e-11b205e3a6e2 None admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:49.329100 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71394bbd-f273-4593-be6e-11b205e3a6e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:49.329377 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71394bbd-f273-4593-be6e-11b205e3a6e2 None admin] PATH_INFO: `/v3/users` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:49.330211 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71394bbd-f273-4593-be6e-11b205e3a6e2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:49.331697 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71394bbd-f273-4593-be6e-11b205e3a6e2 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:49.354685 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 240/467] 10.222.0.33 () {60 vars in 1132 bytes} [Tue Sep 20 22:10:49 2022] POST /identity/v3/users => generated 246 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:10:49.355585 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71394bbd-f273-4593-be6e-11b205e3a6e2 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:49.388212 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 228/468] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:10:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 22:10:49.389519 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f88a12e-a947-4623-b345-1ea805b43046 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:49.511426 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f88a12e-a947-4623-b345-1ea805b43046 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:49.521372 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:49.547193 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:49.553844 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71394bbd-f273-4593-be6e-11b205e3a6e2 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:49.554233 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0711c83b-95e4-457c-b859-ea36e0abcab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:49.555281 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0711c83b-95e4-457c-b859-ea36e0abcab0 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:49.555800 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0711c83b-95e4-457c-b859-ea36e0abcab0 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:49.556391 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0711c83b-95e4-457c-b859-ea36e0abcab0 None admin] PATH_INFO: `/v3/domains` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:49.557248 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0711c83b-95e4-457c-b859-ea36e0abcab0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:10:49.558582 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0711c83b-95e4-457c-b859-ea36e0abcab0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:49.560169 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0711c83b-95e4-457c-b859-ea36e0abcab0 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:49.575242 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 229/469] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 20 22:10:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:49.581089 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0711c83b-95e4-457c-b859-ea36e0abcab0 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:49.600773 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3419daf5-40eb-4d46-a137-049dffaafad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:49.601940 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3419daf5-40eb-4d46-a137-049dffaafad2 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:49.602840 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3419daf5-40eb-4d46-a137-049dffaafad2 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:49.603311 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3419daf5-40eb-4d46-a137-049dffaafad2 None admin] PATH_INFO: `/v3/domains` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:49.604232 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3419daf5-40eb-4d46-a137-049dffaafad2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:10:49.604986 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3419daf5-40eb-4d46-a137-049dffaafad2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:49.607053 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3419daf5-40eb-4d46-a137-049dffaafad2 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:49.623822 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 241/470] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 20 22:10:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:49.627905 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3419daf5-40eb-4d46-a137-049dffaafad2 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:49.708146 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0711c83b-95e4-457c-b859-ea36e0abcab0 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:49.753200 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02754ef9-a84c-4705-ad96-ceab099ec1af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:49.753664 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3419daf5-40eb-4d46-a137-049dffaafad2 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:49.753801 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02754ef9-a84c-4705-ad96-ceab099ec1af None admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:49.754083 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02754ef9-a84c-4705-ad96-ceab099ec1af None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:49.754360 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02754ef9-a84c-4705-ad96-ceab099ec1af None admin] PATH_INFO: `/v3/users` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:49.755060 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02754ef9-a84c-4705-ad96-ceab099ec1af None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:49.757131 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02754ef9-a84c-4705-ad96-ceab099ec1af None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:49.779156 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 230/471] 10.222.0.33 () {60 vars in 1132 bytes} [Tue Sep 20 22:10:49 2022] POST /identity/v3/users => generated 248 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:10:49.780652 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb8d20d-7f4b-4022-b7d6-908036924a99 None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:49.781113 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb8d20d-7f4b-4022-b7d6-908036924a99 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:49.781571 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb8d20d-7f4b-4022-b7d6-908036924a99 None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:49.783328 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 231/472] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:10:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:10:49.784341 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb8d20d-7f4b-4022-b7d6-908036924a99 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:49.797693 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d8ae6e-8a92-4dd7-ba6b-52205738238a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:49.798682 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d8ae6e-8a92-4dd7-ba6b-52205738238a None admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:49.798981 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d8ae6e-8a92-4dd7-ba6b-52205738238a None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:49.799257 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d8ae6e-8a92-4dd7-ba6b-52205738238a None admin] PATH_INFO: `/v3/users` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:49.799928 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d8ae6e-8a92-4dd7-ba6b-52205738238a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:49.801370 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d8ae6e-8a92-4dd7-ba6b-52205738238a None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:49.815622 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:49.838996 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 242/473] 10.222.0.33 () {60 vars in 1132 bytes} [Tue Sep 20 22:10:49 2022] POST /identity/v3/users => generated 248 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:10:49.839653 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:49.844057 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fc30aa-f0a4-4579-b9f1-8a9eac90c240 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:49.844717 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fc30aa-f0a4-4579-b9f1-8a9eac90c240 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:49.845453 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fc30aa-f0a4-4579-b9f1-8a9eac90c240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:49.877549 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-79fc30aa-f0a4-4579-b9f1-8a9eac90c240 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:10:49.879328 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-79fc30aa-f0a4-4579-b9f1-8a9eac90c240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:10:49.976199 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb8d20d-7f4b-4022-b7d6-908036924a99 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:49.981462 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 243/474] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:10:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 22:10:50.026327 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b667a10-2c14-4c7a-a07e-39023de20404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:50.027093 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b667a10-2c14-4c7a-a07e-39023de20404 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:50.027383 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b667a10-2c14-4c7a-a07e-39023de20404 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:50.027665 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b667a10-2c14-4c7a-a07e-39023de20404 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:50.040647 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b667a10-2c14-4c7a-a07e-39023de20404 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:50.042161 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b667a10-2c14-4c7a-a07e-39023de20404 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:50.060303 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-0b667a10-2c14-4c7a-a07e-39023de20404 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:10:50.060303 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:10:50.060303 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:10:50.060303 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:10:50.060303 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:10:50.060303 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:10:50.060303 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:10:50.060303 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:10:50.060303 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:10:50.060303 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:10:50.060303 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:10:50.060303 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:10:50.060303 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 22:10:50.060303 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 22:10:50.060303 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 22:10:50.060303 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 22:10:50.061289 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:10:50.061289 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:10:50.061289 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:10:50.061289 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:10:50.061289 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:10:50.061289 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:10:50.061289 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:10:50.061289 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:10:50.061289 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:10:50.061289 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:10:50.061289 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:10:50.061289 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:10:50.061289 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:10:50.061289 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:10:50.061289 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:10:50.061289 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:10:50.061289 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 22:10:50.062134 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 22:10:50.062134 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:10:50.062134 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:10:50.062134 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 232/475] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 20 22:10:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:10:50.069579 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fc30aa-f0a4-4579-b9f1-8a9eac90c240 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:50.183187 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fc30aa-f0a4-4579-b9f1-8a9eac90c240 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:50.210720 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:50.224821 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf7d9bc-abe7-46ee-9c7a-771e58f7a036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:50.226058 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf7d9bc-abe7-46ee-9c7a-771e58f7a036 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:50.226339 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf7d9bc-abe7-46ee-9c7a-771e58f7a036 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:50.226643 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf7d9bc-abe7-46ee-9c7a-771e58f7a036 None admin] PATH_INFO: `/v3/domains` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:50.227297 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf7d9bc-abe7-46ee-9c7a-771e58f7a036 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:10:50.227600 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf7d9bc-abe7-46ee-9c7a-771e58f7a036 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:50.228973 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf7d9bc-abe7-46ee-9c7a-771e58f7a036 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:50.243931 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 244/476] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 20 22:10:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:50.251554 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b667a10-2c14-4c7a-a07e-39023de20404 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:50.270594 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf7d9bc-abe7-46ee-9c7a-771e58f7a036 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:50.369810 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:50.392458 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b667a10-2c14-4c7a-a07e-39023de20404 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:50.402720 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf7d9bc-abe7-46ee-9c7a-771e58f7a036 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:50.442028 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa17936d-4365-42e6-bf56-7c3f77653824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:50.442572 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17936d-4365-42e6-bf56-7c3f77653824 None admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:50.442852 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17936d-4365-42e6-bf56-7c3f77653824 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:50.443120 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17936d-4365-42e6-bf56-7c3f77653824 None admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:50.444363 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa17936d-4365-42e6-bf56-7c3f77653824 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:50.446997 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa17936d-4365-42e6-bf56-7c3f77653824 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:50.465041 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.sql.core [None req-aa17936d-4365-42e6-bf56-7c3f77653824 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 20 22:10:50.465041 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 20 22:10:50.465041 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [parameters: {'id': '490e3769490a4b8f9c43068a6377f8bc', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 20 22:10:50.465041 dv-cinder-858276-1-smb devstack@keystone.service[81306]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81306) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 20 22:10:50.482224 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0734e15a-21ac-431b-84e6-2596c628d543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:50.482908 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0734e15a-21ac-431b-84e6-2596c628d543 None admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:50.483185 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0734e15a-21ac-431b-84e6-2596c628d543 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:50.483452 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0734e15a-21ac-431b-84e6-2596c628d543 None admin] PATH_INFO: `/v3/users` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:50.484093 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0734e15a-21ac-431b-84e6-2596c628d543 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:50.485577 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0734e15a-21ac-431b-84e6-2596c628d543 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:50.498461 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-aa17936d-4365-42e6-bf56-7c3f77653824 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 20 22:10:50.498461 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:10:50.498461 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 20 22:10:50.498461 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 20 22:10:50.498461 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 20 22:10:50.498461 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 20 22:10:50.498461 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 20 22:10:50.498461 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application result = self._query(query) Sep 20 22:10:50.498461 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 20 22:10:50.498461 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application conn.query(q) Sep 20 22:10:50.498461 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 20 22:10:50.498461 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 20 22:10:50.498461 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 20 22:10:50.498461 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application result.read() Sep 20 22:10:50.498461 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 20 22:10:50.499382 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 20 22:10:50.499382 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 20 22:10:50.499382 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 20 22:10:50.499382 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 20 22:10:50.499382 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 20 22:10:50.499382 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 20 22:10:50.499382 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 20 22:10:50.499382 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 20 22:10:50.499382 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:10:50.499382 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 20 22:10:50.499382 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:10:50.499382 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:10:50.499382 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 20 22:10:50.499382 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 20 22:10:50.499382 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 20 22:10:50.499382 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return ref.to_dict() Sep 20 22:10:50.499382 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 20 22:10:50.499382 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application next(self.gen) Sep 20 22:10:50.500279 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 20 22:10:50.500279 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application yield resource Sep 20 22:10:50.500279 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 20 22:10:50.500279 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application next(self.gen) Sep 20 22:10:50.500279 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 20 22:10:50.500279 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application self.session.rollback() Sep 20 22:10:50.500279 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 20 22:10:50.500279 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application self.force_reraise() Sep 20 22:10:50.500279 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 20 22:10:50.500279 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise self.value Sep 20 22:10:50.500279 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 20 22:10:50.500279 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 20 22:10:50.500279 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 20 22:10:50.500279 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application session.commit() Sep 20 22:10:50.500279 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 20 22:10:50.500279 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 20 22:10:50.500279 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 20 22:10:50.501572 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application self._prepare_impl() Sep 20 22:10:50.501572 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 20 22:10:50.501572 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application self.session.flush() Sep 20 22:10:50.501572 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 20 22:10:50.501572 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application self._flush(objects) Sep 20 22:10:50.501572 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 20 22:10:50.501572 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 20 22:10:50.501572 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 20 22:10:50.501572 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application compat.raise_( Sep 20 22:10:50.501572 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 20 22:10:50.501572 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception Sep 20 22:10:50.501572 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 20 22:10:50.501572 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application flush_context.execute() Sep 20 22:10:50.501572 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 20 22:10:50.501572 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rec.execute(self) Sep 20 22:10:50.501572 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 20 22:10:50.501572 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 20 22:10:50.502435 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 20 22:10:50.502435 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 20 22:10:50.502435 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 20 22:10:50.502435 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 20 22:10:50.502435 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 20 22:10:50.502435 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 20 22:10:50.502435 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 20 22:10:50.502435 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 20 22:10:50.502435 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 20 22:10:50.502435 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 20 22:10:50.502435 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 20 22:10:50.502435 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 20 22:10:50.502435 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 20 22:10:50.502435 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 20 22:10:50.502435 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 20 22:10:50.502435 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception Sep 20 22:10:50.503959 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 20 22:10:50.503959 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 20 22:10:50.503959 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 20 22:10:50.503959 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 20 22:10:50.503959 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 20 22:10:50.503959 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application result = self._query(query) Sep 20 22:10:50.503959 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 20 22:10:50.503959 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application conn.query(q) Sep 20 22:10:50.503959 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 20 22:10:50.503959 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 20 22:10:50.503959 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 20 22:10:50.503959 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application result.read() Sep 20 22:10:50.503959 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 20 22:10:50.503959 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 20 22:10:50.503959 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 20 22:10:50.503959 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 20 22:10:50.505967 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 20 22:10:50.505967 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 20 22:10:50.505967 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 20 22:10:50.505967 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 20 22:10:50.505967 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 20 22:10:50.505967 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 20 22:10:50.505967 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [parameters: {'id': '490e3769490a4b8f9c43068a6377f8bc', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 20 22:10:50.505967 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 20 22:10:50.505967 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:10:50.505967 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 20 22:10:50.505967 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:10:50.505967 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:10:50.505967 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:10:50.505967 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:10:50.505967 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:10:50.505967 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:10:50.513241 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:10:50.513241 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:10:50.513241 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:10:50.513241 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:10:50.513241 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:10:50.513241 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:10:50.513241 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 20 22:10:50.513241 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 20 22:10:50.513241 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:10:50.513241 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:10:50.513241 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 20 22:10:50.513241 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 20 22:10:50.513241 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 20 22:10:50.513241 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 20 22:10:50.513241 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 20 22:10:50.513241 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:10:50.514095 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 245/477] 10.222.0.33 () {60 vars in 1131 bytes} [Tue Sep 20 22:10:50 2022] POST /identity/v3/roles => generated 144 bytes in 232 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 20 22:10:50.514095 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa17936d-4365-42e6-bf56-7c3f77653824 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:50.528944 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 233/478] 10.222.0.33 () {60 vars in 1132 bytes} [Tue Sep 20 22:10:50 2022] POST /identity/v3/users => generated 249 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:10:50.571147 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:50.629335 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa17936d-4365-42e6-bf56-7c3f77653824 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:50.668722 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8216e089-1738-4eb2-9577-c4efc233cb06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:50.669376 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8216e089-1738-4eb2-9577-c4efc233cb06 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:50.669652 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8216e089-1738-4eb2-9577-c4efc233cb06 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:50.669922 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8216e089-1738-4eb2-9577-c4efc233cb06 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:50.682412 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8216e089-1738-4eb2-9577-c4efc233cb06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 22:10:50.687963 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-8216e089-1738-4eb2-9577-c4efc233cb06 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 20 22:10:50.687963 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:10:50.687963 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:10:50.687963 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:10:50.687963 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:10:50.687963 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:10:50.687963 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:10:50.687963 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:10:50.687963 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:10:50.687963 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:10:50.687963 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:10:50.687963 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:10:50.687963 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 22:10:50.687963 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 22:10:50.687963 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 22:10:50.687963 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 22:10:50.688894 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 22:10:50.688894 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 22:10:50.688894 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 22:10:50.688894 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 22:10:50.688894 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:10:50.688894 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:10:50.688894 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:10:50.688894 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:10:50.688894 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:10:50.688894 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:10:50.688894 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:10:50.688894 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:10:50.688894 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:10:50.688894 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:10:50.688894 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:10:50.688894 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:10:50.689686 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:10:50.689686 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:10:50.689686 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:10:50.689686 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:10:50.689686 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 22:10:50.689686 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 22:10:50.689686 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 22:10:50.689686 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 22:10:50.689686 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 22:10:50.689686 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 22:10:50.689686 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 20 22:10:50.689686 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:10:50.689686 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 246/479] 10.222.0.33 () {56 vars in 1114 bytes} [Tue Sep 20 22:10:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:10:50.697577 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0734e15a-21ac-431b-84e6-2596c628d543 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:50.831693 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0734e15a-21ac-431b-84e6-2596c628d543 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:50.866687 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5b490e-c724-4b85-bcc3-8805516077bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:50.867306 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5b490e-c724-4b85-bcc3-8805516077bc None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:50.867584 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5b490e-c724-4b85-bcc3-8805516077bc None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:50.867914 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5b490e-c724-4b85-bcc3-8805516077bc None admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:50.868584 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5b490e-c724-4b85-bcc3-8805516077bc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:10:50.868883 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5b490e-c724-4b85-bcc3-8805516077bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:50.870255 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5b490e-c724-4b85-bcc3-8805516077bc None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:50.878749 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 234/480] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Sep 20 22:10:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:52.264876 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a557d-f0f3-478d-a4f0-a5fe4406b54d None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:52.265383 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a557d-f0f3-478d-a4f0-a5fe4406b54d None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:52.265490 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a557d-f0f3-478d-a4f0-a5fe4406b54d None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:52.267048 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 247/481] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:10:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:10:52.272610 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5f2653-e5f9-4a3c-9785-ded642e88829 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:52.272990 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5f2653-e5f9-4a3c-9785-ded642e88829 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:52.273147 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5f2653-e5f9-4a3c-9785-ded642e88829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:52.295873 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-6b5f2653-e5f9-4a3c-9785-ded642e88829 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:10:52.297068 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-6b5f2653-e5f9-4a3c-9785-ded642e88829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:10:52.299551 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:52.387838 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 235/482] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:10:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 20 22:10:52.626193 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a159fa19-3a31-42ce-8fe6-454a188b3bbb None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:52.626193 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a159fa19-3a31-42ce-8fe6-454a188b3bbb None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:52.626193 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a159fa19-3a31-42ce-8fe6-454a188b3bbb None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:52.627447 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 248/483] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:10:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:10:52.637022 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8182750e-6e3b-4d94-9fc4-f857ed852028 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:52.637313 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8182750e-6e3b-4d94-9fc4-f857ed852028 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:52.637592 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8182750e-6e3b-4d94-9fc4-f857ed852028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:52.643805 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ef492-0e58-41fe-b8fc-3bfb975c0618 None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:52.644322 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ef492-0e58-41fe-b8fc-3bfb975c0618 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:52.644807 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ef492-0e58-41fe-b8fc-3bfb975c0618 None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:52.646326 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 249/484] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:10:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 20 22:10:52.651773 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9a63ac-fe8b-409b-8105-09859a1f65fd None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:52.652303 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9a63ac-fe8b-409b-8105-09859a1f65fd None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:52.652776 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9a63ac-fe8b-409b-8105-09859a1f65fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:52.663947 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-8182750e-6e3b-4d94-9fc4-f857ed852028 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:10:52.665138 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-8182750e-6e3b-4d94-9fc4-f857ed852028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:10:52.672465 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-0b9a63ac-fe8b-409b-8105-09859a1f65fd None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:10:52.674339 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-0b9a63ac-fe8b-409b-8105-09859a1f65fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:10:52.764341 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 236/485] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:10:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 22:10:52.765602 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8182750e-6e3b-4d94-9fc4-f857ed852028 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:52.794962 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 250/486] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:10:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 22:10:52.874205 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:52.918621 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8182750e-6e3b-4d94-9fc4-f857ed852028 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:52.967655 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b99167b-8af7-4aa9-bdba-7edea358dfae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:52.968294 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b99167b-8af7-4aa9-bdba-7edea358dfae None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:52.968657 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b99167b-8af7-4aa9-bdba-7edea358dfae None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:52.968931 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b99167b-8af7-4aa9-bdba-7edea358dfae None admin] PATH_INFO: `/v3/roles/service` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:52.991776 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b99167b-8af7-4aa9-bdba-7edea358dfae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 22:10:52.998364 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-0b99167b-8af7-4aa9-bdba-7edea358dfae None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 20 22:10:52.998364 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:10:52.998364 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:10:52.998364 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:10:52.998364 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:10:52.998364 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:10:52.998364 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:10:52.998364 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:10:52.998364 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:10:52.998364 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:10:52.998364 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:10:52.998364 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:10:52.998364 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 22:10:52.998364 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 22:10:52.998364 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 22:10:52.998364 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 22:10:52.999299 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 22:10:52.999299 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 22:10:52.999299 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 22:10:52.999299 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 22:10:52.999299 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:10:52.999299 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:10:52.999299 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:10:52.999299 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:10:52.999299 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:10:52.999299 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:10:52.999299 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:10:52.999299 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:10:52.999299 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:10:52.999299 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:10:52.999299 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:10:52.999299 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:10:53.000546 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:10:53.000546 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:10:53.000546 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:10:53.000546 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:10:53.000546 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 22:10:53.000546 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 22:10:53.000546 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 22:10:53.000546 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 22:10:53.000546 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 22:10:53.000546 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 22:10:53.000546 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 20 22:10:53.000546 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:10:53.000546 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 237/487] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Sep 20 22:10:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:10:53.007320 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9a63ac-fe8b-409b-8105-09859a1f65fd None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:53.048881 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:53.083781 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b99167b-8af7-4aa9-bdba-7edea358dfae None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:53.129834 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9a63ac-fe8b-409b-8105-09859a1f65fd None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:53.184538 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88b445b-4687-4353-bbce-a0a5727af5ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:53.185553 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88b445b-4687-4353-bbce-a0a5727af5ad None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:53.186084 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88b445b-4687-4353-bbce-a0a5727af5ad None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:53.186578 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88b445b-4687-4353-bbce-a0a5727af5ad None admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:53.187466 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88b445b-4687-4353-bbce-a0a5727af5ad None admin] RBAC: Adding query filter params (name=service) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:10:53.187983 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88b445b-4687-4353-bbce-a0a5727af5ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:53.189569 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88b445b-4687-4353-bbce-a0a5727af5ad None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:53.198560 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 251/488] 10.222.0.33 () {56 vars in 1103 bytes} [Tue Sep 20 22:10:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:53.199673 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88b445b-4687-4353-bbce-a0a5727af5ad None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:53.215395 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b99167b-8af7-4aa9-bdba-7edea358dfae None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:53.243966 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:53.252854 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85a3aa5-e0e5-4d97-b4dd-c0669374f18a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:53.253590 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85a3aa5-e0e5-4d97-b4dd-c0669374f18a None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:53.253872 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85a3aa5-e0e5-4d97-b4dd-c0669374f18a None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:53.254141 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85a3aa5-e0e5-4d97-b4dd-c0669374f18a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:53.265564 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85a3aa5-e0e5-4d97-b4dd-c0669374f18a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 22:10:53.270823 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-e85a3aa5-e0e5-4d97-b4dd-c0669374f18a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 20 22:10:53.270823 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:10:53.270823 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:10:53.270823 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:10:53.270823 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:10:53.270823 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:10:53.270823 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:10:53.270823 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:10:53.270823 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:10:53.270823 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:10:53.270823 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:10:53.270823 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:10:53.270823 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 22:10:53.270823 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 22:10:53.270823 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 22:10:53.270823 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 22:10:53.271704 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 22:10:53.271704 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 22:10:53.271704 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 22:10:53.271704 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 22:10:53.271704 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:10:53.271704 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:10:53.271704 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:10:53.271704 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:10:53.271704 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:10:53.271704 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:10:53.271704 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:10:53.271704 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:10:53.271704 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:10:53.271704 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:10:53.271704 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:10:53.271704 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:10:53.278680 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:10:53.278680 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:10:53.278680 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:10:53.278680 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:10:53.278680 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 22:10:53.278680 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 22:10:53.278680 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 22:10:53.278680 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 22:10:53.278680 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 22:10:53.278680 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 22:10:53.278680 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 20 22:10:53.278680 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:10:53.278680 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 238/489] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Sep 20 22:10:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 20 22:10:53.278680 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85a3aa5-e0e5-4d97-b4dd-c0669374f18a None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:53.325926 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88b445b-4687-4353-bbce-a0a5727af5ad None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:53.328352 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:53.373695 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965dafe5-7b6f-4b4f-8a5a-7b65e7540a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:53.374829 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965dafe5-7b6f-4b4f-8a5a-7b65e7540a0e None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:53.375578 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965dafe5-7b6f-4b4f-8a5a-7b65e7540a0e None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:53.376561 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965dafe5-7b6f-4b4f-8a5a-7b65e7540a0e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:53.390676 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965dafe5-7b6f-4b4f-8a5a-7b65e7540a0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 22:10:53.392617 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85a3aa5-e0e5-4d97-b4dd-c0669374f18a None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:53.398145 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-965dafe5-7b6f-4b4f-8a5a-7b65e7540a0e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 20 22:10:53.398145 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:10:53.398145 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:10:53.398145 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:10:53.398145 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:10:53.398145 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:10:53.398145 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:10:53.398145 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:10:53.398145 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:10:53.398145 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:10:53.398145 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:10:53.398145 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:10:53.398145 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 22:10:53.398145 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 22:10:53.398145 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 22:10:53.398145 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 22:10:53.399086 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 22:10:53.399086 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 22:10:53.399086 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 22:10:53.399086 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 22:10:53.399086 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:10:53.399086 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:10:53.399086 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:10:53.399086 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:10:53.399086 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:10:53.399086 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:10:53.399086 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:10:53.399086 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:10:53.399086 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:10:53.399086 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:10:53.399086 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:10:53.399086 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:10:53.399863 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:10:53.399863 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:10:53.399863 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:10:53.399863 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:10:53.399863 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 22:10:53.399863 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 22:10:53.399863 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 22:10:53.399863 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 22:10:53.399863 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 22:10:53.399863 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 22:10:53.399863 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 20 22:10:53.399863 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:10:53.404953 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 252/490] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Sep 20 22:10:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:10:53.405942 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965dafe5-7b6f-4b4f-8a5a-7b65e7540a0e None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:53.435483 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e225d0-70c0-4ebc-aa8d-66d594ad4e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:53.436451 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e225d0-70c0-4ebc-aa8d-66d594ad4e9b None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:53.437013 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e225d0-70c0-4ebc-aa8d-66d594ad4e9b None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:53.437584 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e225d0-70c0-4ebc-aa8d-66d594ad4e9b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:53.449978 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e225d0-70c0-4ebc-aa8d-66d594ad4e9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:53.451748 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e225d0-70c0-4ebc-aa8d-66d594ad4e9b None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:53.468710 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-05e225d0-70c0-4ebc-aa8d-66d594ad4e9b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:10:53.468710 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:10:53.468710 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:10:53.468710 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:10:53.468710 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:10:53.468710 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:10:53.468710 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:10:53.468710 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:10:53.468710 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:10:53.468710 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:10:53.468710 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:10:53.468710 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:10:53.468710 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 22:10:53.468710 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 22:10:53.468710 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 22:10:53.468710 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 22:10:53.469693 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:10:53.469693 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:10:53.469693 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:10:53.469693 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:10:53.469693 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:10:53.469693 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:10:53.469693 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:10:53.469693 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:10:53.469693 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:10:53.469693 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:10:53.469693 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:10:53.469693 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:10:53.469693 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:10:53.469693 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:10:53.469693 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:10:53.469693 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:10:53.469693 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 22:10:53.470536 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 22:10:53.470536 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:10:53.470536 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:10:53.472498 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 239/491] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 20 22:10:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:10:53.473481 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e225d0-70c0-4ebc-aa8d-66d594ad4e9b None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:53.517659 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:53.523527 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965dafe5-7b6f-4b4f-8a5a-7b65e7540a0e None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:53.559536 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d476a9-13c1-419c-81be-163546fe454e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:53.560146 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d476a9-13c1-419c-81be-163546fe454e None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:53.560428 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d476a9-13c1-419c-81be-163546fe454e None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:53.560698 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d476a9-13c1-419c-81be-163546fe454e None admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:53.561357 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d476a9-13c1-419c-81be-163546fe454e None admin] RBAC: Adding query filter params (name=service) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:10:53.561659 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d476a9-13c1-419c-81be-163546fe454e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:53.563104 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d476a9-13c1-419c-81be-163546fe454e None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:53.576203 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 253/492] 10.222.0.33 () {56 vars in 1103 bytes} [Tue Sep 20 22:10:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:53.576203 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff483818-5c2c-42b1-a01e-6561a665c999 None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:53.576203 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff483818-5c2c-42b1-a01e-6561a665c999 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:53.576203 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff483818-5c2c-42b1-a01e-6561a665c999 None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:53.578829 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 254/493] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:10:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:10:53.579584 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff483818-5c2c-42b1-a01e-6561a665c999 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:53.588483 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e225d0-70c0-4ebc-aa8d-66d594ad4e9b None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:53.606674 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:53.623669 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7d716e-0e79-4235-843d-ced548e092b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:53.624278 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7d716e-0e79-4235-843d-ced548e092b0 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:53.624967 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7d716e-0e79-4235-843d-ced548e092b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:53.625247 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7d716e-0e79-4235-843d-ced548e092b0 None admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:53.625917 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7d716e-0e79-4235-843d-ced548e092b0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:10:53.626226 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7d716e-0e79-4235-843d-ced548e092b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:53.628290 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7d716e-0e79-4235-843d-ced548e092b0 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:53.641985 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 240/494] 10.222.0.33 () {56 vars in 1103 bytes} [Tue Sep 20 22:10:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:53.641985 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7d716e-0e79-4235-843d-ced548e092b0 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:53.695994 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff483818-5c2c-42b1-a01e-6561a665c999 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:53.735052 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768f5871-afdc-4e91-9973-5a380b55aaaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:53.735650 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768f5871-afdc-4e91-9973-5a380b55aaaf None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:53.735930 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768f5871-afdc-4e91-9973-5a380b55aaaf None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:53.736196 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768f5871-afdc-4e91-9973-5a380b55aaaf None admin] PATH_INFO: `/v3/domains` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:53.736830 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768f5871-afdc-4e91-9973-5a380b55aaaf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:10:53.737127 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768f5871-afdc-4e91-9973-5a380b55aaaf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:53.738474 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768f5871-afdc-4e91-9973-5a380b55aaaf None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:53.749163 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7d716e-0e79-4235-843d-ced548e092b0 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:53.749866 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 255/495] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 20 22:10:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:53.751098 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3d61f5-368e-4ac0-acf0-2e917cecdfa1 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:53.751375 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3d61f5-368e-4ac0-acf0-2e917cecdfa1 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:53.751641 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3d61f5-368e-4ac0-acf0-2e917cecdfa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:53.755238 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:53.770204 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-1f3d61f5-368e-4ac0-acf0-2e917cecdfa1 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:10:53.771423 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-1f3d61f5-368e-4ac0-acf0-2e917cecdfa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:10:53.793365 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e3d360-5742-4a42-be9f-22f4d50d9067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:53.794277 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e3d360-5742-4a42-be9f-22f4d50d9067 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:53.794624 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e3d360-5742-4a42-be9f-22f4d50d9067 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:53.795026 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e3d360-5742-4a42-be9f-22f4d50d9067 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:53.807185 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e3d360-5742-4a42-be9f-22f4d50d9067 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:53.808711 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e3d360-5742-4a42-be9f-22f4d50d9067 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:53.823844 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-33e3d360-5742-4a42-be9f-22f4d50d9067 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:10:53.823844 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:10:53.823844 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:10:53.823844 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:10:53.823844 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:10:53.823844 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:10:53.823844 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:10:53.823844 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:10:53.823844 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:10:53.823844 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:10:53.823844 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:10:53.823844 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:10:53.823844 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 22:10:53.823844 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 22:10:53.823844 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 22:10:53.823844 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 22:10:53.824871 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:10:53.824871 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:10:53.824871 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:10:53.824871 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:10:53.824871 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:10:53.824871 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:10:53.824871 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:10:53.824871 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:10:53.824871 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:10:53.824871 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:10:53.824871 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:10:53.824871 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:10:53.824871 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:10:53.824871 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:10:53.824871 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:10:53.824871 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:10:53.824871 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 22:10:53.825728 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 22:10:53.825728 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:10:53.825728 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:10:53.825728 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 241/496] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 20 22:10:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:10:53.825728 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e3d360-5742-4a42-be9f-22f4d50d9067 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:53.842255 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 256/497] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:10:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 22:10:53.843064 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3d61f5-368e-4ac0-acf0-2e917cecdfa1 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:53.861409 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:53.934800 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e3d360-5742-4a42-be9f-22f4d50d9067 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:53.951732 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3d61f5-368e-4ac0-acf0-2e917cecdfa1 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:53.968997 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69ce2a8-cbf6-4445-b4f4-eea732f8bc3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:53.969930 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ce2a8-cbf6-4445-b4f4-eea732f8bc3f None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:53.970207 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ce2a8-cbf6-4445-b4f4-eea732f8bc3f None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:53.970470 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ce2a8-cbf6-4445-b4f4-eea732f8bc3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:53.981065 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69ce2a8-cbf6-4445-b4f4-eea732f8bc3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:53.982528 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69ce2a8-cbf6-4445-b4f4-eea732f8bc3f None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:53.986785 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6143bc46-3f4a-44eb-ae65-33bc90b3132a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:53.987680 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6143bc46-3f4a-44eb-ae65-33bc90b3132a None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:53.987960 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6143bc46-3f4a-44eb-ae65-33bc90b3132a None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:53.988226 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6143bc46-3f4a-44eb-ae65-33bc90b3132a None admin] PATH_INFO: `/v3/users/nova` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:53.996201 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6143bc46-3f4a-44eb-ae65-33bc90b3132a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:53.997617 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6143bc46-3f4a-44eb-ae65-33bc90b3132a None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:53.999864 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-d69ce2a8-cbf6-4445-b4f4-eea732f8bc3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:10:53.999864 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:10:53.999864 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:10:53.999864 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:10:53.999864 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:10:53.999864 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:10:53.999864 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:10:53.999864 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:10:53.999864 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:10:53.999864 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:10:53.999864 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:10:53.999864 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:10:53.999864 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 22:10:53.999864 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 22:10:53.999864 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 22:10:53.999864 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 22:10:54.000705 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:10:54.000705 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:10:54.000705 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:10:54.000705 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:10:54.000705 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:10:54.000705 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:10:54.000705 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:10:54.000705 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:10:54.000705 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:10:54.000705 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:10:54.000705 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:10:54.000705 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:10:54.000705 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:10:54.000705 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:10:54.000705 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:10:54.000705 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:10:54.000705 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 22:10:54.001572 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 22:10:54.001572 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:10:54.001572 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:10:54.001572 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 242/498] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 20 22:10:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:10:54.002641 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4adc0b-fb8c-4929-a81f-4787c64aa60c None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:54.002641 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4adc0b-fb8c-4929-a81f-4787c64aa60c None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:54.002808 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4adc0b-fb8c-4929-a81f-4787c64aa60c None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:54.004172 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 243/499] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:10:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:10:54.004769 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4adc0b-fb8c-4929-a81f-4787c64aa60c None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:54.017207 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:54.022147 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-6143bc46-3f4a-44eb-ae65-33bc90b3132a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 20 22:10:54.022147 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:10:54.022147 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:10:54.022147 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:10:54.022147 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:10:54.022147 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:10:54.022147 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:10:54.022147 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:10:54.022147 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:10:54.022147 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:10:54.022147 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:10:54.022147 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:10:54.022147 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 20 22:10:54.022147 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 20 22:10:54.022147 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 20 22:10:54.022147 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 20 22:10:54.023111 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:10:54.023111 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:10:54.023111 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 20 22:10:54.023111 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 22:10:54.023111 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 20 22:10:54.023111 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 22:10:54.023111 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:10:54.023111 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:10:54.023111 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:10:54.023111 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:10:54.023111 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:10:54.023111 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:10:54.023111 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:10:54.023111 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:10:54.023111 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:10:54.023111 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:10:54.023111 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:10:54.023111 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:10:54.023997 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:10:54.023997 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:10:54.023997 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 20 22:10:54.023997 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 20 22:10:54.023997 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 20 22:10:54.023997 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 20 22:10:54.023997 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 20 22:10:54.023997 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 20 22:10:54.023997 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 20 22:10:54.023997 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:10:54.023997 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 257/500] 10.222.0.33 () {56 vars in 1093 bytes} [Tue Sep 20 22:10:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:10:54.024554 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6143bc46-3f4a-44eb-ae65-33bc90b3132a None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:54.104621 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:54.126798 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4adc0b-fb8c-4929-a81f-4787c64aa60c None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:54.132985 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6143bc46-3f4a-44eb-ae65-33bc90b3132a None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:54.159952 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293fa965-4a31-4186-9fe4-6439bb544374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:54.160553 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293fa965-4a31-4186-9fe4-6439bb544374 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:54.160826 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293fa965-4a31-4186-9fe4-6439bb544374 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:54.161099 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293fa965-4a31-4186-9fe4-6439bb544374 None admin] PATH_INFO: `/v3/domains` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:54.161728 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293fa965-4a31-4186-9fe4-6439bb544374 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:10:54.162027 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293fa965-4a31-4186-9fe4-6439bb544374 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:54.163957 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293fa965-4a31-4186-9fe4-6439bb544374 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:54.166079 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e08a7f7-364e-4bba-95ce-d439e8482630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:54.166699 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e08a7f7-364e-4bba-95ce-d439e8482630 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:54.166976 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e08a7f7-364e-4bba-95ce-d439e8482630 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:54.167247 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e08a7f7-364e-4bba-95ce-d439e8482630 None admin] PATH_INFO: `/v3/domains` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:54.167878 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e08a7f7-364e-4bba-95ce-d439e8482630 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:10:54.168178 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e08a7f7-364e-4bba-95ce-d439e8482630 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:54.169527 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e08a7f7-364e-4bba-95ce-d439e8482630 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:54.174920 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 244/501] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 20 22:10:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:54.176049 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c2ce6-689b-4f27-8fb0-9295d71a43c8 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:54.176331 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c2ce6-689b-4f27-8fb0-9295d71a43c8 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:54.176601 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c2ce6-689b-4f27-8fb0-9295d71a43c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:54.185744 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 258/502] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 20 22:10:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:54.186582 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e08a7f7-364e-4bba-95ce-d439e8482630 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:54.195333 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-6d5c2ce6-689b-4f27-8fb0-9295d71a43c8 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:10:54.196531 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-6d5c2ce6-689b-4f27-8fb0-9295d71a43c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:10:54.255624 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:54.263265 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 245/503] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:10:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 22:10:54.264059 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5c2ce6-689b-4f27-8fb0-9295d71a43c8 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:54.285835 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e08a7f7-364e-4bba-95ce-d439e8482630 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:54.323936 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9b846b-68e7-46bf-a2a4-0e996f0cdc83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:54.324628 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9b846b-68e7-46bf-a2a4-0e996f0cdc83 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:54.324983 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9b846b-68e7-46bf-a2a4-0e996f0cdc83 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:54.325331 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9b846b-68e7-46bf-a2a4-0e996f0cdc83 None admin] PATH_INFO: `/v3/users` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:54.326159 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9b846b-68e7-46bf-a2a4-0e996f0cdc83 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:10:54.326705 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9b846b-68e7-46bf-a2a4-0e996f0cdc83 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:54.328048 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9b846b-68e7-46bf-a2a4-0e996f0cdc83 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:54.330118 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:54.365619 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 259/504] 10.222.0.33 () {56 vars in 1133 bytes} [Tue Sep 20 22:10:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:54.367248 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9b846b-68e7-46bf-a2a4-0e996f0cdc83 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:54.382905 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5c2ce6-689b-4f27-8fb0-9295d71a43c8 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:54.417334 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceb35b6-071d-4329-a7e0-08f1bed58493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:54.417960 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceb35b6-071d-4329-a7e0-08f1bed58493 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:54.418236 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceb35b6-071d-4329-a7e0-08f1bed58493 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:54.418523 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceb35b6-071d-4329-a7e0-08f1bed58493 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:54.430111 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ceb35b6-071d-4329-a7e0-08f1bed58493 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:54.431603 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ceb35b6-071d-4329-a7e0-08f1bed58493 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:54.446084 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-0ceb35b6-071d-4329-a7e0-08f1bed58493 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:10:54.446084 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:10:54.446084 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:10:54.446084 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:10:54.446084 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:10:54.446084 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:10:54.446084 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:10:54.446084 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:10:54.446084 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:10:54.446084 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:10:54.446084 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:10:54.446084 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:10:54.446084 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 22:10:54.446084 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 22:10:54.446084 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 22:10:54.446084 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 22:10:54.447092 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:10:54.447092 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:10:54.447092 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:10:54.447092 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:10:54.447092 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:10:54.447092 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:10:54.447092 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:10:54.447092 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:10:54.447092 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:10:54.447092 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:10:54.447092 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:10:54.447092 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:10:54.447092 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:10:54.447092 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:10:54.447092 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:10:54.447092 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:10:54.447092 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 22:10:54.448034 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 22:10:54.448034 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:10:54.448034 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:10:54.448034 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 246/505] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 20 22:10:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:10:54.448034 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceb35b6-071d-4329-a7e0-08f1bed58493 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:54.478141 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9b846b-68e7-46bf-a2a4-0e996f0cdc83 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:54.498223 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:54.514107 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05569d6-1415-49a0-9f5d-303b2a6b2342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:54.514707 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05569d6-1415-49a0-9f5d-303b2a6b2342 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:54.514988 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05569d6-1415-49a0-9f5d-303b2a6b2342 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:54.515258 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05569d6-1415-49a0-9f5d-303b2a6b2342 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:54.523212 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05569d6-1415-49a0-9f5d-303b2a6b2342 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:54.524660 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05569d6-1415-49a0-9f5d-303b2a6b2342 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:54.536460 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-f05569d6-1415-49a0-9f5d-303b2a6b2342 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 20 22:10:54.536460 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:10:54.536460 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:10:54.536460 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:10:54.536460 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:10:54.536460 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:10:54.536460 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:10:54.536460 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:10:54.536460 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:10:54.536460 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:10:54.536460 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:10:54.536460 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:10:54.536460 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 20 22:10:54.536460 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 20 22:10:54.536460 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 20 22:10:54.536460 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 20 22:10:54.537354 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:10:54.537354 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:10:54.537354 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 20 22:10:54.537354 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 22:10:54.537354 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 20 22:10:54.537354 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 22:10:54.537354 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:10:54.537354 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:10:54.537354 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:10:54.537354 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:10:54.537354 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:10:54.537354 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:10:54.537354 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:10:54.537354 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:10:54.537354 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:10:54.537354 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:10:54.537354 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:10:54.537354 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:10:54.538839 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:10:54.538839 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:10:54.538839 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 20 22:10:54.538839 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 20 22:10:54.538839 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 20 22:10:54.538839 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 20 22:10:54.538839 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 20 22:10:54.538839 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 20 22:10:54.538839 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 20 22:10:54.538839 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:10:54.538839 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 260/506] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 20 22:10:54 2022] GET /identity/v3/users/glance => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:10:54.538839 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05569d6-1415-49a0-9f5d-303b2a6b2342 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:54.559551 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceb35b6-071d-4329-a7e0-08f1bed58493 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:54.590576 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:54.592570 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c908644-7e23-4350-94ae-e824a5d38580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:54.593327 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c908644-7e23-4350-94ae-e824a5d38580 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:54.593606 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c908644-7e23-4350-94ae-e824a5d38580 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:54.593880 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c908644-7e23-4350-94ae-e824a5d38580 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:54.601731 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c908644-7e23-4350-94ae-e824a5d38580 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:54.603181 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c908644-7e23-4350-94ae-e824a5d38580 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:54.615334 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-5c908644-7e23-4350-94ae-e824a5d38580 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 20 22:10:54.615334 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:10:54.615334 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:10:54.615334 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:10:54.615334 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:10:54.615334 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:10:54.615334 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:10:54.615334 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:10:54.615334 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:10:54.615334 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:10:54.615334 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:10:54.615334 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:10:54.615334 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 20 22:10:54.615334 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 20 22:10:54.615334 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 20 22:10:54.615334 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 20 22:10:54.616442 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:10:54.616442 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:10:54.616442 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 20 22:10:54.616442 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 22:10:54.616442 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 20 22:10:54.616442 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 22:10:54.616442 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:10:54.616442 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:10:54.616442 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:10:54.616442 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:10:54.616442 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:10:54.616442 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:10:54.616442 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:10:54.616442 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:10:54.616442 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:10:54.616442 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:10:54.616442 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:10:54.616442 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:10:54.617345 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:10:54.617345 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:10:54.617345 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 20 22:10:54.617345 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 20 22:10:54.617345 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 20 22:10:54.617345 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 20 22:10:54.617345 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 20 22:10:54.617345 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 20 22:10:54.617345 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 20 22:10:54.617345 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:10:54.617345 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 247/507] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 20 22:10:54 2022] GET /identity/v3/users/cinder => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:10:54.617345 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c908644-7e23-4350-94ae-e824a5d38580 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:54.641730 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05569d6-1415-49a0-9f5d-303b2a6b2342 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:54.676643 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f865e72f-a0ff-49ed-a071-486928166575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:54.677326 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f865e72f-a0ff-49ed-a071-486928166575 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:54.677601 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f865e72f-a0ff-49ed-a071-486928166575 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:54.677869 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f865e72f-a0ff-49ed-a071-486928166575 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:54.715728 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c908644-7e23-4350-94ae-e824a5d38580 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:54.724204 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:54.744922 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f865e72f-a0ff-49ed-a071-486928166575 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:54.746388 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f865e72f-a0ff-49ed-a071-486928166575 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:54.750122 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acb31fa-bc63-4468-a380-41d383dbd398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:54.750748 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acb31fa-bc63-4468-a380-41d383dbd398 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:54.751027 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acb31fa-bc63-4468-a380-41d383dbd398 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:54.751295 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acb31fa-bc63-4468-a380-41d383dbd398 None admin] PATH_INFO: `/v3/domains` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:54.751931 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acb31fa-bc63-4468-a380-41d383dbd398 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:10:54.752231 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acb31fa-bc63-4468-a380-41d383dbd398 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:54.753594 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acb31fa-bc63-4468-a380-41d383dbd398 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:54.765083 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 248/508] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 20 22:10:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:54.765802 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acb31fa-bc63-4468-a380-41d383dbd398 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:54.800393 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:54.847604 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 261/509] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 20 22:10:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 20 22:10:54.848597 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f865e72f-a0ff-49ed-a071-486928166575 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:54.868451 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acb31fa-bc63-4468-a380-41d383dbd398 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:54.902381 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b8d067-e16c-4afc-8894-3c88acfbeb47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:54.903104 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b8d067-e16c-4afc-8894-3c88acfbeb47 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:54.903387 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b8d067-e16c-4afc-8894-3c88acfbeb47 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:54.903658 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b8d067-e16c-4afc-8894-3c88acfbeb47 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:54.914249 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b8d067-e16c-4afc-8894-3c88acfbeb47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 22:10:54.919056 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-89b8d067-e16c-4afc-8894-3c88acfbeb47 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 20 22:10:54.919056 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:10:54.919056 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:10:54.919056 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:10:54.919056 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:10:54.919056 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:10:54.919056 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:10:54.919056 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:10:54.919056 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:10:54.919056 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:10:54.919056 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:10:54.919056 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:10:54.919056 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 22:10:54.919056 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 22:10:54.919056 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 22:10:54.919056 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 22:10:54.920116 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 22:10:54.920116 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 22:10:54.920116 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 22:10:54.920116 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 22:10:54.920116 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:10:54.920116 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:10:54.920116 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:10:54.920116 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:10:54.920116 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:10:54.920116 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:10:54.920116 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:10:54.920116 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:10:54.920116 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:10:54.920116 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:10:54.920116 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:10:54.920116 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:10:54.923908 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:10:54.923908 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:10:54.923908 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:10:54.923908 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:10:54.923908 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 22:10:54.923908 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 22:10:54.923908 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 22:10:54.923908 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 22:10:54.923908 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 22:10:54.923908 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 22:10:54.923908 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 20 22:10:54.923908 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:10:54.923908 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 249/510] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Sep 20 22:10:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:10:54.923908 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b8d067-e16c-4afc-8894-3c88acfbeb47 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:54.949757 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:54.949895 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f865e72f-a0ff-49ed-a071-486928166575 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:54.983309 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e932bee9-cb1f-4187-813a-d6c7739feff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:54.983909 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e932bee9-cb1f-4187-813a-d6c7739feff8 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:54.984183 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e932bee9-cb1f-4187-813a-d6c7739feff8 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:54.984459 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e932bee9-cb1f-4187-813a-d6c7739feff8 None admin] PATH_INFO: `/v3/users` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:54.985170 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e932bee9-cb1f-4187-813a-d6c7739feff8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:10:54.985471 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e932bee9-cb1f-4187-813a-d6c7739feff8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:54.986907 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e932bee9-cb1f-4187-813a-d6c7739feff8 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:55.003553 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 262/511] 10.222.0.33 () {56 vars in 1137 bytes} [Tue Sep 20 22:10:54 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:55.004373 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e932bee9-cb1f-4187-813a-d6c7739feff8 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:55.016538 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:55.019853 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b8d067-e16c-4afc-8894-3c88acfbeb47 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:55.053140 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05b97c4-d7ff-48dc-bee9-1362d44280c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:55.053938 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05b97c4-d7ff-48dc-bee9-1362d44280c4 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:55.054067 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05b97c4-d7ff-48dc-bee9-1362d44280c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:55.054268 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05b97c4-d7ff-48dc-bee9-1362d44280c4 None admin] PATH_INFO: `/v3/users` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:55.055284 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05b97c4-d7ff-48dc-bee9-1362d44280c4 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:10:55.055587 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05b97c4-d7ff-48dc-bee9-1362d44280c4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:55.057028 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05b97c4-d7ff-48dc-bee9-1362d44280c4 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:55.092797 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 250/512] 10.222.0.33 () {56 vars in 1137 bytes} [Tue Sep 20 22:10:54 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:55.093600 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05b97c4-d7ff-48dc-bee9-1362d44280c4 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:55.105904 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e932bee9-cb1f-4187-813a-d6c7739feff8 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:55.139478 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138d614c-bde7-4940-a7dc-1bbd7ca252ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:55.140074 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138d614c-bde7-4940-a7dc-1bbd7ca252ac None admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:55.140345 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138d614c-bde7-4940-a7dc-1bbd7ca252ac None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:55.140609 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138d614c-bde7-4940-a7dc-1bbd7ca252ac None admin] PATH_INFO: `/v3/users` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:55.141240 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138d614c-bde7-4940-a7dc-1bbd7ca252ac None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:55.142670 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138d614c-bde7-4940-a7dc-1bbd7ca252ac None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:55.164177 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 263/513] 10.222.0.33 () {60 vars in 1132 bytes} [Tue Sep 20 22:10:55 2022] POST /identity/v3/users => generated 247 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:10:55.164967 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138d614c-bde7-4940-a7dc-1bbd7ca252ac None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:55.184448 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:55.202803 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05b97c4-d7ff-48dc-bee9-1362d44280c4 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:55.239894 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b2fb56-8c77-48ea-aaa0-58a5979e914a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:55.240695 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b2fb56-8c77-48ea-aaa0-58a5979e914a None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:55.240975 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b2fb56-8c77-48ea-aaa0-58a5979e914a None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:55.241247 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b2fb56-8c77-48ea-aaa0-58a5979e914a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:55.251624 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:55.252714 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b2fb56-8c77-48ea-aaa0-58a5979e914a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:55.254637 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b2fb56-8c77-48ea-aaa0-58a5979e914a None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:55.271627 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-64b2fb56-8c77-48ea-aaa0-58a5979e914a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:10:55.271627 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:10:55.271627 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:10:55.271627 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:10:55.271627 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:10:55.271627 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:10:55.271627 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:10:55.271627 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:10:55.271627 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:10:55.271627 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:10:55.271627 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:10:55.271627 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:10:55.271627 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 22:10:55.271627 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 22:10:55.271627 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 22:10:55.271627 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 22:10:55.273234 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:10:55.273234 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:10:55.273234 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:10:55.273234 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:10:55.273234 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:10:55.273234 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:10:55.273234 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:10:55.273234 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:10:55.273234 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:10:55.273234 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:10:55.273234 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:10:55.273234 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:10:55.273234 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:10:55.273234 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:10:55.273234 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:10:55.273234 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:10:55.273234 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 22:10:55.274865 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 22:10:55.274865 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:10:55.274865 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:10:55.274865 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 251/514] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 20 22:10:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:10:55.274865 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b2fb56-8c77-48ea-aaa0-58a5979e914a None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:55.308181 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138d614c-bde7-4940-a7dc-1bbd7ca252ac None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:55.347943 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7478c114-4ce5-4262-b4a1-f933784ab198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:55.348586 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7478c114-4ce5-4262-b4a1-f933784ab198 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:55.348817 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7478c114-4ce5-4262-b4a1-f933784ab198 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:55.349082 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7478c114-4ce5-4262-b4a1-f933784ab198 None admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:55.349766 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7478c114-4ce5-4262-b4a1-f933784ab198 None admin] RBAC: Adding query filter params (name=service) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:10:55.350117 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7478c114-4ce5-4262-b4a1-f933784ab198 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:55.352177 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7478c114-4ce5-4262-b4a1-f933784ab198 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:55.360326 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 264/515] 10.222.0.33 () {56 vars in 1103 bytes} [Tue Sep 20 22:10:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:55.361367 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7478c114-4ce5-4262-b4a1-f933784ab198 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:55.400342 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b2fb56-8c77-48ea-aaa0-58a5979e914a None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:55.436504 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b805404-1a3f-4bfa-9556-e0d284946830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:55.437114 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b805404-1a3f-4bfa-9556-e0d284946830 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:55.437389 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b805404-1a3f-4bfa-9556-e0d284946830 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:55.437658 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b805404-1a3f-4bfa-9556-e0d284946830 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:55.446471 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:55.472287 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7478c114-4ce5-4262-b4a1-f933784ab198 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:55.500044 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:55.509631 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b805404-1a3f-4bfa-9556-e0d284946830 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:55.510389 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58300a03-f999-499b-9407-7aa01d46ea9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:55.511024 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58300a03-f999-499b-9407-7aa01d46ea9e None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:55.511123 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b805404-1a3f-4bfa-9556-e0d284946830 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:55.511300 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58300a03-f999-499b-9407-7aa01d46ea9e None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:55.511569 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58300a03-f999-499b-9407-7aa01d46ea9e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:55.584534 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58300a03-f999-499b-9407-7aa01d46ea9e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:55.585924 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58300a03-f999-499b-9407-7aa01d46ea9e None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:55.619001 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 252/516] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 20 22:10:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 20 22:10:55.620439 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b805404-1a3f-4bfa-9556-e0d284946830 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:55.660698 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:55.688395 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 265/517] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 20 22:10:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 20 22:10:55.689247 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58300a03-f999-499b-9407-7aa01d46ea9e None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:55.718572 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:55.737895 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b805404-1a3f-4bfa-9556-e0d284946830 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:55.772658 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fb3dc5-9290-4816-9fac-557b2143e69f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:55.773264 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fb3dc5-9290-4816-9fac-557b2143e69f None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:55.773537 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fb3dc5-9290-4816-9fac-557b2143e69f None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:55.773810 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fb3dc5-9290-4816-9fac-557b2143e69f None admin] PATH_INFO: `/v3/domains` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:55.774447 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fb3dc5-9290-4816-9fac-557b2143e69f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:10:55.774789 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fb3dc5-9290-4816-9fac-557b2143e69f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:55.776152 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fb3dc5-9290-4816-9fac-557b2143e69f None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:55.788618 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 253/518] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 20 22:10:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:55.789591 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fb3dc5-9290-4816-9fac-557b2143e69f None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:55.801465 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58300a03-f999-499b-9407-7aa01d46ea9e None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:55.836456 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e667ec9c-730b-4f1d-9c86-dd43379642a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:55.837082 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e667ec9c-730b-4f1d-9c86-dd43379642a0 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:55.837366 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e667ec9c-730b-4f1d-9c86-dd43379642a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:55.837641 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e667ec9c-730b-4f1d-9c86-dd43379642a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:55.847900 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e667ec9c-730b-4f1d-9c86-dd43379642a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:55.849326 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e667ec9c-730b-4f1d-9c86-dd43379642a0 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:55.866845 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-e667ec9c-730b-4f1d-9c86-dd43379642a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:10:55.866845 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:10:55.866845 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:10:55.866845 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:10:55.866845 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:10:55.866845 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:10:55.866845 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:10:55.866845 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:10:55.866845 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:10:55.866845 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:10:55.866845 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:10:55.866845 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:10:55.866845 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 22:10:55.866845 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 22:10:55.866845 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 22:10:55.866845 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 22:10:55.867750 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:10:55.867750 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:10:55.867750 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:10:55.867750 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:10:55.867750 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:10:55.867750 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:10:55.867750 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:10:55.867750 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:10:55.867750 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:10:55.867750 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:10:55.867750 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:10:55.867750 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:10:55.867750 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:10:55.867750 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:10:55.867750 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:10:55.867750 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:10:55.867750 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 22:10:55.868588 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 22:10:55.868588 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:10:55.868588 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:10:55.872844 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 266/519] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 20 22:10:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:10:55.873215 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e667ec9c-730b-4f1d-9c86-dd43379642a0 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:55.891234 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:55.895629 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fb3dc5-9290-4816-9fac-557b2143e69f None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:55.931497 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5f378d-5b0c-4d95-b0dc-2a960b67a2cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:55.932210 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5f378d-5b0c-4d95-b0dc-2a960b67a2cc None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:55.932629 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5f378d-5b0c-4d95-b0dc-2a960b67a2cc None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:55.933144 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5f378d-5b0c-4d95-b0dc-2a960b67a2cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:55.945869 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5f378d-5b0c-4d95-b0dc-2a960b67a2cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:55.947344 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5f378d-5b0c-4d95-b0dc-2a960b67a2cc None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:55.961408 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-0e5f378d-5b0c-4d95-b0dc-2a960b67a2cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:10:55.961408 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:10:55.961408 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:10:55.961408 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:10:55.961408 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:10:55.961408 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:10:55.961408 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:10:55.961408 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:10:55.961408 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:10:55.961408 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:10:55.961408 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:10:55.961408 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:10:55.961408 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 22:10:55.961408 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 22:10:55.961408 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 22:10:55.961408 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 22:10:55.962374 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:10:55.962374 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:10:55.962374 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:10:55.962374 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:10:55.962374 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:10:55.962374 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:10:55.962374 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:10:55.962374 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:10:55.962374 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:10:55.962374 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:10:55.962374 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:10:55.962374 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:10:55.962374 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:10:55.962374 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:10:55.962374 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:10:55.962374 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:10:55.962374 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 22:10:55.963242 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 22:10:55.963242 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:10:55.963242 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:10:55.963242 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 254/520] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 20 22:10:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:10:55.963800 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5f378d-5b0c-4d95-b0dc-2a960b67a2cc None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:55.969151 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:55.992345 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e667ec9c-730b-4f1d-9c86-dd43379642a0 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:56.027951 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86597e30-7036-4ab2-a88d-b8e5279f26d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:56.028574 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86597e30-7036-4ab2-a88d-b8e5279f26d2 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:56.028851 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86597e30-7036-4ab2-a88d-b8e5279f26d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:56.029123 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86597e30-7036-4ab2-a88d-b8e5279f26d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:56.040995 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86597e30-7036-4ab2-a88d-b8e5279f26d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:56.042422 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86597e30-7036-4ab2-a88d-b8e5279f26d2 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:56.061653 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-86597e30-7036-4ab2-a88d-b8e5279f26d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:10:56.061653 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:10:56.061653 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:10:56.061653 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:10:56.061653 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:10:56.061653 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:10:56.061653 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:10:56.061653 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:10:56.061653 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:10:56.061653 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:10:56.061653 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:10:56.061653 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:10:56.061653 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 22:10:56.061653 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 22:10:56.061653 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 22:10:56.061653 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 22:10:56.062634 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:10:56.062634 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:10:56.062634 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:10:56.062634 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:10:56.062634 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:10:56.062634 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:10:56.062634 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:10:56.062634 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:10:56.062634 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:10:56.062634 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:10:56.062634 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:10:56.062634 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:10:56.062634 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:10:56.062634 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:10:56.062634 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:10:56.062634 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:10:56.062634 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 22:10:56.063489 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 22:10:56.063489 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:10:56.063489 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:10:56.063489 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 267/521] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 20 22:10:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:10:56.063711 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86597e30-7036-4ab2-a88d-b8e5279f26d2 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:56.072172 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5f378d-5b0c-4d95-b0dc-2a960b67a2cc None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:56.110480 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c65f59-b1b0-4c2b-8f93-b20635ca9bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:56.111031 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c65f59-b1b0-4c2b-8f93-b20635ca9bc9 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:56.111301 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c65f59-b1b0-4c2b-8f93-b20635ca9bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:56.111568 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c65f59-b1b0-4c2b-8f93-b20635ca9bc9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:56.121935 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c65f59-b1b0-4c2b-8f93-b20635ca9bc9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:56.123445 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c65f59-b1b0-4c2b-8f93-b20635ca9bc9 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:56.140588 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-79c65f59-b1b0-4c2b-8f93-b20635ca9bc9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 22:10:56.140588 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:10:56.140588 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:10:56.140588 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:10:56.140588 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:10:56.140588 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:10:56.140588 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:10:56.140588 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:10:56.140588 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:10:56.140588 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:10:56.140588 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:10:56.140588 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:10:56.140588 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 20 22:10:56.140588 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 20 22:10:56.140588 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 20 22:10:56.141458 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 20 22:10:56.141458 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:10:56.141458 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:10:56.141458 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:10:56.141458 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:10:56.141458 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:10:56.141458 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:10:56.141458 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:10:56.141458 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:10:56.141458 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:10:56.141458 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:10:56.141458 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:10:56.141458 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:10:56.141458 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:10:56.141458 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:10:56.141458 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:10:56.141458 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:10:56.142471 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 20 22:10:56.142471 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 20 22:10:56.142471 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 20 22:10:56.142471 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 20 22:10:56.142471 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 20 22:10:56.142471 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 20 22:10:56.142471 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 22:10:56.142471 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:10:56.142471 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 255/522] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Sep 20 22:10:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:10:56.143944 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c65f59-b1b0-4c2b-8f93-b20635ca9bc9 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:56.156096 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:56.183739 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86597e30-7036-4ab2-a88d-b8e5279f26d2 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:56.215621 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:56.221416 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003dc9b6-0dc4-4ab5-ab36-bbcf443b4af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:56.222263 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003dc9b6-0dc4-4ab5-ab36-bbcf443b4af2 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:56.222841 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003dc9b6-0dc4-4ab5-ab36-bbcf443b4af2 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:56.223507 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003dc9b6-0dc4-4ab5-ab36-bbcf443b4af2 None admin] PATH_INFO: `/v3/domains` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:56.223854 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003dc9b6-0dc4-4ab5-ab36-bbcf443b4af2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:10:56.224158 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003dc9b6-0dc4-4ab5-ab36-bbcf443b4af2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:56.226224 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003dc9b6-0dc4-4ab5-ab36-bbcf443b4af2 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:56.245009 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 268/523] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 20 22:10:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:56.245009 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003dc9b6-0dc4-4ab5-ab36-bbcf443b4af2 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:56.252063 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c65f59-b1b0-4c2b-8f93-b20635ca9bc9 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:56.285507 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d8ec11-5e43-4f07-90ee-41214027a932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:56.286112 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d8ec11-5e43-4f07-90ee-41214027a932 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:56.286395 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d8ec11-5e43-4f07-90ee-41214027a932 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:56.286724 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d8ec11-5e43-4f07-90ee-41214027a932 None admin] PATH_INFO: `/v3/domains` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:56.287396 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d8ec11-5e43-4f07-90ee-41214027a932 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:10:56.288269 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d8ec11-5e43-4f07-90ee-41214027a932 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:56.289651 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d8ec11-5e43-4f07-90ee-41214027a932 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:56.307258 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 256/524] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 20 22:10:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:56.308086 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d8ec11-5e43-4f07-90ee-41214027a932 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:56.366192 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003dc9b6-0dc4-4ab5-ab36-bbcf443b4af2 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:56.379453 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:56.402442 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7431e50-0772-45ae-9be2-771a0395e1be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:56.403077 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7431e50-0772-45ae-9be2-771a0395e1be None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:56.403356 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7431e50-0772-45ae-9be2-771a0395e1be None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:56.403632 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7431e50-0772-45ae-9be2-771a0395e1be None admin] PATH_INFO: `/v3/domains` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:56.404269 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7431e50-0772-45ae-9be2-771a0395e1be None admin] RBAC: Adding query filter params (name=Default) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:10:56.404574 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7431e50-0772-45ae-9be2-771a0395e1be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:56.406064 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7431e50-0772-45ae-9be2-771a0395e1be None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:56.414886 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d8ec11-5e43-4f07-90ee-41214027a932 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:56.418694 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 269/525] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 20 22:10:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:56.423978 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7431e50-0772-45ae-9be2-771a0395e1be None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:56.454330 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d2caf4-9efc-488b-9d1b-596edcd06496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:56.454967 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d2caf4-9efc-488b-9d1b-596edcd06496 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:56.455328 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d2caf4-9efc-488b-9d1b-596edcd06496 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:56.455578 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d2caf4-9efc-488b-9d1b-596edcd06496 None admin] PATH_INFO: `/v3/projects` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:56.456258 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d2caf4-9efc-488b-9d1b-596edcd06496 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:10:56.456556 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d2caf4-9efc-488b-9d1b-596edcd06496 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:56.457993 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d2caf4-9efc-488b-9d1b-596edcd06496 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:56.476052 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 257/526] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Sep 20 22:10:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:56.481657 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d2caf4-9efc-488b-9d1b-596edcd06496 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:56.481801 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:56.533835 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7431e50-0772-45ae-9be2-771a0395e1be None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:56.570018 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a03b332-3569-4ddb-bc09-03f01fb6a213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:56.570669 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a03b332-3569-4ddb-bc09-03f01fb6a213 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:56.570993 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a03b332-3569-4ddb-bc09-03f01fb6a213 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:56.571209 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a03b332-3569-4ddb-bc09-03f01fb6a213 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:56.579027 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a03b332-3569-4ddb-bc09-03f01fb6a213 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:56.580449 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a03b332-3569-4ddb-bc09-03f01fb6a213 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:56.590352 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d2caf4-9efc-488b-9d1b-596edcd06496 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:56.592192 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-1a03b332-3569-4ddb-bc09-03f01fb6a213 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 20 22:10:56.592192 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:10:56.592192 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:10:56.592192 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:10:56.592192 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:10:56.592192 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:10:56.592192 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:10:56.592192 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:10:56.592192 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:10:56.592192 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:10:56.592192 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:10:56.592192 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:10:56.592192 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 20 22:10:56.592192 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 20 22:10:56.592192 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 20 22:10:56.592192 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 20 22:10:56.593088 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:10:56.593088 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:10:56.593088 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 20 22:10:56.593088 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 22:10:56.593088 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 20 22:10:56.593088 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 22:10:56.593088 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:10:56.593088 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:10:56.593088 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:10:56.593088 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:10:56.593088 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:10:56.593088 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:10:56.593088 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:10:56.593088 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:10:56.593088 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:10:56.593088 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:10:56.593088 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:10:56.593088 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:10:56.594084 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:10:56.594084 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:10:56.594084 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 20 22:10:56.594084 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 20 22:10:56.594084 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 20 22:10:56.594084 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 20 22:10:56.594084 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 20 22:10:56.594084 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 20 22:10:56.594084 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 20 22:10:56.594084 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:10:56.594084 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 270/527] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Sep 20 22:10:56 2022] GET /identity/v3/users/neutron => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:10:56.594084 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a03b332-3569-4ddb-bc09-03f01fb6a213 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:56.622935 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:56.631046 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b75a921-9f26-4a1c-9a97-dc7c01241af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:56.632526 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b75a921-9f26-4a1c-9a97-dc7c01241af5 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:56.632812 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b75a921-9f26-4a1c-9a97-dc7c01241af5 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:56.633089 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b75a921-9f26-4a1c-9a97-dc7c01241af5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:56.639898 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b75a921-9f26-4a1c-9a97-dc7c01241af5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:56.641341 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b75a921-9f26-4a1c-9a97-dc7c01241af5 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:56.656840 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-3b75a921-9f26-4a1c-9a97-dc7c01241af5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 22:10:56.656840 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:10:56.656840 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:10:56.656840 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:10:56.656840 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:10:56.656840 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:10:56.656840 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:10:56.656840 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:10:56.656840 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:10:56.656840 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:10:56.656840 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:10:56.656840 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:10:56.656840 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 20 22:10:56.656840 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 20 22:10:56.656840 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 20 22:10:56.657685 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 20 22:10:56.657685 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:10:56.657685 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:10:56.657685 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:10:56.657685 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:10:56.657685 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:10:56.657685 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:10:56.657685 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:10:56.657685 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:10:56.657685 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:10:56.657685 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:10:56.657685 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:10:56.657685 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:10:56.657685 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:10:56.657685 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:10:56.657685 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:10:56.657685 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:10:56.658560 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 20 22:10:56.658560 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 20 22:10:56.658560 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 20 22:10:56.658560 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 20 22:10:56.658560 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 20 22:10:56.658560 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 20 22:10:56.658560 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 22:10:56.658560 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:10:56.658560 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 258/528] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Sep 20 22:10:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:10:56.659025 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b75a921-9f26-4a1c-9a97-dc7c01241af5 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:56.712345 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a03b332-3569-4ddb-bc09-03f01fb6a213 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:56.725673 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:56.749834 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7f7458-04b4-45a3-a676-dc3b4b8039e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:56.750871 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f7458-04b4-45a3-a676-dc3b4b8039e7 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:56.751429 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f7458-04b4-45a3-a676-dc3b4b8039e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:56.751707 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f7458-04b4-45a3-a676-dc3b4b8039e7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:56.759042 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7f7458-04b4-45a3-a676-dc3b4b8039e7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:56.761001 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7f7458-04b4-45a3-a676-dc3b4b8039e7 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:56.769380 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b75a921-9f26-4a1c-9a97-dc7c01241af5 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:56.773569 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-7b7f7458-04b4-45a3-a676-dc3b4b8039e7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 22:10:56.773569 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:10:56.773569 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:10:56.773569 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:10:56.773569 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:10:56.773569 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:10:56.773569 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:10:56.773569 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:10:56.773569 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:10:56.773569 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:10:56.773569 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:10:56.773569 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:10:56.773569 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 20 22:10:56.773569 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 20 22:10:56.773569 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 20 22:10:56.774422 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 20 22:10:56.774422 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:10:56.774422 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:10:56.774422 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:10:56.774422 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:10:56.774422 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:10:56.774422 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:10:56.774422 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:10:56.774422 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:10:56.774422 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:10:56.774422 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:10:56.774422 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:10:56.774422 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:10:56.774422 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:10:56.774422 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:10:56.774422 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:10:56.774422 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:10:56.775578 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 20 22:10:56.775578 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 20 22:10:56.775578 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 20 22:10:56.775578 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 20 22:10:56.775578 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 20 22:10:56.775578 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 20 22:10:56.775578 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 22:10:56.775578 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:10:56.775578 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 271/529] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Sep 20 22:10:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:10:56.780007 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7f7458-04b4-45a3-a676-dc3b4b8039e7 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:56.806114 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0593744f-ad15-47d5-b4ff-f172edf2a3c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:56.806936 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0593744f-ad15-47d5-b4ff-f172edf2a3c3 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:56.807061 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0593744f-ad15-47d5-b4ff-f172edf2a3c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:56.807256 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0593744f-ad15-47d5-b4ff-f172edf2a3c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:56.807970 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0593744f-ad15-47d5-b4ff-f172edf2a3c3 None admin] RBAC: Adding query filter params (role.id=6d6dcbd3bc16491db00308c3b7d27a63, scope.project.id=3ce415d02aa9489bae19cd514805fd8c, user.id=db7eed561e99452289a662ad326cf919) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:10:56.808274 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0593744f-ad15-47d5-b4ff-f172edf2a3c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:56.809686 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0593744f-ad15-47d5-b4ff-f172edf2a3c3 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:56.815388 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 259/530] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Sep 20 22:10:56 2022] GET /identity/v3/role_assignments?user.id=db7eed561e99452289a662ad326cf919&scope.project.id=3ce415d02aa9489bae19cd514805fd8c&role.id=6d6dcbd3bc16491db00308c3b7d27a63 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:56.828344 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0593744f-ad15-47d5-b4ff-f172edf2a3c3 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:56.901666 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:56.902266 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7f7458-04b4-45a3-a676-dc3b4b8039e7 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:56.948404 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555cc274-d01d-4fc3-a463-805f2947a64d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:56.949410 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555cc274-d01d-4fc3-a463-805f2947a64d None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:56.949923 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555cc274-d01d-4fc3-a463-805f2947a64d None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:56.950405 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555cc274-d01d-4fc3-a463-805f2947a64d None admin] PATH_INFO: `/v3/users` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:56.952080 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555cc274-d01d-4fc3-a463-805f2947a64d None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:10:56.952873 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555cc274-d01d-4fc3-a463-805f2947a64d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:56.955304 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555cc274-d01d-4fc3-a463-805f2947a64d None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:56.964654 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0593744f-ad15-47d5-b4ff-f172edf2a3c3 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:56.982730 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 272/531] 10.222.0.33 () {56 vars in 1139 bytes} [Tue Sep 20 22:10:56 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:56.983917 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555cc274-d01d-4fc3-a463-805f2947a64d None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:57.014429 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c06387-3ac9-4ae3-9443-d62d34760ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:57.015079 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c06387-3ac9-4ae3-9443-d62d34760ebf None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:57.015360 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c06387-3ac9-4ae3-9443-d62d34760ebf None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:57.015630 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c06387-3ac9-4ae3-9443-d62d34760ebf None admin] PATH_INFO: `/v3/projects` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:57.016580 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c06387-3ac9-4ae3-9443-d62d34760ebf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:10:57.016885 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c06387-3ac9-4ae3-9443-d62d34760ebf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:57.019073 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c06387-3ac9-4ae3-9443-d62d34760ebf None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:57.023873 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:57.039215 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 260/532] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Sep 20 22:10:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:57.040400 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c06387-3ac9-4ae3-9443-d62d34760ebf None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:57.115612 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555cc274-d01d-4fc3-a463-805f2947a64d None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:57.148464 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c06387-3ac9-4ae3-9443-d62d34760ebf None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:57.154619 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570d1216-6ec0-4e6b-9b37-9981f62c9292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:57.155180 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570d1216-6ec0-4e6b-9b37-9981f62c9292 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:57.155456 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570d1216-6ec0-4e6b-9b37-9981f62c9292 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:57.155723 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570d1216-6ec0-4e6b-9b37-9981f62c9292 None admin] PATH_INFO: `/v3/projects` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:57.156411 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570d1216-6ec0-4e6b-9b37-9981f62c9292 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:10:57.156711 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570d1216-6ec0-4e6b-9b37-9981f62c9292 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:57.158281 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570d1216-6ec0-4e6b-9b37-9981f62c9292 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:57.166481 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:57.180837 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 273/533] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Sep 20 22:10:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:57.181749 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570d1216-6ec0-4e6b-9b37-9981f62c9292 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:57.198928 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb1270b-65be-4cf5-b552-5ea14828f20d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:57.199923 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb1270b-65be-4cf5-b552-5ea14828f20d None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:57.200405 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb1270b-65be-4cf5-b552-5ea14828f20d None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:57.200906 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb1270b-65be-4cf5-b552-5ea14828f20d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:57.273410 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb1270b-65be-4cf5-b552-5ea14828f20d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:57.275242 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb1270b-65be-4cf5-b552-5ea14828f20d None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:57.289779 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:57.308864 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570d1216-6ec0-4e6b-9b37-9981f62c9292 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:57.357543 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abedf19-c27e-4fda-918e-bf0593f96c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:57.358161 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abedf19-c27e-4fda-918e-bf0593f96c98 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:57.358606 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abedf19-c27e-4fda-918e-bf0593f96c98 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:57.359007 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abedf19-c27e-4fda-918e-bf0593f96c98 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:57.359742 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abedf19-c27e-4fda-918e-bf0593f96c98 None admin] RBAC: Adding query filter params (role.id=6d6dcbd3bc16491db00308c3b7d27a63, scope.project.id=3ce415d02aa9489bae19cd514805fd8c, user.id=fbecfbbf24fd425ca99499fd44d8c7a8) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:10:57.360051 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abedf19-c27e-4fda-918e-bf0593f96c98 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:57.362675 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abedf19-c27e-4fda-918e-bf0593f96c98 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:57.379026 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 274/534] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Sep 20 22:10:57 2022] GET /identity/v3/role_assignments?user.id=fbecfbbf24fd425ca99499fd44d8c7a8&scope.project.id=3ce415d02aa9489bae19cd514805fd8c&role.id=6d6dcbd3bc16491db00308c3b7d27a63 => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:57.380459 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abedf19-c27e-4fda-918e-bf0593f96c98 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:57.431492 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 261/535] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 20 22:10:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 20 22:10:57.432725 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c590fee-3e17-45d4-b7c5-2c90c76ed12c None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:57.433016 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c590fee-3e17-45d4-b7c5-2c90c76ed12c None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:57.433286 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c590fee-3e17-45d4-b7c5-2c90c76ed12c None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:57.438916 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 262/536] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:10:57 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:10:57.439875 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c590fee-3e17-45d4-b7c5-2c90c76ed12c None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:57.457387 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:57.523205 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abedf19-c27e-4fda-918e-bf0593f96c98 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:57.570344 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c590fee-3e17-45d4-b7c5-2c90c76ed12c None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:57.580225 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdbad06-c6d8-43ce-aaf9-6fc49d183aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:57.580838 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdbad06-c6d8-43ce-aaf9-6fc49d183aaf None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:57.581112 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdbad06-c6d8-43ce-aaf9-6fc49d183aaf None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:57.581378 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdbad06-c6d8-43ce-aaf9-6fc49d183aaf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:57.582099 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdbad06-c6d8-43ce-aaf9-6fc49d183aaf None admin] RBAC: Adding query filter params (role.id=6d6dcbd3bc16491db00308c3b7d27a63, scope.project.id=3ce415d02aa9489bae19cd514805fd8c, user.id=6577c8b14c1f4279beac13b9ba11aba1) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:10:57.582410 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdbad06-c6d8-43ce-aaf9-6fc49d183aaf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:57.583845 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdbad06-c6d8-43ce-aaf9-6fc49d183aaf None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:57.594542 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 275/537] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Sep 20 22:10:57 2022] GET /identity/v3/role_assignments?user.id=6577c8b14c1f4279beac13b9ba11aba1&scope.project.id=3ce415d02aa9489bae19cd514805fd8c&role.id=6d6dcbd3bc16491db00308c3b7d27a63 => generated 259 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:57.594542 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e4cab1-a4ca-45fe-a4e8-1a2893513553 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:57.594542 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e4cab1-a4ca-45fe-a4e8-1a2893513553 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:57.594542 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e4cab1-a4ca-45fe-a4e8-1a2893513553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:57.618053 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-83e4cab1-a4ca-45fe-a4e8-1a2893513553 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:10:57.619332 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-83e4cab1-a4ca-45fe-a4e8-1a2893513553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:10:57.642131 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09152a7-4601-48a6-ac3e-e46b986da6e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:57.642915 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09152a7-4601-48a6-ac3e-e46b986da6e8 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:57.643196 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09152a7-4601-48a6-ac3e-e46b986da6e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:57.643465 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09152a7-4601-48a6-ac3e-e46b986da6e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:57.654904 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:57.664051 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09152a7-4601-48a6-ac3e-e46b986da6e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:57.665559 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09152a7-4601-48a6-ac3e-e46b986da6e8 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:57.695187 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-a09152a7-4601-48a6-ac3e-e46b986da6e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:10:57.695187 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:10:57.695187 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:10:57.695187 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:10:57.695187 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:10:57.695187 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:10:57.695187 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:10:57.695187 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:10:57.695187 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:10:57.695187 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:10:57.695187 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:10:57.695187 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:10:57.695187 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 22:10:57.695187 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 22:10:57.695187 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 22:10:57.695187 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 22:10:57.696194 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:10:57.696194 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:10:57.696194 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:10:57.696194 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:10:57.696194 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:10:57.696194 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:10:57.696194 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:10:57.696194 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:10:57.696194 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:10:57.696194 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:10:57.696194 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:10:57.696194 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:10:57.696194 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:10:57.696194 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:10:57.696194 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:10:57.696194 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:10:57.696194 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 22:10:57.697025 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 22:10:57.697025 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:10:57.697025 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:10:57.698059 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 263/538] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 20 22:10:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:10:57.705389 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09152a7-4601-48a6-ac3e-e46b986da6e8 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:57.762313 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 276/539] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:10:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 22:10:57.805518 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:57.852387 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09152a7-4601-48a6-ac3e-e46b986da6e8 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:57.888186 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a7d152-22cb-4661-98a2-1a6941ee31d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:57.888788 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a7d152-22cb-4661-98a2-1a6941ee31d3 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:57.889065 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a7d152-22cb-4661-98a2-1a6941ee31d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:57.889330 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a7d152-22cb-4661-98a2-1a6941ee31d3 None admin] PATH_INFO: `/v3/domains` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:57.889966 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a7d152-22cb-4661-98a2-1a6941ee31d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:10:57.890262 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a7d152-22cb-4661-98a2-1a6941ee31d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:57.891659 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a7d152-22cb-4661-98a2-1a6941ee31d3 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:57.903542 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 264/540] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 20 22:10:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:57.908887 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e4cab1-a4ca-45fe-a4e8-1a2893513553 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:58.030456 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e4cab1-a4ca-45fe-a4e8-1a2893513553 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:58.065642 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04ebd04-daa8-4273-8f26-8309785bd722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:58.066612 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ebd04-daa8-4273-8f26-8309785bd722 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:58.067062 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ebd04-daa8-4273-8f26-8309785bd722 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:58.067500 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ebd04-daa8-4273-8f26-8309785bd722 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:58.075090 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04ebd04-daa8-4273-8f26-8309785bd722 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:58.076718 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04ebd04-daa8-4273-8f26-8309785bd722 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:58.088715 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-b04ebd04-daa8-4273-8f26-8309785bd722 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 22:10:58.088715 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:10:58.088715 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:10:58.088715 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:10:58.088715 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:10:58.088715 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:10:58.088715 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:10:58.088715 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:10:58.088715 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:10:58.088715 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:10:58.088715 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:10:58.088715 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:10:58.088715 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 20 22:10:58.088715 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 20 22:10:58.088715 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 20 22:10:58.089584 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 20 22:10:58.089584 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:10:58.089584 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:10:58.089584 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:10:58.089584 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:10:58.089584 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:10:58.089584 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:10:58.089584 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:10:58.089584 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:10:58.089584 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:10:58.089584 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:10:58.089584 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:10:58.089584 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:10:58.089584 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:10:58.089584 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:10:58.089584 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:10:58.089584 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:10:58.090426 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 20 22:10:58.090426 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 20 22:10:58.090426 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 20 22:10:58.090426 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 20 22:10:58.090426 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 20 22:10:58.090426 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 20 22:10:58.090426 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 22:10:58.090426 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:10:58.090426 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 277/541] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Sep 20 22:10:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 20 22:10:58.096162 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a7d152-22cb-4661-98a2-1a6941ee31d3 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:58.110078 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04ebd04-daa8-4273-8f26-8309785bd722 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:58.127881 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:58.252798 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a7d152-22cb-4661-98a2-1a6941ee31d3 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:58.286598 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:58.289537 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a7dc33-d1da-4586-9a60-2c1202025ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:58.290770 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a7dc33-d1da-4586-9a60-2c1202025ffd None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:58.291054 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a7dc33-d1da-4586-9a60-2c1202025ffd None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:58.291319 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a7dc33-d1da-4586-9a60-2c1202025ffd None admin] PATH_INFO: `/v3/projects` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:58.292022 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a7dc33-d1da-4586-9a60-2c1202025ffd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:10:58.292344 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a7dc33-d1da-4586-9a60-2c1202025ffd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:58.293928 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a7dc33-d1da-4586-9a60-2c1202025ffd None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:58.310797 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 265/542] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Sep 20 22:10:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:58.316772 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a7dc33-d1da-4586-9a60-2c1202025ffd None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:58.335775 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04ebd04-daa8-4273-8f26-8309785bd722 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:58.427223 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f7d65c-60dc-459c-acb5-a9e2bdd6ebda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:58.427864 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7d65c-60dc-459c-acb5-a9e2bdd6ebda None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:58.428681 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7d65c-60dc-459c-acb5-a9e2bdd6ebda None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:58.428957 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7d65c-60dc-459c-acb5-a9e2bdd6ebda None admin] PATH_INFO: `/v3/roles/service` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:58.437169 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a7dc33-d1da-4586-9a60-2c1202025ffd None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:58.465880 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f7d65c-60dc-459c-acb5-a9e2bdd6ebda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 22:10:58.471291 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-20f7d65c-60dc-459c-acb5-a9e2bdd6ebda None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 20 22:10:58.471291 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:10:58.471291 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:10:58.471291 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:10:58.471291 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:10:58.471291 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:10:58.471291 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:10:58.471291 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:10:58.471291 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:10:58.471291 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:10:58.471291 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:10:58.471291 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:10:58.471291 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 22:10:58.471291 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 22:10:58.471291 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 22:10:58.471291 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 22:10:58.472172 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 22:10:58.472172 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 22:10:58.472172 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 22:10:58.472172 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 22:10:58.472172 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:10:58.472172 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:10:58.472172 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:10:58.472172 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:10:58.472172 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:10:58.472172 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:10:58.472172 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:10:58.472172 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:10:58.472172 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:10:58.472172 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:10:58.472172 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:10:58.472172 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:10:58.472953 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:10:58.472953 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:10:58.472953 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:10:58.472953 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:10:58.472953 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 22:10:58.472953 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 22:10:58.472953 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 22:10:58.472953 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 22:10:58.472953 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 22:10:58.472953 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 22:10:58.472953 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 20 22:10:58.472953 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:10:58.474893 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 278/543] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Sep 20 22:10:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 365 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:10:58.479372 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eb3349-1810-4733-a7b2-1fe7e926d352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:58.480042 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eb3349-1810-4733-a7b2-1fe7e926d352 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:58.480329 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eb3349-1810-4733-a7b2-1fe7e926d352 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:58.480643 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eb3349-1810-4733-a7b2-1fe7e926d352 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:58.481377 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eb3349-1810-4733-a7b2-1fe7e926d352 None admin] RBAC: Adding query filter params (role.id=6d6dcbd3bc16491db00308c3b7d27a63, scope.project.id=3ce415d02aa9489bae19cd514805fd8c, user.id=e9b0b3ca4ecd41aaba9cf8e0f91fbf54) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:10:58.481682 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eb3349-1810-4733-a7b2-1fe7e926d352 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:58.483331 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eb3349-1810-4733-a7b2-1fe7e926d352 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:58.485947 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f7d65c-60dc-459c-acb5-a9e2bdd6ebda None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:58.490127 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 266/544] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Sep 20 22:10:58 2022] GET /identity/v3/role_assignments?user.id=e9b0b3ca4ecd41aaba9cf8e0f91fbf54&scope.project.id=3ce415d02aa9489bae19cd514805fd8c&role.id=6d6dcbd3bc16491db00308c3b7d27a63 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:58.589223 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:58.637725 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f7d65c-60dc-459c-acb5-a9e2bdd6ebda None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:58.682810 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e619cb-9f6e-4508-a50e-87b41bb64f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:58.683441 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e619cb-9f6e-4508-a50e-87b41bb64f16 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:58.683721 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e619cb-9f6e-4508-a50e-87b41bb64f16 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:58.683993 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e619cb-9f6e-4508-a50e-87b41bb64f16 None admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:58.684687 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e619cb-9f6e-4508-a50e-87b41bb64f16 None admin] RBAC: Adding query filter params (name=service) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:10:58.684991 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e619cb-9f6e-4508-a50e-87b41bb64f16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:58.686405 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e619cb-9f6e-4508-a50e-87b41bb64f16 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:58.700108 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 279/545] 10.222.0.33 () {56 vars in 1103 bytes} [Tue Sep 20 22:10:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:58.705960 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eb3349-1810-4733-a7b2-1fe7e926d352 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:58.788591 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:58.844260 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eb3349-1810-4733-a7b2-1fe7e926d352 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:58.885131 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b750e03-8d84-4025-ab6c-eebfc531e0e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:58.885131 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b750e03-8d84-4025-ab6c-eebfc531e0e3 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:58.885131 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b750e03-8d84-4025-ab6c-eebfc531e0e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:58.885131 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b750e03-8d84-4025-ab6c-eebfc531e0e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:58.896839 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b750e03-8d84-4025-ab6c-eebfc531e0e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:58.898656 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b750e03-8d84-4025-ab6c-eebfc531e0e3 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:58.914259 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-8b750e03-8d84-4025-ab6c-eebfc531e0e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:10:58.914259 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:10:58.914259 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:10:58.914259 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:10:58.914259 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:10:58.914259 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:10:58.914259 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:10:58.914259 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:10:58.914259 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:10:58.914259 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:10:58.914259 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:10:58.914259 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:10:58.914259 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 22:10:58.914259 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 22:10:58.914259 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 22:10:58.914259 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 22:10:58.915193 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:10:58.915193 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:10:58.915193 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:10:58.915193 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:10:58.915193 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:10:58.915193 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:10:58.915193 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:10:58.915193 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:10:58.915193 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:10:58.915193 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:10:58.915193 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:10:58.915193 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:10:58.915193 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:10:58.915193 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:10:58.915193 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:10:58.915193 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:10:58.915193 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 22:10:58.916014 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 22:10:58.916014 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:10:58.916014 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:10:58.918424 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 267/546] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 20 22:10:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:10:58.923578 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e619cb-9f6e-4508-a50e-87b41bb64f16 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:59.047070 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e619cb-9f6e-4508-a50e-87b41bb64f16 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:59.083359 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:59.093236 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4123f156-358d-45dd-9766-60ad32ecd307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:59.093852 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4123f156-358d-45dd-9766-60ad32ecd307 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:59.094137 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4123f156-358d-45dd-9766-60ad32ecd307 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:59.094462 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4123f156-358d-45dd-9766-60ad32ecd307 None admin] PATH_INFO: `/v3/domains` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:59.095083 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4123f156-358d-45dd-9766-60ad32ecd307 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:10:59.095385 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4123f156-358d-45dd-9766-60ad32ecd307 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:59.096743 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4123f156-358d-45dd-9766-60ad32ecd307 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:59.113768 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 280/547] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 20 22:10:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:10:59.119090 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b750e03-8d84-4025-ab6c-eebfc531e0e3 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:59.278324 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246ec7c0-aac1-4ea9-8357-441e461bd70a None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:59.278701 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246ec7c0-aac1-4ea9-8357-441e461bd70a None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:59.278926 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246ec7c0-aac1-4ea9-8357-441e461bd70a None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:59.280190 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 281/548] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:10:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 20 22:10:59.281311 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b750e03-8d84-4025-ab6c-eebfc531e0e3 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:59.285557 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100213d7-2816-4715-96c4-e4c128f53c8e None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:59.285974 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100213d7-2816-4715-96c4-e4c128f53c8e None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:59.286348 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100213d7-2816-4715-96c4-e4c128f53c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:59.298867 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:59.326287 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cd81b5-f944-4782-9ea2-989150ae0113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:59.326952 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cd81b5-f944-4782-9ea2-989150ae0113 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:59.327233 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cd81b5-f944-4782-9ea2-989150ae0113 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:59.327508 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cd81b5-f944-4782-9ea2-989150ae0113 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:59.335903 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cd81b5-f944-4782-9ea2-989150ae0113 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:59.337361 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cd81b5-f944-4782-9ea2-989150ae0113 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:59.343620 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-100213d7-2816-4715-96c4-e4c128f53c8e None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:10:59.344998 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-100213d7-2816-4715-96c4-e4c128f53c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:10:59.348602 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-03cd81b5-f944-4782-9ea2-989150ae0113 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 20 22:10:59.348602 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:10:59.348602 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:10:59.348602 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:10:59.348602 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:10:59.348602 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:10:59.348602 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:10:59.348602 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:10:59.348602 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:10:59.348602 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:10:59.348602 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:10:59.348602 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:10:59.348602 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 20 22:10:59.348602 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 20 22:10:59.348602 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 20 22:10:59.348602 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 20 22:10:59.350680 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:10:59.350680 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:10:59.350680 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 20 22:10:59.350680 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 22:10:59.350680 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 20 22:10:59.350680 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 22:10:59.350680 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:10:59.350680 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:10:59.350680 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:10:59.350680 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:10:59.350680 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:10:59.350680 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:10:59.350680 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:10:59.350680 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:10:59.350680 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:10:59.350680 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:10:59.350680 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:10:59.350680 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:10:59.351737 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:10:59.351737 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:10:59.351737 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 20 22:10:59.351737 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 20 22:10:59.351737 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 20 22:10:59.351737 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 20 22:10:59.351737 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 20 22:10:59.351737 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 20 22:10:59.351737 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 20 22:10:59.351737 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:10:59.351737 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 268/549] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Sep 20 22:10:59 2022] GET /identity/v3/users/swift => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:10:59.358056 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cd81b5-f944-4782-9ea2-989150ae0113 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:59.465101 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 282/550] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:10:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 22:10:59.536276 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cd81b5-f944-4782-9ea2-989150ae0113 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:59.593170 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3464ab5f-dc0f-4bf4-aa6c-42754b4d9fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:59.593786 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3464ab5f-dc0f-4bf4-aa6c-42754b4d9fcb None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:59.594063 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3464ab5f-dc0f-4bf4-aa6c-42754b4d9fcb None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:59.594333 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3464ab5f-dc0f-4bf4-aa6c-42754b4d9fcb None admin] PATH_INFO: `/v3/users` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:59.595146 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3464ab5f-dc0f-4bf4-aa6c-42754b4d9fcb None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:10:59.595397 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3464ab5f-dc0f-4bf4-aa6c-42754b4d9fcb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:59.596839 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3464ab5f-dc0f-4bf4-aa6c-42754b4d9fcb None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:10:59.622101 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 269/551] 10.222.0.33 () {56 vars in 1135 bytes} [Tue Sep 20 22:10:59 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 22:10:59.627714 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100213d7-2816-4715-96c4-e4c128f53c8e None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:59.772802 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100213d7-2816-4715-96c4-e4c128f53c8e None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:59.780193 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3464ab5f-dc0f-4bf4-aa6c-42754b4d9fcb None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:10:59.814897 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:59.820796 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:10:59.850899 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193bcc12-3ef9-4a2b-9c8f-786a6cf4e1c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:10:59.851426 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193bcc12-3ef9-4a2b-9c8f-786a6cf4e1c9 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:10:59.851730 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193bcc12-3ef9-4a2b-9c8f-786a6cf4e1c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:10:59.851976 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193bcc12-3ef9-4a2b-9c8f-786a6cf4e1c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:10:59.959554 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193bcc12-3ef9-4a2b-9c8f-786a6cf4e1c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:10:59.962310 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3464ab5f-dc0f-4bf4-aa6c-42754b4d9fcb None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:10:59.964315 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193bcc12-3ef9-4a2b-9c8f-786a6cf4e1c9 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:00.031820 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e87bb7-2792-4130-9f02-7d5ddd4fbb6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:00.032472 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e87bb7-2792-4130-9f02-7d5ddd4fbb6e None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:00.032798 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e87bb7-2792-4130-9f02-7d5ddd4fbb6e None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:00.033067 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e87bb7-2792-4130-9f02-7d5ddd4fbb6e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:00.052131 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e87bb7-2792-4130-9f02-7d5ddd4fbb6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 22:11:00.061337 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-20e87bb7-2792-4130-9f02-7d5ddd4fbb6e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 20 22:11:00.061337 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:00.061337 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:00.061337 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:00.061337 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:00.061337 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:00.061337 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:00.061337 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:00.061337 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:00.061337 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:00.061337 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:00.061337 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:00.061337 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 22:11:00.061337 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 22:11:00.061337 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 22:11:00.061337 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 22:11:00.062364 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 22:11:00.062364 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 22:11:00.062364 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 22:11:00.062364 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 22:11:00.062364 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:00.062364 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:00.062364 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:00.062364 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:00.062364 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:00.062364 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:00.062364 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:00.062364 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:00.062364 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:00.062364 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:00.062364 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:00.062364 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:00.063231 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:00.063231 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:00.063231 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:00.063231 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:00.063231 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 22:11:00.063231 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 22:11:00.063231 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 22:11:00.063231 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 22:11:00.063231 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 22:11:00.063231 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 22:11:00.063231 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 20 22:11:00.063231 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:11:00.065191 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 270/552] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Sep 20 22:10:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 20 22:11:00.071123 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e87bb7-2792-4130-9f02-7d5ddd4fbb6e None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:00.165647 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 283/553] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 20 22:10:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 538 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 20 22:11:00.171859 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193bcc12-3ef9-4a2b-9c8f-786a6cf4e1c9 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:00.208577 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:00.221313 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:00.259285 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e87bb7-2792-4130-9f02-7d5ddd4fbb6e None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:00.302056 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f704969f-c8a6-470d-96a6-6fd7e0c58b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:00.302696 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f704969f-c8a6-470d-96a6-6fd7e0c58b73 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:00.303590 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f704969f-c8a6-470d-96a6-6fd7e0c58b73 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:00.303863 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f704969f-c8a6-470d-96a6-6fd7e0c58b73 None admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:00.304937 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f704969f-c8a6-470d-96a6-6fd7e0c58b73 None admin] RBAC: Adding query filter params (name=service) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:00.305238 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f704969f-c8a6-470d-96a6-6fd7e0c58b73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:00.306630 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f704969f-c8a6-470d-96a6-6fd7e0c58b73 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:00.314488 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 271/554] 10.222.0.33 () {56 vars in 1103 bytes} [Tue Sep 20 22:11:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 22:11:00.315726 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbea32fb-7b75-4671-873b-e73bec6c687c None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:00.316009 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbea32fb-7b75-4671-873b-e73bec6c687c None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:00.316278 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbea32fb-7b75-4671-873b-e73bec6c687c None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:00.322230 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 272/555] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:11:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:11:00.322230 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f74cb1-76a4-4cb8-b846-cb3f8b4ff4ff None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:00.322230 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f74cb1-76a4-4cb8-b846-cb3f8b4ff4ff None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:00.322230 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f74cb1-76a4-4cb8-b846-cb3f8b4ff4ff None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:00.322230 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 273/556] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:11:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:11:00.322230 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f74cb1-76a4-4cb8-b846-cb3f8b4ff4ff None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:00.325306 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193bcc12-3ef9-4a2b-9c8f-786a6cf4e1c9 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:00.363669 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7897969f-4081-4e94-afa6-b65a8f6b69af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:00.364662 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7897969f-4081-4e94-afa6-b65a8f6b69af None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:00.364950 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7897969f-4081-4e94-afa6-b65a8f6b69af None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:00.365224 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7897969f-4081-4e94-afa6-b65a8f6b69af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:00.376925 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7897969f-4081-4e94-afa6-b65a8f6b69af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:00.378482 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7897969f-4081-4e94-afa6-b65a8f6b69af None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:00.394193 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-7897969f-4081-4e94-afa6-b65a8f6b69af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:11:00.394193 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:00.394193 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:00.394193 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:00.394193 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:00.394193 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:00.394193 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:00.394193 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:00.394193 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:00.394193 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:00.394193 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:00.394193 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:00.394193 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 22:11:00.394193 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 22:11:00.394193 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 22:11:00.394193 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 22:11:00.395295 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:00.395295 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:00.395295 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:00.395295 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:00.395295 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:00.395295 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:00.395295 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:00.395295 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:00.395295 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:00.395295 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:00.395295 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:00.395295 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:00.395295 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:00.395295 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:00.395295 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:00.395295 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:00.395295 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 22:11:00.396199 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 22:11:00.396199 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:11:00.396199 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:11:00.402914 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 284/557] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 20 22:11:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 20 22:11:00.402914 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d7f383-d1d0-401f-9d33-fbf1383e97e8 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:00.402914 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d7f383-d1d0-401f-9d33-fbf1383e97e8 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:00.402914 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d7f383-d1d0-401f-9d33-fbf1383e97e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:00.419643 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-a1d7f383-d1d0-401f-9d33-fbf1383e97e8 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:11:00.420767 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-a1d7f383-d1d0-401f-9d33-fbf1383e97e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:11:00.427714 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f74cb1-76a4-4cb8-b846-cb3f8b4ff4ff None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:00.463553 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e19e56-130c-4108-bc02-351ab5935cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:00.464179 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e19e56-130c-4108-bc02-351ab5935cb3 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:00.464456 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e19e56-130c-4108-bc02-351ab5935cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:00.464726 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e19e56-130c-4108-bc02-351ab5935cb3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:00.476268 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e19e56-130c-4108-bc02-351ab5935cb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:00.477724 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e19e56-130c-4108-bc02-351ab5935cb3 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:00.480721 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:00.492574 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 285/558] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:11:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 22:11:00.494420 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be27e81e-ac11-443a-aa6e-bcf8cb372a81 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:00.495129 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-07e19e56-130c-4108-bc02-351ab5935cb3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:11:00.495129 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:00.495129 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:00.495129 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:00.495129 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:00.495129 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:00.495129 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:00.495129 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:00.495129 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:00.495129 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:00.495129 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:00.495129 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:00.495129 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 22:11:00.495129 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 22:11:00.495129 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 22:11:00.495129 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 22:11:00.496123 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:00.496123 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:00.496123 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:00.496123 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:00.496123 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:00.496123 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:00.496123 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:00.496123 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:00.496123 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:00.496123 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:00.496123 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:00.496123 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:00.496123 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:00.496123 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:00.496123 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:00.496123 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:00.496123 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 22:11:00.497016 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 22:11:00.497016 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:11:00.497016 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:11:00.497836 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be27e81e-ac11-443a-aa6e-bcf8cb372a81 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:00.498322 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be27e81e-ac11-443a-aa6e-bcf8cb372a81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:00.500797 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 274/559] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 20 22:11:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:00.501611 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e19e56-130c-4108-bc02-351ab5935cb3 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:00.519702 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:00.525417 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-be27e81e-ac11-443a-aa6e-bcf8cb372a81 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:11:00.528219 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-be27e81e-ac11-443a-aa6e-bcf8cb372a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:11:00.612078 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e19e56-130c-4108-bc02-351ab5935cb3 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:00.617620 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 286/560] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:11:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 22:11:00.618713 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be27e81e-ac11-443a-aa6e-bcf8cb372a81 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:00.692251 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1cbe81-2529-4e15-981d-88b0778f3e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:00.694129 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1cbe81-2529-4e15-981d-88b0778f3e24 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:00.695148 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1cbe81-2529-4e15-981d-88b0778f3e24 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:00.697301 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1cbe81-2529-4e15-981d-88b0778f3e24 None admin] PATH_INFO: `/v3/domains` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:00.698178 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1cbe81-2529-4e15-981d-88b0778f3e24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:00.699217 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1cbe81-2529-4e15-981d-88b0778f3e24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:00.701721 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1cbe81-2529-4e15-981d-88b0778f3e24 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:00.727166 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 275/561] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 20 22:11:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:00.733668 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1cbe81-2529-4e15-981d-88b0778f3e24 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:00.794015 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be27e81e-ac11-443a-aa6e-bcf8cb372a81 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:00.810812 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:00.836186 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:00.843483 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115457d7-0bab-494b-8398-b83415bc4ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:00.844096 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115457d7-0bab-494b-8398-b83415bc4ff6 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:00.844371 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115457d7-0bab-494b-8398-b83415bc4ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:00.844659 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115457d7-0bab-494b-8398-b83415bc4ff6 None admin] PATH_INFO: `/v3/domains` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:00.845540 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115457d7-0bab-494b-8398-b83415bc4ff6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:00.845841 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115457d7-0bab-494b-8398-b83415bc4ff6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:00.847631 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115457d7-0bab-494b-8398-b83415bc4ff6 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:00.862881 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 287/562] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 20 22:11:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:00.863797 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115457d7-0bab-494b-8398-b83415bc4ff6 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:00.864385 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1cbe81-2529-4e15-981d-88b0778f3e24 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:00.903360 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273d406c-e0e7-4629-a004-c34441227b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:00.904369 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273d406c-e0e7-4629-a004-c34441227b64 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:00.904878 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273d406c-e0e7-4629-a004-c34441227b64 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:00.905349 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273d406c-e0e7-4629-a004-c34441227b64 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:00.914066 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273d406c-e0e7-4629-a004-c34441227b64 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:00.915779 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273d406c-e0e7-4629-a004-c34441227b64 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:00.927756 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-273d406c-e0e7-4629-a004-c34441227b64 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 22:11:00.927756 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:00.927756 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:00.927756 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:00.927756 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:00.927756 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:00.927756 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:00.927756 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:00.927756 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:00.927756 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:00.927756 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:00.927756 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:00.927756 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 20 22:11:00.927756 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 20 22:11:00.927756 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 20 22:11:00.929232 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 20 22:11:00.929232 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:00.929232 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:00.929232 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:00.929232 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:00.929232 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:00.929232 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:00.929232 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:00.929232 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:00.929232 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:00.929232 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:00.929232 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:00.929232 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:00.929232 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:00.929232 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:00.929232 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:00.929232 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:00.930381 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 20 22:11:00.930381 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 20 22:11:00.930381 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 20 22:11:00.930381 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 20 22:11:00.930381 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 20 22:11:00.930381 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 20 22:11:00.930381 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 22:11:00.930381 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:11:00.932924 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 276/563] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Sep 20 22:11:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:00.934049 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273d406c-e0e7-4629-a004-c34441227b64 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:00.993762 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115457d7-0bab-494b-8398-b83415bc4ff6 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:01.026774 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886dccc3-d0ac-4af1-80f6-176fa0ae155e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:01.027398 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886dccc3-d0ac-4af1-80f6-176fa0ae155e None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:01.027672 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886dccc3-d0ac-4af1-80f6-176fa0ae155e None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:01.027940 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886dccc3-d0ac-4af1-80f6-176fa0ae155e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:01.038536 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886dccc3-d0ac-4af1-80f6-176fa0ae155e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 22:11:01.043694 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-886dccc3-d0ac-4af1-80f6-176fa0ae155e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 20 22:11:01.043694 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:01.043694 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:01.043694 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:01.043694 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:01.043694 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:01.043694 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:01.043694 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:01.043694 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:01.043694 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:01.043694 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:01.043694 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:01.043694 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 22:11:01.043694 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 22:11:01.043694 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 22:11:01.043694 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 22:11:01.044620 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 22:11:01.044620 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 22:11:01.044620 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 22:11:01.044620 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 22:11:01.044620 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:01.044620 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:01.044620 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:01.044620 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:01.044620 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:01.044620 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:01.044620 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:01.044620 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:01.044620 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:01.044620 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:01.044620 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:01.044620 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:01.045452 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:01.045452 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:01.045452 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:01.045452 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:01.045452 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 22:11:01.045452 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 22:11:01.045452 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 22:11:01.045452 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 22:11:01.045452 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 22:11:01.045452 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 22:11:01.045452 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 20 22:11:01.045452 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:11:01.045452 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 288/564] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Sep 20 22:11:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:01.046158 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886dccc3-d0ac-4af1-80f6-176fa0ae155e None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:01.057523 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273d406c-e0e7-4629-a004-c34441227b64 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:01.071768 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:01.091625 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a12165-38c9-41ac-aeda-cfc82c48f858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:01.092255 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a12165-38c9-41ac-aeda-cfc82c48f858 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:01.092535 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a12165-38c9-41ac-aeda-cfc82c48f858 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:01.092805 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a12165-38c9-41ac-aeda-cfc82c48f858 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:01.100624 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a12165-38c9-41ac-aeda-cfc82c48f858 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:01.101998 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:01.102117 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a12165-38c9-41ac-aeda-cfc82c48f858 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:01.113004 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-67a12165-38c9-41ac-aeda-cfc82c48f858 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 20 22:11:01.113004 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:01.113004 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:01.113004 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:01.113004 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:01.113004 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:01.113004 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:01.113004 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:01.113004 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:01.113004 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:01.113004 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:01.113004 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:01.113004 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 20 22:11:01.113004 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 20 22:11:01.113004 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 20 22:11:01.113004 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 20 22:11:01.114128 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:01.114128 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:01.114128 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 20 22:11:01.114128 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 22:11:01.114128 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 20 22:11:01.114128 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 22:11:01.114128 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:01.114128 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:01.114128 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:01.114128 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:01.114128 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:01.114128 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:01.114128 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:01.114128 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:01.114128 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:01.114128 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:01.114128 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:01.114128 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:01.115107 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:01.115107 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:01.115107 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 20 22:11:01.115107 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 20 22:11:01.115107 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 20 22:11:01.115107 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 20 22:11:01.115107 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 20 22:11:01.115107 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 20 22:11:01.115107 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 20 22:11:01.115107 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:11:01.115107 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 277/565] 10.222.0.33 () {56 vars in 1093 bytes} [Tue Sep 20 22:11:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:01.115107 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a12165-38c9-41ac-aeda-cfc82c48f858 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:01.154604 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886dccc3-d0ac-4af1-80f6-176fa0ae155e None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:01.188736 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6200005-f060-4de0-9f1d-1327502c7c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:01.189331 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6200005-f060-4de0-9f1d-1327502c7c40 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:01.189608 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6200005-f060-4de0-9f1d-1327502c7c40 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:01.189877 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6200005-f060-4de0-9f1d-1327502c7c40 None admin] PATH_INFO: `/v3/projects` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:01.190591 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6200005-f060-4de0-9f1d-1327502c7c40 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:01.190896 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6200005-f060-4de0-9f1d-1327502c7c40 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:01.192313 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6200005-f060-4de0-9f1d-1327502c7c40 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:01.203933 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 289/566] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Sep 20 22:11:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:01.204717 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6200005-f060-4de0-9f1d-1327502c7c40 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:01.213749 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a12165-38c9-41ac-aeda-cfc82c48f858 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:01.247543 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e73233c-179c-4f97-b13e-417201c018ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:01.248107 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e73233c-179c-4f97-b13e-417201c018ba None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:01.248385 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e73233c-179c-4f97-b13e-417201c018ba None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:01.248654 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e73233c-179c-4f97-b13e-417201c018ba None admin] PATH_INFO: `/v3/roles/service` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:01.258653 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e73233c-179c-4f97-b13e-417201c018ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 22:11:01.263757 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-8e73233c-179c-4f97-b13e-417201c018ba None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 20 22:11:01.263757 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:01.263757 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:01.263757 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:01.263757 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:01.263757 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:01.263757 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:01.263757 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:01.263757 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:01.263757 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:01.263757 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:01.263757 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:01.263757 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 22:11:01.263757 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 22:11:01.263757 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 22:11:01.263757 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 22:11:01.264669 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 22:11:01.264669 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 22:11:01.264669 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 22:11:01.264669 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 22:11:01.264669 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:01.264669 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:01.264669 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:01.264669 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:01.264669 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:01.264669 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:01.264669 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:01.264669 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:01.264669 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:01.264669 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:01.264669 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:01.264669 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:01.265522 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:01.265522 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:01.265522 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:01.265522 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:01.265522 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 22:11:01.265522 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 22:11:01.265522 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 22:11:01.265522 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 22:11:01.265522 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 22:11:01.265522 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 22:11:01.265522 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 20 22:11:01.265522 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:11:01.265522 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 278/567] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Sep 20 22:11:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:01.266240 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652362ba-7270-4732-827a-5f3971560369 None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:01.266240 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652362ba-7270-4732-827a-5f3971560369 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:01.266458 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652362ba-7270-4732-827a-5f3971560369 None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:01.267865 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 279/568] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:11:01 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:11:01.271296 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652362ba-7270-4732-827a-5f3971560369 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:01.309856 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:01.313468 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6200005-f060-4de0-9f1d-1327502c7c40 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:01.326398 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:01.349026 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6917a93a-0314-4bad-9bdf-35bd65b579d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:01.349733 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6917a93a-0314-4bad-9bdf-35bd65b579d4 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:01.350485 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6917a93a-0314-4bad-9bdf-35bd65b579d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:01.350789 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6917a93a-0314-4bad-9bdf-35bd65b579d4 None admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:01.351456 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6917a93a-0314-4bad-9bdf-35bd65b579d4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:01.351757 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6917a93a-0314-4bad-9bdf-35bd65b579d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:01.353108 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6917a93a-0314-4bad-9bdf-35bd65b579d4 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:01.360945 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 290/569] 10.222.0.33 () {56 vars in 1103 bytes} [Tue Sep 20 22:11:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:01.362002 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6917a93a-0314-4bad-9bdf-35bd65b579d4 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:01.379002 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652362ba-7270-4732-827a-5f3971560369 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:01.412242 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0cf03f-ff88-4217-88a5-00b3d1c1cd6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:01.413273 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0cf03f-ff88-4217-88a5-00b3d1c1cd6a None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:01.413551 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0cf03f-ff88-4217-88a5-00b3d1c1cd6a None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:01.413820 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0cf03f-ff88-4217-88a5-00b3d1c1cd6a None admin] PATH_INFO: `/v3/users` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:01.414568 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0cf03f-ff88-4217-88a5-00b3d1c1cd6a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:01.414872 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0cf03f-ff88-4217-88a5-00b3d1c1cd6a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:01.416312 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0cf03f-ff88-4217-88a5-00b3d1c1cd6a None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:01.433008 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 280/570] 10.222.0.33 () {56 vars in 1133 bytes} [Tue Sep 20 22:11:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:01.433786 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0cf03f-ff88-4217-88a5-00b3d1c1cd6a None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:01.460541 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6917a93a-0314-4bad-9bdf-35bd65b579d4 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:01.493180 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511b66e3-ac6f-4d10-97ce-49a491d4baab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:01.493763 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511b66e3-ac6f-4d10-97ce-49a491d4baab None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:01.494038 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511b66e3-ac6f-4d10-97ce-49a491d4baab None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:01.494309 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511b66e3-ac6f-4d10-97ce-49a491d4baab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:01.495048 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511b66e3-ac6f-4d10-97ce-49a491d4baab None admin] RBAC: Adding query filter params (role.id=6d6dcbd3bc16491db00308c3b7d27a63, scope.project.id=3ce415d02aa9489bae19cd514805fd8c, user.id=257983500d7b430c8f0377b2aa743ae0) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:01.495351 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511b66e3-ac6f-4d10-97ce-49a491d4baab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:01.496758 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511b66e3-ac6f-4d10-97ce-49a491d4baab None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:01.502058 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 291/571] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Sep 20 22:11:01 2022] GET /identity/v3/role_assignments?user.id=257983500d7b430c8f0377b2aa743ae0&scope.project.id=3ce415d02aa9489bae19cd514805fd8c&role.id=6d6dcbd3bc16491db00308c3b7d27a63 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:01.503137 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796ce5b2-217f-4630-a828-e24255d245bb None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:01.503417 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796ce5b2-217f-4630-a828-e24255d245bb None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:01.503689 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796ce5b2-217f-4630-a828-e24255d245bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:01.523656 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-796ce5b2-217f-4630-a828-e24255d245bb None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:11:01.524882 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-796ce5b2-217f-4630-a828-e24255d245bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:11:01.526897 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:01.540124 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0cf03f-ff88-4217-88a5-00b3d1c1cd6a None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:01.564827 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:01.580110 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6805ff-d506-4860-8464-3181ce17ef45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:01.580854 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6805ff-d506-4860-8464-3181ce17ef45 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:01.581138 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6805ff-d506-4860-8464-3181ce17ef45 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:01.581413 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6805ff-d506-4860-8464-3181ce17ef45 None admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:01.582099 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6805ff-d506-4860-8464-3181ce17ef45 None admin] RBAC: Adding query filter params (name=service) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:01.582407 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6805ff-d506-4860-8464-3181ce17ef45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:01.584559 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6805ff-d506-4860-8464-3181ce17ef45 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:01.598777 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 281/572] 10.222.0.33 () {56 vars in 1103 bytes} [Tue Sep 20 22:11:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:01.599767 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6805ff-d506-4860-8464-3181ce17ef45 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:01.610571 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 292/573] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:11:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 22:11:01.610571 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796ce5b2-217f-4630-a828-e24255d245bb None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:01.740215 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796ce5b2-217f-4630-a828-e24255d245bb None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:01.741125 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6805ff-d506-4860-8464-3181ce17ef45 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:01.779621 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b201644-a247-4b53-a21a-7259153e7020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:01.780179 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b201644-a247-4b53-a21a-7259153e7020 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:01.780457 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b201644-a247-4b53-a21a-7259153e7020 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:01.780731 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b201644-a247-4b53-a21a-7259153e7020 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:01.785931 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fe0396-df47-4b19-a94b-74275e13f034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:01.786815 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fe0396-df47-4b19-a94b-74275e13f034 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:01.788317 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fe0396-df47-4b19-a94b-74275e13f034 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:01.788781 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fe0396-df47-4b19-a94b-74275e13f034 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:01.791738 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b201644-a247-4b53-a21a-7259153e7020 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:01.793251 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b201644-a247-4b53-a21a-7259153e7020 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:01.803982 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fe0396-df47-4b19-a94b-74275e13f034 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:01.805976 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fe0396-df47-4b19-a94b-74275e13f034 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:01.808942 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-3b201644-a247-4b53-a21a-7259153e7020 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:11:01.808942 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:01.808942 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:01.808942 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:01.808942 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:01.808942 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:01.808942 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:01.808942 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:01.808942 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:01.808942 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:01.808942 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:01.808942 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:01.808942 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 22:11:01.808942 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 22:11:01.808942 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 22:11:01.808942 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 22:11:01.809869 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:01.809869 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:01.809869 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:01.809869 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:01.809869 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:01.809869 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:01.809869 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:01.809869 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:01.809869 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:01.809869 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:01.809869 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:01.809869 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:01.809869 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:01.809869 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:01.809869 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:01.809869 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:01.809869 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 22:11:01.810782 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 22:11:01.810782 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:11:01.810782 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:11:01.814637 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 293/574] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 20 22:11:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:01.815469 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b201644-a247-4b53-a21a-7259153e7020 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:01.826837 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-37fe0396-df47-4b19-a94b-74275e13f034 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:11:01.826837 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:01.826837 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:01.826837 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:01.826837 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:01.826837 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:01.826837 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:01.826837 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:01.826837 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:01.826837 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:01.826837 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:01.826837 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:01.826837 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 22:11:01.826837 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 22:11:01.826837 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 22:11:01.826837 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 22:11:01.827802 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:01.827802 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:01.827802 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:01.827802 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:01.827802 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:01.827802 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:01.827802 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:01.827802 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:01.827802 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:01.827802 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:01.827802 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:01.827802 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:01.827802 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:01.827802 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:01.827802 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:01.827802 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:01.827802 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 22:11:01.828701 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 22:11:01.828701 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:11:01.828701 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:11:01.831111 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 282/575] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 20 22:11:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:01.832345 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fe0396-df47-4b19-a94b-74275e13f034 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:01.842371 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:01.846542 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:01.931377 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b201644-a247-4b53-a21a-7259153e7020 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:01.960029 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fe0396-df47-4b19-a94b-74275e13f034 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:01.966619 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424f7355-649e-4f6e-b610-e545023c021d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:01.967698 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424f7355-649e-4f6e-b610-e545023c021d None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:01.967975 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424f7355-649e-4f6e-b610-e545023c021d None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:01.968243 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424f7355-649e-4f6e-b610-e545023c021d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:01.980083 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424f7355-649e-4f6e-b610-e545023c021d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:01.981528 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424f7355-649e-4f6e-b610-e545023c021d None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:01.995032 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edcd09a-c0c3-4fbe-8ae9-89b2f5dbe824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:01.995637 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edcd09a-c0c3-4fbe-8ae9-89b2f5dbe824 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:01.995916 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edcd09a-c0c3-4fbe-8ae9-89b2f5dbe824 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:01.996186 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edcd09a-c0c3-4fbe-8ae9-89b2f5dbe824 None admin] PATH_INFO: `/v3/domains` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:01.996306 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-424f7355-649e-4f6e-b610-e545023c021d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:11:01.996306 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:01.996306 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:01.996306 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:01.996306 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:01.996306 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:01.996306 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:01.996306 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:01.996306 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:01.996306 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:01.996306 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:01.996306 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:01.996306 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 22:11:01.996306 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 22:11:01.996306 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 22:11:01.996306 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 22:11:01.997173 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:01.997173 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:01.997173 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:01.997173 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:01.997173 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:01.997173 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:01.997173 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:01.997173 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:01.997173 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:01.997173 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:01.997173 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:01.997173 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:01.997173 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:01.997173 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:01.997173 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:01.997173 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:01.997173 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 22:11:02.003119 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 22:11:02.003119 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:11:02.003119 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:11:02.003320 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edcd09a-c0c3-4fbe-8ae9-89b2f5dbe824 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:02.003320 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edcd09a-c0c3-4fbe-8ae9-89b2f5dbe824 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:02.003459 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 294/576] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 20 22:11:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:02.003459 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424f7355-649e-4f6e-b610-e545023c021d None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:02.003585 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edcd09a-c0c3-4fbe-8ae9-89b2f5dbe824 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:02.011472 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 283/577] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 20 22:11:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:02.012565 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edcd09a-c0c3-4fbe-8ae9-89b2f5dbe824 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:02.078494 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:02.088821 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:02.114383 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424f7355-649e-4f6e-b610-e545023c021d None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:02.128063 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edcd09a-c0c3-4fbe-8ae9-89b2f5dbe824 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:02.151469 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fe711c-9092-48c4-b376-f720f2e1d907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:02.152077 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fe711c-9092-48c4-b376-f720f2e1d907 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:02.152363 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fe711c-9092-48c4-b376-f720f2e1d907 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:02.152663 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fe711c-9092-48c4-b376-f720f2e1d907 None admin] PATH_INFO: `/v3/domains` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:02.153283 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fe711c-9092-48c4-b376-f720f2e1d907 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:02.153588 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fe711c-9092-48c4-b376-f720f2e1d907 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:02.155197 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fe711c-9092-48c4-b376-f720f2e1d907 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:02.163929 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf3a362-10fc-4698-a939-b1ede3d081e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:02.164723 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf3a362-10fc-4698-a939-b1ede3d081e7 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:02.165006 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf3a362-10fc-4698-a939-b1ede3d081e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:02.165279 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf3a362-10fc-4698-a939-b1ede3d081e7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:02.168283 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 295/578] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 20 22:11:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:02.169610 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fe711c-9092-48c4-b376-f720f2e1d907 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:02.182084 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf3a362-10fc-4698-a939-b1ede3d081e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 22:11:02.186856 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-eaf3a362-10fc-4698-a939-b1ede3d081e7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 20 22:11:02.186856 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:02.186856 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:02.186856 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:02.186856 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:02.186856 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:02.186856 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:02.186856 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:02.186856 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:02.186856 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:02.186856 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:02.186856 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:02.186856 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 22:11:02.186856 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 22:11:02.186856 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 22:11:02.186856 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 22:11:02.187783 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 22:11:02.187783 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 22:11:02.187783 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 22:11:02.187783 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 22:11:02.187783 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:02.187783 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:02.187783 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:02.187783 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:02.187783 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:02.187783 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:02.187783 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:02.187783 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:02.187783 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:02.187783 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:02.187783 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:02.187783 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:02.188629 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:02.188629 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:02.188629 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:02.188629 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:02.188629 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 22:11:02.188629 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 22:11:02.188629 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 22:11:02.188629 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 22:11:02.188629 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 22:11:02.188629 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 22:11:02.188629 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 20 22:11:02.188629 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:11:02.188629 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 284/579] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Sep 20 22:11:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:02.189338 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf3a362-10fc-4698-a939-b1ede3d081e7 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:02.283300 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fe711c-9092-48c4-b376-f720f2e1d907 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:02.299870 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf3a362-10fc-4698-a939-b1ede3d081e7 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:02.319122 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:02.325901 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1b44cc-1a44-4c48-9966-ae487fe86a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:02.326563 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b44cc-1a44-4c48-9966-ae487fe86a4a None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:02.326808 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b44cc-1a44-4c48-9966-ae487fe86a4a None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:02.327085 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b44cc-1a44-4c48-9966-ae487fe86a4a None admin] PATH_INFO: `/v3/domains` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:02.327352 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:02.327723 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1b44cc-1a44-4c48-9966-ae487fe86a4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:02.328225 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1b44cc-1a44-4c48-9966-ae487fe86a4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:02.329519 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1b44cc-1a44-4c48-9966-ae487fe86a4a None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:02.339120 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703d2c1c-f2c1-4880-ba50-0604d60db741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:02.340047 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703d2c1c-f2c1-4880-ba50-0604d60db741 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:02.340328 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703d2c1c-f2c1-4880-ba50-0604d60db741 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:02.340600 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703d2c1c-f2c1-4880-ba50-0604d60db741 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:02.341355 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 296/580] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 20 22:11:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:02.343385 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1b44cc-1a44-4c48-9966-ae487fe86a4a None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:02.353263 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703d2c1c-f2c1-4880-ba50-0604d60db741 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:02.355134 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703d2c1c-f2c1-4880-ba50-0604d60db741 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:02.366831 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-703d2c1c-f2c1-4880-ba50-0604d60db741 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 22:11:02.366831 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:02.366831 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:02.366831 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:02.366831 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:02.366831 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:02.366831 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:02.366831 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:02.366831 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:02.366831 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:02.366831 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:02.366831 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:02.366831 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 20 22:11:02.366831 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 20 22:11:02.366831 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 20 22:11:02.367735 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 20 22:11:02.367735 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:02.367735 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:02.367735 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:02.367735 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:02.367735 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:02.367735 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:02.367735 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:02.367735 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:02.367735 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:02.367735 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:02.367735 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:02.367735 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:02.367735 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:02.367735 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:02.367735 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:02.367735 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:02.368719 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 20 22:11:02.368719 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 20 22:11:02.368719 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 20 22:11:02.368719 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 20 22:11:02.368719 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 20 22:11:02.368719 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 20 22:11:02.368719 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 22:11:02.368719 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:11:02.372638 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 285/581] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Sep 20 22:11:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:02.373464 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703d2c1c-f2c1-4880-ba50-0604d60db741 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:02.461480 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1b44cc-1a44-4c48-9966-ae487fe86a4a None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:02.485744 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703d2c1c-f2c1-4880-ba50-0604d60db741 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:02.498526 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9058619-812b-49e6-9ec2-3db3244b7518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:02.499157 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9058619-812b-49e6-9ec2-3db3244b7518 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:02.499437 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9058619-812b-49e6-9ec2-3db3244b7518 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:02.499708 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9058619-812b-49e6-9ec2-3db3244b7518 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:02.507596 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9058619-812b-49e6-9ec2-3db3244b7518 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:02.509025 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9058619-812b-49e6-9ec2-3db3244b7518 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:02.519912 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-e9058619-812b-49e6-9ec2-3db3244b7518 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 20 22:11:02.519912 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:02.519912 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:02.519912 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:02.519912 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:02.519912 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:02.519912 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:02.519912 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:02.519912 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:02.519912 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:02.519912 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:02.519912 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:02.519912 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 20 22:11:02.519912 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 20 22:11:02.519912 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 20 22:11:02.519912 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 20 22:11:02.520853 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:02.520853 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:02.520853 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 20 22:11:02.520853 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 22:11:02.520853 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 20 22:11:02.520853 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 22:11:02.520853 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:02.520853 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:02.520853 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:02.520853 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:02.520853 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:02.520853 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:02.520853 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:02.520853 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:02.520853 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:02.520853 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:02.520853 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:02.520853 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:02.522369 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:02.522369 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:02.522369 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 20 22:11:02.522369 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 20 22:11:02.522369 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 20 22:11:02.522369 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 20 22:11:02.522369 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 20 22:11:02.522369 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 20 22:11:02.522369 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 20 22:11:02.522369 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:11:02.522369 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 297/582] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 20 22:11:02 2022] GET /identity/v3/users/cinder => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:02.522369 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9058619-812b-49e6-9ec2-3db3244b7518 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:02.528612 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4d22d6-8ac6-48d4-ae58-7b604f029675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:02.529235 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4d22d6-8ac6-48d4-ae58-7b604f029675 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:02.529519 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4d22d6-8ac6-48d4-ae58-7b604f029675 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:02.529792 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4d22d6-8ac6-48d4-ae58-7b604f029675 None admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:02.530466 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4d22d6-8ac6-48d4-ae58-7b604f029675 None admin] RBAC: Adding query filter params (name=service) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:02.530867 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4d22d6-8ac6-48d4-ae58-7b604f029675 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:02.532235 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4d22d6-8ac6-48d4-ae58-7b604f029675 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:02.541757 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 286/583] 10.222.0.33 () {56 vars in 1103 bytes} [Tue Sep 20 22:11:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:02.546970 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4d22d6-8ac6-48d4-ae58-7b604f029675 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:02.580940 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:02.596813 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:02.632271 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9058619-812b-49e6-9ec2-3db3244b7518 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:02.652279 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4d22d6-8ac6-48d4-ae58-7b604f029675 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:02.667194 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a986a0c-61ea-409a-8794-6e941b5ba24c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:02.667822 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a986a0c-61ea-409a-8794-6e941b5ba24c None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:02.668103 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a986a0c-61ea-409a-8794-6e941b5ba24c None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:02.668375 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a986a0c-61ea-409a-8794-6e941b5ba24c None admin] PATH_INFO: `/v3/users/glance` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:02.678175 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a986a0c-61ea-409a-8794-6e941b5ba24c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:02.679906 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a986a0c-61ea-409a-8794-6e941b5ba24c None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:02.687172 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da010b81-2f5f-4abd-8537-0c06a463758a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:02.688021 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da010b81-2f5f-4abd-8537-0c06a463758a None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:02.688485 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da010b81-2f5f-4abd-8537-0c06a463758a None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:02.688934 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da010b81-2f5f-4abd-8537-0c06a463758a None admin] PATH_INFO: `/v3/projects` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:02.689798 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da010b81-2f5f-4abd-8537-0c06a463758a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:02.690283 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da010b81-2f5f-4abd-8537-0c06a463758a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:02.691383 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-0a986a0c-61ea-409a-8794-6e941b5ba24c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 20 22:11:02.691383 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:02.691383 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:02.691383 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:02.691383 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:02.691383 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:02.691383 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:02.691383 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:02.691383 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:02.691383 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:02.691383 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:02.691383 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:02.691383 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 20 22:11:02.691383 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 20 22:11:02.691383 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 20 22:11:02.691383 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 20 22:11:02.692285 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:02.692285 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:02.692285 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 20 22:11:02.692285 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 22:11:02.692285 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 20 22:11:02.692285 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 22:11:02.692285 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:02.692285 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:02.692285 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:02.692285 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:02.692285 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:02.692285 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:02.692285 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:02.692285 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:02.692285 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:02.692285 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:02.692285 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:02.692285 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:02.693224 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:02.693224 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:02.693224 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 20 22:11:02.693224 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 20 22:11:02.693224 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 20 22:11:02.693224 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 20 22:11:02.693224 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 20 22:11:02.693224 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 20 22:11:02.693224 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 20 22:11:02.693224 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:11:02.693224 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 298/584] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 20 22:11:02 2022] GET /identity/v3/users/glance => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:02.693224 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a986a0c-61ea-409a-8794-6e941b5ba24c None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:02.695422 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da010b81-2f5f-4abd-8537-0c06a463758a None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:02.711854 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 287/585] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Sep 20 22:11:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:02.712776 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da010b81-2f5f-4abd-8537-0c06a463758a None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:02.822904 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a986a0c-61ea-409a-8794-6e941b5ba24c None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:02.826110 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da010b81-2f5f-4abd-8537-0c06a463758a None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:02.836443 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:02.837726 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:02.860892 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711dadfc-b624-424f-8694-67f5bd2360f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:02.861503 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711dadfc-b624-424f-8694-67f5bd2360f8 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:02.861780 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711dadfc-b624-424f-8694-67f5bd2360f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:02.862057 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711dadfc-b624-424f-8694-67f5bd2360f8 None admin] PATH_INFO: `/v3/users` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:02.862816 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711dadfc-b624-424f-8694-67f5bd2360f8 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:02.863124 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711dadfc-b624-424f-8694-67f5bd2360f8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:02.863341 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a152fca-b2a7-40d3-aebd-2f2722ccca8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:02.863967 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a152fca-b2a7-40d3-aebd-2f2722ccca8c None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:02.864248 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a152fca-b2a7-40d3-aebd-2f2722ccca8c None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:02.864518 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a152fca-b2a7-40d3-aebd-2f2722ccca8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:02.864620 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711dadfc-b624-424f-8694-67f5bd2360f8 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:02.875433 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a152fca-b2a7-40d3-aebd-2f2722ccca8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:02.876671 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a152fca-b2a7-40d3-aebd-2f2722ccca8c None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:02.884172 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 299/586] 10.222.0.33 () {56 vars in 1137 bytes} [Tue Sep 20 22:11:02 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:02.884863 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711dadfc-b624-424f-8694-67f5bd2360f8 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:02.896705 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-8a152fca-b2a7-40d3-aebd-2f2722ccca8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:11:02.896705 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:02.896705 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:02.896705 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:02.896705 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:02.896705 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:02.896705 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:02.896705 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:02.896705 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:02.896705 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:02.896705 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:02.896705 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:02.896705 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 22:11:02.896705 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 22:11:02.896705 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 22:11:02.896705 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 22:11:02.897625 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:02.897625 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:02.897625 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:02.897625 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:02.897625 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:02.897625 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:02.897625 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:02.897625 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:02.897625 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:02.897625 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:02.897625 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:02.897625 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:02.897625 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:02.897625 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:02.897625 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:02.897625 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:02.897625 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 22:11:02.898531 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 22:11:02.898531 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:11:02.898531 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:11:02.898531 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 288/587] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 20 22:11:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:02.898755 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a152fca-b2a7-40d3-aebd-2f2722ccca8c None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:02.993387 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711dadfc-b624-424f-8694-67f5bd2360f8 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:03.002976 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a152fca-b2a7-40d3-aebd-2f2722ccca8c None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:03.027595 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16ff7de-eefd-4352-800d-75ccfce87e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:03.028201 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ff7de-eefd-4352-800d-75ccfce87e5f None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:03.028491 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ff7de-eefd-4352-800d-75ccfce87e5f None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:03.028763 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ff7de-eefd-4352-800d-75ccfce87e5f None admin] PATH_INFO: `/v3/users` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:03.029487 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16ff7de-eefd-4352-800d-75ccfce87e5f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:03.029798 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16ff7de-eefd-4352-800d-75ccfce87e5f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:03.031242 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16ff7de-eefd-4352-800d-75ccfce87e5f None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:03.036808 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f35a806-aefb-46c9-aa19-282f3fff60a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:03.037494 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f35a806-aefb-46c9-aa19-282f3fff60a2 None admin] REQUEST_METHOD: `PUT` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:03.037773 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f35a806-aefb-46c9-aa19-282f3fff60a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:03.038049 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f35a806-aefb-46c9-aa19-282f3fff60a2 None admin] PATH_INFO: `/v3/projects/3ce415d02aa9489bae19cd514805fd8c/users/db7eed561e99452289a662ad326cf919/roles/6d6dcbd3bc16491db00308c3b7d27a63` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:03.057475 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 300/588] 10.222.0.33 () {56 vars in 1137 bytes} [Tue Sep 20 22:11:02 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:03.057475 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16ff7de-eefd-4352-800d-75ccfce87e5f None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:03.059233 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f35a806-aefb-46c9-aa19-282f3fff60a2 None admin] RBAC: Authorizing `identity:create_grant(project_id=3ce415d02aa9489bae19cd514805fd8c, user_id=db7eed561e99452289a662ad326cf919, role_id=6d6dcbd3bc16491db00308c3b7d27a63)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:03.062835 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f35a806-aefb-46c9-aa19-282f3fff60a2 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:03.086622 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 289/589] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Sep 20 22:11:02 2022] PUT /identity/v3/projects/3ce415d02aa9489bae19cd514805fd8c/users/db7eed561e99452289a662ad326cf919/roles/6d6dcbd3bc16491db00308c3b7d27a63 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:11:03.086622 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f35a806-aefb-46c9-aa19-282f3fff60a2 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:03.097898 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:03.102653 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:03.210799 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f35a806-aefb-46c9-aa19-282f3fff60a2 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:03.211002 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16ff7de-eefd-4352-800d-75ccfce87e5f None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:03.253265 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf334c8-6dcd-4e9b-ba6a-796a7f8fe1d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:03.254212 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf334c8-6dcd-4e9b-ba6a-796a7f8fe1d0 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:03.254819 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf334c8-6dcd-4e9b-ba6a-796a7f8fe1d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:03.255329 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf334c8-6dcd-4e9b-ba6a-796a7f8fe1d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:03.261377 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dd85f3-9be2-4276-953b-0ede65dac6c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:03.262000 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd85f3-9be2-4276-953b-0ede65dac6c3 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:03.262276 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd85f3-9be2-4276-953b-0ede65dac6c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:03.262573 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd85f3-9be2-4276-953b-0ede65dac6c3 None admin] PATH_INFO: `/v3/domains` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:03.263240 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dd85f3-9be2-4276-953b-0ede65dac6c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:03.263539 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dd85f3-9be2-4276-953b-0ede65dac6c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:03.264922 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dd85f3-9be2-4276-953b-0ede65dac6c3 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:03.270156 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf334c8-6dcd-4e9b-ba6a-796a7f8fe1d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:03.272517 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf334c8-6dcd-4e9b-ba6a-796a7f8fe1d0 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:03.280371 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 290/590] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 20 22:11:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:03.281831 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dd85f3-9be2-4276-953b-0ede65dac6c3 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:03.290076 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-eaf334c8-6dcd-4e9b-ba6a-796a7f8fe1d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:11:03.290076 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:03.290076 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:03.290076 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:03.290076 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:03.290076 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:03.290076 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:03.290076 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:03.290076 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:03.290076 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:03.290076 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:03.290076 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:03.290076 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 22:11:03.290076 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 22:11:03.290076 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 22:11:03.290076 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 22:11:03.291053 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:03.291053 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:03.291053 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:03.291053 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:03.291053 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:03.291053 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:03.291053 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:03.291053 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:03.291053 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:03.291053 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:03.291053 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:03.291053 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:03.291053 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:03.291053 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:03.291053 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:03.291053 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:03.291053 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 22:11:03.291919 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 22:11:03.291919 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:11:03.291919 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:11:03.293996 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 301/591] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 20 22:11:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:03.295671 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf334c8-6dcd-4e9b-ba6a-796a7f8fe1d0 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:03.372067 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:03.411651 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:03.415912 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dd85f3-9be2-4276-953b-0ede65dac6c3 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:03.444056 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf334c8-6dcd-4e9b-ba6a-796a7f8fe1d0 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:03.460248 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012498e2-f9c9-4d06-a916-123c2046d754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:03.461346 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012498e2-f9c9-4d06-a916-123c2046d754 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:03.461695 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012498e2-f9c9-4d06-a916-123c2046d754 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:03.462298 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012498e2-f9c9-4d06-a916-123c2046d754 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:03.476821 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012498e2-f9c9-4d06-a916-123c2046d754 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:03.478973 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012498e2-f9c9-4d06-a916-123c2046d754 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:03.483315 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe8b1ee-b928-4a1f-8d00-257877781468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:03.484133 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe8b1ee-b928-4a1f-8d00-257877781468 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:03.484573 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe8b1ee-b928-4a1f-8d00-257877781468 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:03.484986 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe8b1ee-b928-4a1f-8d00-257877781468 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:03.495605 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe8b1ee-b928-4a1f-8d00-257877781468 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:03.496575 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-012498e2-f9c9-4d06-a916-123c2046d754 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:11:03.496575 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:03.496575 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:03.496575 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:03.496575 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:03.496575 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:03.496575 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:03.496575 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:03.496575 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:03.496575 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:03.496575 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:03.496575 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:03.496575 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 22:11:03.496575 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 22:11:03.496575 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 22:11:03.496575 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 22:11:03.497677 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:03.497677 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:03.497677 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:03.497677 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:03.497677 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:03.497677 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:03.497677 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:03.497677 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:03.497677 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:03.497677 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:03.497677 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:03.497677 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:03.497677 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:03.497677 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:03.497677 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:03.497677 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:03.497677 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 22:11:03.498798 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 22:11:03.498798 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:11:03.498798 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:11:03.499829 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 291/592] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 20 22:11:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:03.499940 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe8b1ee-b928-4a1f-8d00-257877781468 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:03.500984 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012498e2-f9c9-4d06-a916-123c2046d754 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:03.512721 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-abe8b1ee-b928-4a1f-8d00-257877781468 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 20 22:11:03.512721 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:03.512721 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:03.512721 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:03.512721 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:03.512721 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:03.512721 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:03.512721 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:03.512721 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:03.512721 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:03.512721 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:03.512721 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:03.512721 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 20 22:11:03.512721 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 20 22:11:03.512721 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 20 22:11:03.512721 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 20 22:11:03.513697 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:03.513697 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:03.513697 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 20 22:11:03.513697 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 22:11:03.513697 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 20 22:11:03.513697 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 22:11:03.513697 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:03.513697 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:03.513697 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:03.513697 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:03.513697 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:03.513697 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:03.513697 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:03.513697 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:03.513697 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:03.513697 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:03.513697 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:03.513697 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:03.514692 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:03.514692 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:03.514692 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 20 22:11:03.514692 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 20 22:11:03.514692 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 20 22:11:03.514692 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 20 22:11:03.514692 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 20 22:11:03.514692 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 20 22:11:03.514692 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 20 22:11:03.514692 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:11:03.521946 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 302/593] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Sep 20 22:11:03 2022] GET /identity/v3/users/neutron => generated 85 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:03.521946 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe8b1ee-b928-4a1f-8d00-257877781468 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:03.623607 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012498e2-f9c9-4d06-a916-123c2046d754 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:03.634958 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe8b1ee-b928-4a1f-8d00-257877781468 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:03.650033 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:03.666072 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4993141-150c-4e27-9788-a60d0c05887c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:03.667048 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4993141-150c-4e27-9788-a60d0c05887c None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:03.667667 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4993141-150c-4e27-9788-a60d0c05887c None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:03.668137 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4993141-150c-4e27-9788-a60d0c05887c None admin] PATH_INFO: `/v3/domains` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:03.669036 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4993141-150c-4e27-9788-a60d0c05887c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:03.669580 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4993141-150c-4e27-9788-a60d0c05887c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:03.671175 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4993141-150c-4e27-9788-a60d0c05887c None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:03.673155 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc0274b-4d77-47ec-99b8-bd50f75c3232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:03.673759 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc0274b-4d77-47ec-99b8-bd50f75c3232 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:03.674035 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc0274b-4d77-47ec-99b8-bd50f75c3232 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:03.674310 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc0274b-4d77-47ec-99b8-bd50f75c3232 None admin] PATH_INFO: `/v3/domains` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:03.675022 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc0274b-4d77-47ec-99b8-bd50f75c3232 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:03.675326 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc0274b-4d77-47ec-99b8-bd50f75c3232 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:03.676672 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc0274b-4d77-47ec-99b8-bd50f75c3232 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:03.686583 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:03.689162 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 292/594] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 20 22:11:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:03.690385 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4993141-150c-4e27-9788-a60d0c05887c None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:03.695370 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 303/595] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 20 22:11:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:03.696507 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc0274b-4d77-47ec-99b8-bd50f75c3232 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:03.797562 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4993141-150c-4e27-9788-a60d0c05887c None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:03.811028 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc0274b-4d77-47ec-99b8-bd50f75c3232 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:03.833370 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82683366-d3cb-4b27-a0c1-be874a9aeed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:03.834153 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82683366-d3cb-4b27-a0c1-be874a9aeed4 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:03.834619 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82683366-d3cb-4b27-a0c1-be874a9aeed4 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:03.834997 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82683366-d3cb-4b27-a0c1-be874a9aeed4 None admin] PATH_INFO: `/v3/users` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:03.835734 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82683366-d3cb-4b27-a0c1-be874a9aeed4 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:03.836058 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82683366-d3cb-4b27-a0c1-be874a9aeed4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:03.837478 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82683366-d3cb-4b27-a0c1-be874a9aeed4 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:03.850054 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ceb086-2bc9-4a0f-a247-3ab1f5ee7f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:03.850919 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ceb086-2bc9-4a0f-a247-3ab1f5ee7f22 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:03.851362 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ceb086-2bc9-4a0f-a247-3ab1f5ee7f22 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:03.852262 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ceb086-2bc9-4a0f-a247-3ab1f5ee7f22 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:03.854996 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 293/596] 10.222.0.33 () {56 vars in 1139 bytes} [Tue Sep 20 22:11:03 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:03.855820 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82683366-d3cb-4b27-a0c1-be874a9aeed4 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:03.864513 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ceb086-2bc9-4a0f-a247-3ab1f5ee7f22 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:03.866819 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ceb086-2bc9-4a0f-a247-3ab1f5ee7f22 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:03.879643 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-55ceb086-2bc9-4a0f-a247-3ab1f5ee7f22 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 22:11:03.879643 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:03.879643 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:03.879643 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:03.879643 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:03.879643 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:03.879643 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:03.879643 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:03.879643 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:03.879643 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:03.879643 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:03.879643 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:03.879643 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 20 22:11:03.879643 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 20 22:11:03.879643 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 20 22:11:03.885916 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 20 22:11:03.885916 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:03.885916 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:03.885916 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:03.885916 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:03.885916 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:03.885916 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:03.885916 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:03.885916 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:03.885916 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:03.885916 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:03.885916 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:03.885916 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:03.885916 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:03.885916 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:03.885916 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:03.885916 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:03.886890 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 20 22:11:03.886890 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 20 22:11:03.886890 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 20 22:11:03.886890 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 20 22:11:03.886890 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 20 22:11:03.886890 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 20 22:11:03.886890 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 22:11:03.886890 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:11:03.886890 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 304/597] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Sep 20 22:11:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:03.886890 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c271d5-9c2b-4753-9b7e-8dc358d7d045 None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:03.886890 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c271d5-9c2b-4753-9b7e-8dc358d7d045 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:03.887496 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c271d5-9c2b-4753-9b7e-8dc358d7d045 None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:03.887496 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 305/598] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:11:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:11:03.887496 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c271d5-9c2b-4753-9b7e-8dc358d7d045 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:03.908944 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:03.953384 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:03.971207 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82683366-d3cb-4b27-a0c1-be874a9aeed4 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:04.001006 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c271d5-9c2b-4753-9b7e-8dc358d7d045 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:04.006126 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbdea6c-7a8a-4090-a82f-fee52b886caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:04.006791 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbdea6c-7a8a-4090-a82f-fee52b886caf None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:04.007072 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbdea6c-7a8a-4090-a82f-fee52b886caf None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:04.007346 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbdea6c-7a8a-4090-a82f-fee52b886caf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:04.014224 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbdea6c-7a8a-4090-a82f-fee52b886caf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:04.015736 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbdea6c-7a8a-4090-a82f-fee52b886caf None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:04.028193 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-5dbdea6c-7a8a-4090-a82f-fee52b886caf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 22:11:04.028193 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:04.028193 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:04.028193 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:04.028193 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:04.028193 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:04.028193 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:04.028193 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:04.028193 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:04.028193 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:04.028193 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:04.028193 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:04.028193 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 20 22:11:04.028193 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 20 22:11:04.028193 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 20 22:11:04.029321 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 20 22:11:04.029321 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:04.029321 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:04.029321 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:04.029321 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:04.029321 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:04.029321 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:04.029321 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:04.029321 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:04.029321 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:04.029321 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:04.029321 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:04.029321 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:04.029321 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:04.029321 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:04.029321 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:04.029321 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:04.030582 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 20 22:11:04.030582 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 20 22:11:04.030582 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 20 22:11:04.030582 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 20 22:11:04.030582 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 20 22:11:04.030582 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 20 22:11:04.030582 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 22:11:04.030582 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:11:04.030582 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 294/599] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Sep 20 22:11:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:04.030582 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbdea6c-7a8a-4090-a82f-fee52b886caf None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:04.046038 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c7ba5a-751b-4e89-a29b-bf6b27a05739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:04.046694 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c7ba5a-751b-4e89-a29b-bf6b27a05739 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:04.046974 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c7ba5a-751b-4e89-a29b-bf6b27a05739 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:04.047244 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c7ba5a-751b-4e89-a29b-bf6b27a05739 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:04.060090 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c7ba5a-751b-4e89-a29b-bf6b27a05739 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:04.061627 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c7ba5a-751b-4e89-a29b-bf6b27a05739 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:04.076169 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-37c7ba5a-751b-4e89-a29b-bf6b27a05739 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:11:04.076169 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:04.076169 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:04.076169 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:04.076169 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:04.076169 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:04.076169 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:04.076169 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:04.076169 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:04.076169 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:04.076169 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:04.076169 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:04.076169 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 22:11:04.076169 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 22:11:04.076169 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 22:11:04.076169 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 22:11:04.077313 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:04.077313 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:04.077313 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:04.077313 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:04.077313 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:04.077313 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:04.077313 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:04.077313 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:04.077313 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:04.077313 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:04.077313 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:04.077313 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:04.077313 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:04.077313 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:04.077313 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:04.077313 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:04.077313 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 22:11:04.078376 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 22:11:04.078376 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:11:04.078376 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:11:04.083955 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 306/600] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 20 22:11:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:04.083955 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557e64f0-effa-42ab-8f90-56048fb8e103 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:04.083955 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557e64f0-effa-42ab-8f90-56048fb8e103 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:04.083955 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557e64f0-effa-42ab-8f90-56048fb8e103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:04.099496 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-557e64f0-effa-42ab-8f90-56048fb8e103 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:11:04.100800 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-557e64f0-effa-42ab-8f90-56048fb8e103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:11:04.140435 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:04.143939 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbdea6c-7a8a-4090-a82f-fee52b886caf None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:04.167101 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 307/601] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:11:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 22:11:04.167996 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557e64f0-effa-42ab-8f90-56048fb8e103 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:04.183799 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89512f8-c44a-401b-b1a9-a0344d578b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:04.184630 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89512f8-c44a-401b-b1a9-a0344d578b37 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:04.185169 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89512f8-c44a-401b-b1a9-a0344d578b37 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:04.185634 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89512f8-c44a-401b-b1a9-a0344d578b37 None admin] PATH_INFO: `/v3/projects` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:04.186657 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89512f8-c44a-401b-b1a9-a0344d578b37 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:04.187239 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89512f8-c44a-401b-b1a9-a0344d578b37 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:04.188847 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89512f8-c44a-401b-b1a9-a0344d578b37 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:04.202968 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 295/602] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Sep 20 22:11:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:04.204031 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89512f8-c44a-401b-b1a9-a0344d578b37 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:04.228676 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:04.295609 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557e64f0-effa-42ab-8f90-56048fb8e103 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:04.325627 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89512f8-c44a-401b-b1a9-a0344d578b37 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:04.336420 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb5ff22-edff-45f6-9eac-4d160512ab26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:04.337642 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb5ff22-edff-45f6-9eac-4d160512ab26 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:04.338119 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb5ff22-edff-45f6-9eac-4d160512ab26 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:04.338897 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb5ff22-edff-45f6-9eac-4d160512ab26 None admin] PATH_INFO: `/v3/projects` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:04.340040 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb5ff22-edff-45f6-9eac-4d160512ab26 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:04.340519 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb5ff22-edff-45f6-9eac-4d160512ab26 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:04.342193 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb5ff22-edff-45f6-9eac-4d160512ab26 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:04.356393 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 308/603] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Sep 20 22:11:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:04.357472 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb5ff22-edff-45f6-9eac-4d160512ab26 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:04.366940 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fb6e4b-c138-40e8-9420-be975f8bff77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:04.368305 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fb6e4b-c138-40e8-9420-be975f8bff77 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:04.368657 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fb6e4b-c138-40e8-9420-be975f8bff77 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:04.368998 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fb6e4b-c138-40e8-9420-be975f8bff77 None admin] PATH_INFO: `/v3/domains` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:04.369718 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fb6e4b-c138-40e8-9420-be975f8bff77 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:04.370090 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fb6e4b-c138-40e8-9420-be975f8bff77 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:04.372045 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fb6e4b-c138-40e8-9420-be975f8bff77 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:04.388244 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 296/604] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 20 22:11:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:04.389982 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fb6e4b-c138-40e8-9420-be975f8bff77 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:04.423506 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:04.477223 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb5ff22-edff-45f6-9eac-4d160512ab26 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:04.478741 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:04.511996 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6e44ce-929b-4156-9fbb-f2e547f14898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:04.512730 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6e44ce-929b-4156-9fbb-f2e547f14898 None admin] REQUEST_METHOD: `PUT` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:04.512916 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6e44ce-929b-4156-9fbb-f2e547f14898 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:04.513186 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6e44ce-929b-4156-9fbb-f2e547f14898 None admin] PATH_INFO: `/v3/projects/3ce415d02aa9489bae19cd514805fd8c/users/6577c8b14c1f4279beac13b9ba11aba1/roles/6d6dcbd3bc16491db00308c3b7d27a63` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:04.514962 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fb6e4b-c138-40e8-9420-be975f8bff77 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:04.527642 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6e44ce-929b-4156-9fbb-f2e547f14898 None admin] RBAC: Authorizing `identity:create_grant(project_id=3ce415d02aa9489bae19cd514805fd8c, user_id=6577c8b14c1f4279beac13b9ba11aba1, role_id=6d6dcbd3bc16491db00308c3b7d27a63)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:04.529063 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6e44ce-929b-4156-9fbb-f2e547f14898 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:04.541919 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 309/605] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Sep 20 22:11:04 2022] PUT /identity/v3/projects/3ce415d02aa9489bae19cd514805fd8c/users/6577c8b14c1f4279beac13b9ba11aba1/roles/6d6dcbd3bc16491db00308c3b7d27a63 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:11:04.542493 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6e44ce-929b-4156-9fbb-f2e547f14898 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:04.564789 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2697b88-80f1-4bc1-bee6-69c488854bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:04.565920 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2697b88-80f1-4bc1-bee6-69c488854bb0 None admin] REQUEST_METHOD: `PUT` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:04.566407 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2697b88-80f1-4bc1-bee6-69c488854bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:04.566878 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2697b88-80f1-4bc1-bee6-69c488854bb0 None admin] PATH_INFO: `/v3/projects/3ce415d02aa9489bae19cd514805fd8c/users/fbecfbbf24fd425ca99499fd44d8c7a8/roles/6d6dcbd3bc16491db00308c3b7d27a63` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:04.585194 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2697b88-80f1-4bc1-bee6-69c488854bb0 None admin] RBAC: Authorizing `identity:create_grant(project_id=3ce415d02aa9489bae19cd514805fd8c, user_id=fbecfbbf24fd425ca99499fd44d8c7a8, role_id=6d6dcbd3bc16491db00308c3b7d27a63)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:04.586632 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2697b88-80f1-4bc1-bee6-69c488854bb0 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:04.607239 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 297/606] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Sep 20 22:11:04 2022] PUT /identity/v3/projects/3ce415d02aa9489bae19cd514805fd8c/users/fbecfbbf24fd425ca99499fd44d8c7a8/roles/6d6dcbd3bc16491db00308c3b7d27a63 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:11:04.608248 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2697b88-80f1-4bc1-bee6-69c488854bb0 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:04.677048 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6e44ce-929b-4156-9fbb-f2e547f14898 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:04.735767 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:04.738971 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f336c709-4305-4475-bec8-0c149e4f0eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:04.739624 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f336c709-4305-4475-bec8-0c149e4f0eaa None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:04.744989 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f336c709-4305-4475-bec8-0c149e4f0eaa None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:04.745421 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f336c709-4305-4475-bec8-0c149e4f0eaa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:04.757890 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f336c709-4305-4475-bec8-0c149e4f0eaa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:04.759402 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f336c709-4305-4475-bec8-0c149e4f0eaa None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:04.778322 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-f336c709-4305-4475-bec8-0c149e4f0eaa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 22:11:04.778322 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:04.778322 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:04.778322 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:04.778322 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:04.778322 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:04.778322 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:04.778322 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:04.778322 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:04.778322 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:04.778322 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:04.778322 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:04.778322 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 20 22:11:04.778322 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 20 22:11:04.778322 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 20 22:11:04.779330 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 20 22:11:04.779330 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:04.779330 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:04.779330 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:04.779330 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:04.779330 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:04.779330 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:04.779330 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:04.779330 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:04.779330 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:04.779330 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:04.779330 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:04.779330 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:04.779330 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:04.779330 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:04.779330 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:04.779330 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:04.780215 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 20 22:11:04.780215 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 20 22:11:04.780215 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 20 22:11:04.780215 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 20 22:11:04.780215 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 20 22:11:04.780215 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 20 22:11:04.780215 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 22:11:04.780215 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:11:04.780215 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 310/607] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Sep 20 22:11:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:04.785202 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f336c709-4305-4475-bec8-0c149e4f0eaa None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:04.797709 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2697b88-80f1-4bc1-bee6-69c488854bb0 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:04.809004 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:04.842417 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afeacd1-aa30-4636-b681-1242a99a3dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:04.843127 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afeacd1-aa30-4636-b681-1242a99a3dfe None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:04.843374 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afeacd1-aa30-4636-b681-1242a99a3dfe None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:04.843641 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afeacd1-aa30-4636-b681-1242a99a3dfe None admin] PATH_INFO: `/v3/roles/service` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:04.859983 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afeacd1-aa30-4636-b681-1242a99a3dfe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 22:11:04.865981 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-3afeacd1-aa30-4636-b681-1242a99a3dfe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 20 22:11:04.865981 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:04.865981 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:04.865981 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:04.865981 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:04.865981 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:04.865981 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:04.865981 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:04.865981 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:04.865981 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:04.865981 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:04.865981 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:04.865981 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 22:11:04.865981 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 22:11:04.865981 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 22:11:04.865981 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 22:11:04.867249 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 22:11:04.867249 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 22:11:04.867249 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 22:11:04.867249 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 22:11:04.867249 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:04.867249 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:04.867249 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:04.867249 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:04.867249 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:04.867249 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:04.867249 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:04.867249 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:04.867249 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:04.867249 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:04.867249 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:04.867249 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:04.868203 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:04.868203 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:04.868203 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:04.868203 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:04.868203 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 22:11:04.868203 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 22:11:04.868203 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 22:11:04.868203 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 22:11:04.868203 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 22:11:04.868203 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 22:11:04.868203 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 20 22:11:04.868203 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:11:04.868883 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 298/608] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Sep 20 22:11:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:04.875228 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afeacd1-aa30-4636-b681-1242a99a3dfe None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:04.935456 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f336c709-4305-4475-bec8-0c149e4f0eaa None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:04.979166 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677e790d-248e-4df9-afba-8945cde4bcaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:04.980141 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677e790d-248e-4df9-afba-8945cde4bcaf None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:04.980922 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677e790d-248e-4df9-afba-8945cde4bcaf None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:04.981834 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677e790d-248e-4df9-afba-8945cde4bcaf None admin] PATH_INFO: `/v3/projects` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:04.983063 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677e790d-248e-4df9-afba-8945cde4bcaf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:04.983690 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677e790d-248e-4df9-afba-8945cde4bcaf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:04.985420 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677e790d-248e-4df9-afba-8945cde4bcaf None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:04.990996 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afeacd1-aa30-4636-b681-1242a99a3dfe None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:05.000974 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 311/609] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Sep 20 22:11:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:05.008855 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677e790d-248e-4df9-afba-8945cde4bcaf None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:05.027396 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:05.034009 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df674b1-fa21-4afc-ad01-f628956faa36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:05.034426 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df674b1-fa21-4afc-ad01-f628956faa36 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:05.034857 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df674b1-fa21-4afc-ad01-f628956faa36 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:05.035597 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df674b1-fa21-4afc-ad01-f628956faa36 None admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:05.036690 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df674b1-fa21-4afc-ad01-f628956faa36 None admin] RBAC: Adding query filter params (name=service) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:05.037886 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df674b1-fa21-4afc-ad01-f628956faa36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:05.039612 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df674b1-fa21-4afc-ad01-f628956faa36 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:05.048573 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 299/610] 10.222.0.33 () {56 vars in 1103 bytes} [Tue Sep 20 22:11:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:05.054979 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df674b1-fa21-4afc-ad01-f628956faa36 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:05.096802 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:05.150038 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677e790d-248e-4df9-afba-8945cde4bcaf None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:05.222632 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df674b1-fa21-4afc-ad01-f628956faa36 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:05.227164 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019884e5-5b53-4c79-82da-2a5975e91036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:05.227993 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019884e5-5b53-4c79-82da-2a5975e91036 None admin] REQUEST_METHOD: `PUT` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:05.228597 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019884e5-5b53-4c79-82da-2a5975e91036 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:05.229625 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019884e5-5b53-4c79-82da-2a5975e91036 None admin] PATH_INFO: `/v3/projects/3ce415d02aa9489bae19cd514805fd8c/users/e9b0b3ca4ecd41aaba9cf8e0f91fbf54/roles/6d6dcbd3bc16491db00308c3b7d27a63` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:05.264183 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019884e5-5b53-4c79-82da-2a5975e91036 None admin] RBAC: Authorizing `identity:create_grant(project_id=3ce415d02aa9489bae19cd514805fd8c, user_id=e9b0b3ca4ecd41aaba9cf8e0f91fbf54, role_id=6d6dcbd3bc16491db00308c3b7d27a63)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:05.265627 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019884e5-5b53-4c79-82da-2a5975e91036 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:05.280514 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb0f42d-4464-4fc6-bd43-f6cec54a24c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:05.281161 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb0f42d-4464-4fc6-bd43-f6cec54a24c9 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:05.281561 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb0f42d-4464-4fc6-bd43-f6cec54a24c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:05.281839 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb0f42d-4464-4fc6-bd43-f6cec54a24c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:05.291657 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 312/611] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Sep 20 22:11:05 2022] PUT /identity/v3/projects/3ce415d02aa9489bae19cd514805fd8c/users/e9b0b3ca4ecd41aaba9cf8e0f91fbf54/roles/6d6dcbd3bc16491db00308c3b7d27a63 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:11:05.308256 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb0f42d-4464-4fc6-bd43-f6cec54a24c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:05.309834 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb0f42d-4464-4fc6-bd43-f6cec54a24c9 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:05.332990 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-bbb0f42d-4464-4fc6-bd43-f6cec54a24c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:11:05.332990 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:05.332990 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:05.332990 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:05.332990 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:05.332990 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:05.332990 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:05.332990 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:05.332990 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:05.332990 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:05.332990 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:05.332990 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:05.332990 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 22:11:05.332990 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 22:11:05.332990 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 22:11:05.332990 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 22:11:05.334628 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:05.334628 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:05.334628 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:05.334628 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:05.334628 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:05.334628 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:05.334628 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:05.334628 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:05.334628 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:05.334628 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:05.334628 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:05.334628 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:05.334628 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:05.334628 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:05.334628 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:05.334628 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:05.334628 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 22:11:05.335513 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 22:11:05.335513 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:11:05.335513 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:11:05.335513 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 300/612] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 20 22:11:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 20 22:11:05.340717 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019884e5-5b53-4c79-82da-2a5975e91036 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:05.460171 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019884e5-5b53-4c79-82da-2a5975e91036 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:05.486460 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:05.498052 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1b82c7-90a4-4896-b3fc-31d5df44b1e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:05.499128 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1b82c7-90a4-4896-b3fc-31d5df44b1e0 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:05.499813 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1b82c7-90a4-4896-b3fc-31d5df44b1e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:05.499813 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1b82c7-90a4-4896-b3fc-31d5df44b1e0 None admin] PATH_INFO: `/v3/domains` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:05.500313 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1b82c7-90a4-4896-b3fc-31d5df44b1e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:05.500618 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1b82c7-90a4-4896-b3fc-31d5df44b1e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:05.502224 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1b82c7-90a4-4896-b3fc-31d5df44b1e0 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:05.516617 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 313/613] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 20 22:11:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:05.522767 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb0f42d-4464-4fc6-bd43-f6cec54a24c9 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:05.543895 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af94afd-b341-4bbe-9f6c-ffadc3bb903e None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:05.544532 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af94afd-b341-4bbe-9f6c-ffadc3bb903e None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:05.545004 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af94afd-b341-4bbe-9f6c-ffadc3bb903e None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:05.546544 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 314/614] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:11:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 20 22:11:05.560444 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde77667-0bc5-4afb-be4c-d503d368810c None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:05.560804 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde77667-0bc5-4afb-be4c-d503d368810c None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:05.560979 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde77667-0bc5-4afb-be4c-d503d368810c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:05.585861 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:05.593546 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-cde77667-0bc5-4afb-be4c-d503d368810c None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:11:05.594760 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-cde77667-0bc5-4afb-be4c-d503d368810c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:11:05.657982 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb0f42d-4464-4fc6-bd43-f6cec54a24c9 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:05.672564 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 315/615] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:11:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 20 22:11:05.715273 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70460cba-332b-401c-a449-7f68ff57f7a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:05.715924 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70460cba-332b-401c-a449-7f68ff57f7a4 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:05.716204 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70460cba-332b-401c-a449-7f68ff57f7a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:05.716480 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70460cba-332b-401c-a449-7f68ff57f7a4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:05.725019 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70460cba-332b-401c-a449-7f68ff57f7a4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:05.726525 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70460cba-332b-401c-a449-7f68ff57f7a4 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:05.738230 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-70460cba-332b-401c-a449-7f68ff57f7a4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 20 22:11:05.738230 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:05.738230 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:05.738230 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:05.738230 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:05.738230 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:05.738230 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:05.738230 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:05.738230 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:05.738230 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:05.738230 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:05.738230 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:05.738230 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 20 22:11:05.738230 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 20 22:11:05.738230 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 20 22:11:05.738230 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 20 22:11:05.739190 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:05.739190 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:05.739190 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 20 22:11:05.739190 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 22:11:05.739190 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 20 22:11:05.739190 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 22:11:05.739190 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:05.739190 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:05.739190 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:05.739190 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:05.739190 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:05.739190 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:05.739190 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:05.739190 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:05.739190 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:05.739190 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:05.739190 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:05.739190 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:05.740154 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:05.740154 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:05.740154 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 20 22:11:05.740154 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 20 22:11:05.740154 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 20 22:11:05.740154 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 20 22:11:05.740154 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 20 22:11:05.740154 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 20 22:11:05.740154 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 20 22:11:05.740154 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:11:05.740154 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 301/616] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Sep 20 22:11:05 2022] GET /identity/v3/users/swift => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:05.747748 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde77667-0bc5-4afb-be4c-d503d368810c None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:05.869021 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde77667-0bc5-4afb-be4c-d503d368810c None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:05.886906 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:05.906784 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a54e17-a5f7-4544-8fe4-3e9d91320885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:05.907401 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a54e17-a5f7-4544-8fe4-3e9d91320885 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:05.907680 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a54e17-a5f7-4544-8fe4-3e9d91320885 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:05.907952 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a54e17-a5f7-4544-8fe4-3e9d91320885 None admin] PATH_INFO: `/v3/users` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:05.908751 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a54e17-a5f7-4544-8fe4-3e9d91320885 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:05.909059 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a54e17-a5f7-4544-8fe4-3e9d91320885 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:05.910480 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a54e17-a5f7-4544-8fe4-3e9d91320885 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:05.929998 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 316/617] 10.222.0.33 () {56 vars in 1135 bytes} [Tue Sep 20 22:11:05 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:05.935410 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70460cba-332b-401c-a449-7f68ff57f7a4 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:06.074400 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70460cba-332b-401c-a449-7f68ff57f7a4 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:06.076828 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:06.116129 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a54e17-a5f7-4544-8fe4-3e9d91320885 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:06.119846 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa88bfbd-2e2f-4cc9-9f24-a5cf1ddb10c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:06.120486 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa88bfbd-2e2f-4cc9-9f24-a5cf1ddb10c6 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:06.120766 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa88bfbd-2e2f-4cc9-9f24-a5cf1ddb10c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:06.121040 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa88bfbd-2e2f-4cc9-9f24-a5cf1ddb10c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:06.132014 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa88bfbd-2e2f-4cc9-9f24-a5cf1ddb10c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:06.133456 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa88bfbd-2e2f-4cc9-9f24-a5cf1ddb10c6 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:06.148589 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-aa88bfbd-2e2f-4cc9-9f24-a5cf1ddb10c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:11:06.148589 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:06.148589 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:06.148589 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:06.148589 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:06.148589 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:06.148589 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:06.148589 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:06.148589 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:06.148589 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:06.148589 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:06.148589 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:06.148589 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 22:11:06.148589 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 22:11:06.148589 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 22:11:06.148589 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 22:11:06.149545 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:06.149545 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:06.149545 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:06.149545 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:06.149545 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:06.149545 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:06.149545 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:06.149545 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:06.149545 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:06.149545 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:06.149545 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:06.149545 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:06.149545 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:06.149545 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:06.149545 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:06.149545 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:06.149545 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 22:11:06.150441 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 22:11:06.150441 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:11:06.150441 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:11:06.151889 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 302/618] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 20 22:11:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 20 22:11:06.156910 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa88bfbd-2e2f-4cc9-9f24-a5cf1ddb10c6 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:06.311890 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a54e17-a5f7-4544-8fe4-3e9d91320885 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:06.351240 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa88bfbd-2e2f-4cc9-9f24-a5cf1ddb10c6 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:06.377947 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf10d6d7-5a4b-41ec-a386-7ceee0d3262a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:06.378605 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf10d6d7-5a4b-41ec-a386-7ceee0d3262a None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:06.378882 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf10d6d7-5a4b-41ec-a386-7ceee0d3262a None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:06.379147 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf10d6d7-5a4b-41ec-a386-7ceee0d3262a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:06.395722 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf10d6d7-5a4b-41ec-a386-7ceee0d3262a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 22:11:06.400509 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-cf10d6d7-5a4b-41ec-a386-7ceee0d3262a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 20 22:11:06.400509 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:06.400509 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:06.400509 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:06.400509 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:06.400509 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:06.400509 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:06.400509 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:06.400509 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:06.400509 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:06.400509 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:06.400509 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:06.400509 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 22:11:06.400509 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 22:11:06.400509 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 22:11:06.400509 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 22:11:06.401566 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 22:11:06.401566 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 22:11:06.401566 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 22:11:06.401566 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 22:11:06.401566 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:06.401566 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:06.401566 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:06.401566 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:06.401566 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:06.401566 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:06.401566 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:06.401566 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:06.401566 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:06.401566 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:06.401566 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:06.401566 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:06.402404 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:06.402404 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:06.402404 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:06.402404 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:06.402404 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 22:11:06.402404 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 22:11:06.402404 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 22:11:06.402404 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 22:11:06.402404 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 22:11:06.402404 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 22:11:06.402404 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 20 22:11:06.402404 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:11:06.407186 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 317/619] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Sep 20 22:11:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:06.409631 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf10d6d7-5a4b-41ec-a386-7ceee0d3262a None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:06.415930 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb004e7-26e2-47d8-9883-bc5e00ed4cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:06.416546 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb004e7-26e2-47d8-9883-bc5e00ed4cb3 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:06.416825 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb004e7-26e2-47d8-9883-bc5e00ed4cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:06.417097 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb004e7-26e2-47d8-9883-bc5e00ed4cb3 None admin] PATH_INFO: `/v3/domains` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:06.417743 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb004e7-26e2-47d8-9883-bc5e00ed4cb3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:06.418046 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb004e7-26e2-47d8-9883-bc5e00ed4cb3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:06.419441 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb004e7-26e2-47d8-9883-bc5e00ed4cb3 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:06.439583 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 303/620] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 20 22:11:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:06.445230 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb004e7-26e2-47d8-9883-bc5e00ed4cb3 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:06.471197 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:06.473553 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:06.552546 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf10d6d7-5a4b-41ec-a386-7ceee0d3262a None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:06.589708 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a515d0b-6469-4f69-86e4-be4b22dfe7fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:06.590320 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a515d0b-6469-4f69-86e4-be4b22dfe7fa None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:06.590651 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a515d0b-6469-4f69-86e4-be4b22dfe7fa None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:06.590929 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a515d0b-6469-4f69-86e4-be4b22dfe7fa None admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:06.591591 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a515d0b-6469-4f69-86e4-be4b22dfe7fa None admin] RBAC: Adding query filter params (name=service) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:06.591894 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a515d0b-6469-4f69-86e4-be4b22dfe7fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:06.593321 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a515d0b-6469-4f69-86e4-be4b22dfe7fa None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:06.602594 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 318/621] 10.222.0.33 () {56 vars in 1103 bytes} [Tue Sep 20 22:11:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:06.613868 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a515d0b-6469-4f69-86e4-be4b22dfe7fa None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:06.646298 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb004e7-26e2-47d8-9883-bc5e00ed4cb3 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:06.715262 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb38ce8-8c07-40da-922b-d5aa8458abeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:06.715919 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb38ce8-8c07-40da-922b-d5aa8458abeb None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:06.716203 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb38ce8-8c07-40da-922b-d5aa8458abeb None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:06.716463 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb38ce8-8c07-40da-922b-d5aa8458abeb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:06.717380 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:06.721137 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a515d0b-6469-4f69-86e4-be4b22dfe7fa None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:06.734669 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb38ce8-8c07-40da-922b-d5aa8458abeb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:06.736163 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb38ce8-8c07-40da-922b-d5aa8458abeb None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:06.759886 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-0fb38ce8-8c07-40da-922b-d5aa8458abeb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 22:11:06.759886 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:06.759886 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:06.759886 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:06.759886 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:06.759886 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:06.759886 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:06.759886 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:06.759886 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:06.759886 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:06.759886 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:06.759886 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:06.759886 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 20 22:11:06.759886 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 20 22:11:06.759886 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 20 22:11:06.760849 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 20 22:11:06.760849 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:06.760849 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:06.760849 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:06.760849 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:06.760849 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:06.760849 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:06.760849 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:06.760849 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:06.760849 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:06.760849 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:06.760849 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:06.760849 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:06.760849 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:06.760849 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:06.760849 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:06.760849 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:06.761751 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 20 22:11:06.761751 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 20 22:11:06.761751 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 20 22:11:06.761751 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 20 22:11:06.761751 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 20 22:11:06.761751 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 20 22:11:06.761751 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 22:11:06.761751 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:11:06.763953 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 304/622] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Sep 20 22:11:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:06.769373 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb38ce8-8c07-40da-922b-d5aa8458abeb None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:06.783338 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb58633-70d3-4db7-804b-46b88e412d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:06.783980 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb58633-70d3-4db7-804b-46b88e412d04 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:06.784264 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb58633-70d3-4db7-804b-46b88e412d04 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:06.784597 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb58633-70d3-4db7-804b-46b88e412d04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:06.806829 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb58633-70d3-4db7-804b-46b88e412d04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:06.808288 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb58633-70d3-4db7-804b-46b88e412d04 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:06.839200 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-ceb58633-70d3-4db7-804b-46b88e412d04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:11:06.839200 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:06.839200 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:06.839200 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:06.839200 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:06.839200 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:06.839200 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:06.839200 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:06.839200 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:06.839200 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:06.839200 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:06.839200 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:06.839200 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 22:11:06.839200 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 22:11:06.839200 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 22:11:06.839200 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 22:11:06.840192 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:06.840192 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:06.840192 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:06.840192 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:06.840192 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:06.840192 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:06.840192 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:06.840192 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:06.840192 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:06.840192 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:06.840192 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:06.840192 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:06.840192 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:06.840192 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:06.840192 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:06.840192 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:06.840192 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 22:11:06.841078 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 22:11:06.841078 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:11:06.841078 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:11:06.841078 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 319/623] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 20 22:11:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:06.847154 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb58633-70d3-4db7-804b-46b88e412d04 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:06.911731 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:06.961274 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb38ce8-8c07-40da-922b-d5aa8458abeb None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:07.031884 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c33eca-4db1-42d5-b07e-e5f762339906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:07.032508 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c33eca-4db1-42d5-b07e-e5f762339906 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:07.032796 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c33eca-4db1-42d5-b07e-e5f762339906 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:07.032903 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb58633-70d3-4db7-804b-46b88e412d04 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:07.033064 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c33eca-4db1-42d5-b07e-e5f762339906 None admin] PATH_INFO: `/v3/projects` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:07.033861 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c33eca-4db1-42d5-b07e-e5f762339906 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:07.034172 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c33eca-4db1-42d5-b07e-e5f762339906 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:07.035697 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c33eca-4db1-42d5-b07e-e5f762339906 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:07.067880 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 305/624] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Sep 20 22:11:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 22:11:07.074199 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c33eca-4db1-42d5-b07e-e5f762339906 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:07.077971 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d1563f-04e7-4b28-b4b5-bd1d8fc48d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:07.078622 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d1563f-04e7-4b28-b4b5-bd1d8fc48d06 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:07.080699 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d1563f-04e7-4b28-b4b5-bd1d8fc48d06 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:07.080979 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d1563f-04e7-4b28-b4b5-bd1d8fc48d06 None admin] PATH_INFO: `/v3/domains` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:07.081635 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d1563f-04e7-4b28-b4b5-bd1d8fc48d06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:07.081944 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d1563f-04e7-4b28-b4b5-bd1d8fc48d06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:07.089274 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d1563f-04e7-4b28-b4b5-bd1d8fc48d06 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:07.114995 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 320/625] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 20 22:11:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:07.117154 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d1563f-04e7-4b28-b4b5-bd1d8fc48d06 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:07.123788 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:07.261491 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c33eca-4db1-42d5-b07e-e5f762339906 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:07.286226 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d1563f-04e7-4b28-b4b5-bd1d8fc48d06 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:07.314928 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c962d3f-2f6d-4dca-81cb-4301ceeb039a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:07.316000 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c962d3f-2f6d-4dca-81cb-4301ceeb039a None admin] REQUEST_METHOD: `PUT` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:07.316598 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c962d3f-2f6d-4dca-81cb-4301ceeb039a None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:07.317075 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c962d3f-2f6d-4dca-81cb-4301ceeb039a None admin] PATH_INFO: `/v3/projects/3ce415d02aa9489bae19cd514805fd8c/users/257983500d7b430c8f0377b2aa743ae0/roles/6d6dcbd3bc16491db00308c3b7d27a63` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:07.321608 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:07.332078 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73eeb9c-7671-4062-824b-12f87275edff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:07.332995 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73eeb9c-7671-4062-824b-12f87275edff None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:07.332995 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73eeb9c-7671-4062-824b-12f87275edff None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:07.333280 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73eeb9c-7671-4062-824b-12f87275edff None admin] PATH_INFO: `/v3/users/nova` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:07.336646 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c962d3f-2f6d-4dca-81cb-4301ceeb039a None admin] RBAC: Authorizing `identity:create_grant(project_id=3ce415d02aa9489bae19cd514805fd8c, user_id=257983500d7b430c8f0377b2aa743ae0, role_id=6d6dcbd3bc16491db00308c3b7d27a63)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:07.338312 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c962d3f-2f6d-4dca-81cb-4301ceeb039a None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:07.341080 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73eeb9c-7671-4062-824b-12f87275edff None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:07.342730 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73eeb9c-7671-4062-824b-12f87275edff None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:07.353442 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 306/626] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Sep 20 22:11:07 2022] PUT /identity/v3/projects/3ce415d02aa9489bae19cd514805fd8c/users/257983500d7b430c8f0377b2aa743ae0/roles/6d6dcbd3bc16491db00308c3b7d27a63 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 22:11:07.355122 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203924bd-be28-4373-a60e-d97424c54e51 None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:07.355620 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203924bd-be28-4373-a60e-d97424c54e51 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:07.356095 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203924bd-be28-4373-a60e-d97424c54e51 None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:07.356316 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-e73eeb9c-7671-4062-824b-12f87275edff None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 20 22:11:07.356316 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:07.356316 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:07.356316 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:07.356316 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:07.356316 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:07.356316 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:07.356316 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:07.356316 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:07.356316 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:07.356316 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:07.356316 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:07.356316 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 20 22:11:07.356316 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 20 22:11:07.356316 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 20 22:11:07.356316 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 20 22:11:07.357231 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:07.357231 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:07.357231 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 20 22:11:07.357231 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 22:11:07.357231 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 20 22:11:07.357231 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 22:11:07.357231 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:07.357231 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:07.357231 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:07.357231 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:07.357231 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:07.357231 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:07.357231 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:07.357231 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:07.357231 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:07.357231 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:07.357231 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:07.357231 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:07.363322 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:07.363322 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:07.363322 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 20 22:11:07.363322 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 20 22:11:07.363322 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 20 22:11:07.363322 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 20 22:11:07.363322 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 20 22:11:07.363322 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 20 22:11:07.363322 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 20 22:11:07.363322 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:11:07.363322 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 321/627] 10.222.0.33 () {56 vars in 1093 bytes} [Tue Sep 20 22:11:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:07.363915 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 307/628] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:11:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:11:07.367846 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73eeb9c-7671-4062-824b-12f87275edff None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:07.371837 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd5ad6-b11b-4340-9db6-b4a8ccd49901 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:07.371986 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd5ad6-b11b-4340-9db6-b4a8ccd49901 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:07.372264 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd5ad6-b11b-4340-9db6-b4a8ccd49901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:07.393167 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-b9bd5ad6-b11b-4340-9db6-b4a8ccd49901 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:11:07.394461 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-b9bd5ad6-b11b-4340-9db6-b4a8ccd49901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:11:07.451909 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:07.493227 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 308/629] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:11:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 22:11:07.493227 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ad2a77-b865-4566-825c-d80159ba648e None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:07.493227 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ad2a77-b865-4566-825c-d80159ba648e None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:07.493227 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ad2a77-b865-4566-825c-d80159ba648e None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:07.493227 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 309/630] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:11:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:11:07.498812 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c07dbd3-0ff0-48e1-9063-b4eea893cc66 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:07.499250 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c07dbd3-0ff0-48e1-9063-b4eea893cc66 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:07.499639 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c07dbd3-0ff0-48e1-9063-b4eea893cc66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:07.499998 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73eeb9c-7671-4062-824b-12f87275edff None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:07.523078 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-9c07dbd3-0ff0-48e1-9063-b4eea893cc66 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:11:07.524730 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-9c07dbd3-0ff0-48e1-9063-b4eea893cc66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:11:07.578333 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd656af1-6dc5-4d43-a1b1-6c32f23fe4b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:07.579014 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd656af1-6dc5-4d43-a1b1-6c32f23fe4b9 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:07.579255 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd656af1-6dc5-4d43-a1b1-6c32f23fe4b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:07.579523 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd656af1-6dc5-4d43-a1b1-6c32f23fe4b9 None admin] PATH_INFO: `/v3/users` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:07.580285 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd656af1-6dc5-4d43-a1b1-6c32f23fe4b9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:07.580590 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd656af1-6dc5-4d43-a1b1-6c32f23fe4b9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:07.582043 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd656af1-6dc5-4d43-a1b1-6c32f23fe4b9 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:07.601264 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 322/631] 10.222.0.33 () {56 vars in 1133 bytes} [Tue Sep 20 22:11:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:07.606795 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd656af1-6dc5-4d43-a1b1-6c32f23fe4b9 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:07.633678 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 310/632] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:11:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 22:11:07.726204 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd656af1-6dc5-4d43-a1b1-6c32f23fe4b9 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:07.754494 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:07.770701 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9738db8-bcaf-409f-946a-2ff14a4f9385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:07.771657 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9738db8-bcaf-409f-946a-2ff14a4f9385 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:07.772163 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9738db8-bcaf-409f-946a-2ff14a4f9385 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:07.772653 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9738db8-bcaf-409f-946a-2ff14a4f9385 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:07.848593 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9738db8-bcaf-409f-946a-2ff14a4f9385 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:07.850626 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9738db8-bcaf-409f-946a-2ff14a4f9385 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:07.861243 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c07dbd3-0ff0-48e1-9063-b4eea893cc66 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:07.946945 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:07.966143 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 323/633] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 20 22:11:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 20 22:11:07.967444 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91c1fd4-e596-4258-a729-823522c1bec9 None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:07.967827 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91c1fd4-e596-4258-a729-823522c1bec9 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:07.968100 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91c1fd4-e596-4258-a729-823522c1bec9 None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:07.969675 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 324/634] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:11:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:11:07.972599 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91c1fd4-e596-4258-a729-823522c1bec9 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:08.004390 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:08.009483 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c07dbd3-0ff0-48e1-9063-b4eea893cc66 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:08.049485 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5185e9a5-8016-4ab4-b785-8d91776ddb72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:08.050439 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5185e9a5-8016-4ab4-b785-8d91776ddb72 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:08.050741 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5185e9a5-8016-4ab4-b785-8d91776ddb72 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:08.051011 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5185e9a5-8016-4ab4-b785-8d91776ddb72 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:08.062833 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5185e9a5-8016-4ab4-b785-8d91776ddb72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 22:11:08.067687 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-5185e9a5-8016-4ab4-b785-8d91776ddb72 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 20 22:11:08.067687 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:08.067687 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:08.067687 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:08.067687 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:08.067687 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:08.067687 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:08.067687 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:08.067687 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:08.067687 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:08.067687 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:08.067687 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:08.067687 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 22:11:08.067687 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 22:11:08.067687 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 22:11:08.067687 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 22:11:08.068874 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 22:11:08.068874 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 22:11:08.068874 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 22:11:08.068874 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 22:11:08.068874 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:08.068874 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:08.068874 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:08.068874 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:08.068874 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:08.068874 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:08.068874 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:08.068874 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:08.068874 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:08.068874 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:08.068874 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:08.068874 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:08.069711 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:08.069711 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:08.069711 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:08.069711 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:08.069711 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 22:11:08.069711 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 22:11:08.069711 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 22:11:08.069711 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 22:11:08.069711 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 22:11:08.069711 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 22:11:08.069711 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 20 22:11:08.069711 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:11:08.069711 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 311/635] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Sep 20 22:11:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:08.070578 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9d40a7-2125-4c3f-9491-dd29a1522700 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:08.070578 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9d40a7-2125-4c3f-9491-dd29a1522700 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:08.071199 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9d40a7-2125-4c3f-9491-dd29a1522700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:08.092268 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-8d9d40a7-2125-4c3f-9491-dd29a1522700 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:11:08.093458 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-8d9d40a7-2125-4c3f-9491-dd29a1522700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:11:08.101309 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91c1fd4-e596-4258-a729-823522c1bec9 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:08.138126 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6099573a-2e84-4f44-a31c-f7576faf35e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:08.138783 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6099573a-2e84-4f44-a31c-f7576faf35e3 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:08.139173 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6099573a-2e84-4f44-a31c-f7576faf35e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:08.139442 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6099573a-2e84-4f44-a31c-f7576faf35e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:08.150780 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6099573a-2e84-4f44-a31c-f7576faf35e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:08.152325 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6099573a-2e84-4f44-a31c-f7576faf35e3 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:08.159514 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 312/636] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:11:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 22:11:08.160349 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9d40a7-2125-4c3f-9491-dd29a1522700 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:08.176481 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-6099573a-2e84-4f44-a31c-f7576faf35e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:11:08.176481 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:08.176481 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:08.176481 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:08.176481 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:08.176481 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:08.176481 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:08.176481 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:08.176481 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:08.176481 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:08.176481 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:08.176481 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:08.176481 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 22:11:08.176481 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 22:11:08.176481 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 22:11:08.176481 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 22:11:08.177434 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:08.177434 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:08.177434 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:08.177434 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:08.177434 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:08.177434 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:08.177434 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:08.177434 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:08.177434 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:08.177434 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:08.177434 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:08.177434 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:08.177434 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:08.177434 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:08.177434 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:08.177434 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:08.177434 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 22:11:08.178365 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 22:11:08.178365 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:11:08.178365 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:11:08.184683 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 325/637] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 20 22:11:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 20 22:11:08.185522 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6099573a-2e84-4f44-a31c-f7576faf35e3 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:08.214956 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:08.262851 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:08.270709 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9d40a7-2125-4c3f-9491-dd29a1522700 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:08.289562 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6099573a-2e84-4f44-a31c-f7576faf35e3 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:08.309607 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b7025f-d022-4323-88e9-9ed4c54c6bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:08.310518 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b7025f-d022-4323-88e9-9ed4c54c6bff None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:08.310853 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b7025f-d022-4323-88e9-9ed4c54c6bff None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:08.311220 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b7025f-d022-4323-88e9-9ed4c54c6bff None admin] PATH_INFO: `/v3/roles/service` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:08.322550 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b7025f-d022-4323-88e9-9ed4c54c6bff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 22:11:08.328394 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d10049f-bb3e-403f-952f-f3d7d953da68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:08.329128 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-a6b7025f-d022-4323-88e9-9ed4c54c6bff None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 20 22:11:08.329128 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:08.329128 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:08.329128 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:08.329128 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:08.329128 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:08.329128 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:08.329128 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:08.329128 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:08.329128 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:08.329128 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:08.329128 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:08.329128 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 22:11:08.329128 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 22:11:08.329128 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 22:11:08.329128 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 22:11:08.330267 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 22:11:08.330267 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 22:11:08.330267 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 22:11:08.330267 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 22:11:08.330267 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:08.330267 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:08.330267 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:08.330267 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:08.330267 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:08.330267 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:08.330267 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:08.330267 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:08.330267 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:08.330267 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:08.330267 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:08.330267 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:08.331328 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:08.331328 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:08.331328 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:08.331328 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:08.331328 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 22:11:08.331328 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 22:11:08.331328 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 22:11:08.331328 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 22:11:08.331328 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 22:11:08.331328 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 22:11:08.331328 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 20 22:11:08.331328 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:11:08.332201 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d10049f-bb3e-403f-952f-f3d7d953da68 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:08.332619 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d10049f-bb3e-403f-952f-f3d7d953da68 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:08.333043 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d10049f-bb3e-403f-952f-f3d7d953da68 None admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:08.334418 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d10049f-bb3e-403f-952f-f3d7d953da68 None admin] RBAC: Adding query filter params (name=service) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:08.334922 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d10049f-bb3e-403f-952f-f3d7d953da68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:08.336535 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d10049f-bb3e-403f-952f-f3d7d953da68 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:08.338326 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 313/638] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Sep 20 22:11:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:08.339536 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b7025f-d022-4323-88e9-9ed4c54c6bff None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:08.346353 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 326/639] 10.222.0.33 () {56 vars in 1103 bytes} [Tue Sep 20 22:11:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:08.347445 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d10049f-bb3e-403f-952f-f3d7d953da68 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:08.441126 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:08.448077 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b7025f-d022-4323-88e9-9ed4c54c6bff None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:08.451224 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d10049f-bb3e-403f-952f-f3d7d953da68 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:08.484329 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c21a98f-88c8-41d1-8fdc-9a99b188213c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:08.484944 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c21a98f-88c8-41d1-8fdc-9a99b188213c None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:08.485221 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c21a98f-88c8-41d1-8fdc-9a99b188213c None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:08.485488 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c21a98f-88c8-41d1-8fdc-9a99b188213c None admin] PATH_INFO: `/v3/domains` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:08.486156 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c21a98f-88c8-41d1-8fdc-9a99b188213c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:08.486450 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c21a98f-88c8-41d1-8fdc-9a99b188213c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:08.487866 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c21a98f-88c8-41d1-8fdc-9a99b188213c None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:08.488247 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79562961-a008-44db-920e-26f9ddb83bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:08.488862 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79562961-a008-44db-920e-26f9ddb83bc0 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:08.489140 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79562961-a008-44db-920e-26f9ddb83bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:08.489483 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79562961-a008-44db-920e-26f9ddb83bc0 None admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:08.490097 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79562961-a008-44db-920e-26f9ddb83bc0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:08.490403 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79562961-a008-44db-920e-26f9ddb83bc0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:08.491806 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79562961-a008-44db-920e-26f9ddb83bc0 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:08.494611 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:08.501422 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 314/640] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 20 22:11:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:08.502078 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c21a98f-88c8-41d1-8fdc-9a99b188213c None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:08.510630 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 327/641] 10.222.0.33 () {56 vars in 1103 bytes} [Tue Sep 20 22:11:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:08.510630 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79562961-a008-44db-920e-26f9ddb83bc0 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:08.607769 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c21a98f-88c8-41d1-8fdc-9a99b188213c None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:08.613319 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79562961-a008-44db-920e-26f9ddb83bc0 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:08.644330 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c4bbcc-5e17-4f3a-ae57-32df0346ed45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:08.644972 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c4bbcc-5e17-4f3a-ae57-32df0346ed45 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:08.645229 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c4bbcc-5e17-4f3a-ae57-32df0346ed45 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:08.645495 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c4bbcc-5e17-4f3a-ae57-32df0346ed45 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:08.649200 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be5ef47-d45e-423f-91d8-b09528a057ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:08.649823 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be5ef47-d45e-423f-91d8-b09528a057ed None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:08.650103 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be5ef47-d45e-423f-91d8-b09528a057ed None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:08.650373 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be5ef47-d45e-423f-91d8-b09528a057ed None admin] PATH_INFO: `/v3/roles/service` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:08.657229 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c4bbcc-5e17-4f3a-ae57-32df0346ed45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:08.659123 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c4bbcc-5e17-4f3a-ae57-32df0346ed45 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:08.660624 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be5ef47-d45e-423f-91d8-b09528a057ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 22:11:08.665406 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-3be5ef47-d45e-423f-91d8-b09528a057ed None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 20 22:11:08.665406 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:08.665406 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:08.665406 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:08.665406 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:08.665406 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:08.665406 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:08.665406 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:08.665406 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:08.665406 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:08.665406 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:08.665406 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:08.665406 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 22:11:08.665406 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 22:11:08.665406 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 22:11:08.665406 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 22:11:08.666483 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 22:11:08.666483 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 22:11:08.666483 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 22:11:08.666483 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 22:11:08.666483 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:08.666483 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:08.666483 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:08.666483 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:08.666483 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:08.666483 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:08.666483 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:08.666483 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:08.666483 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:08.666483 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:08.666483 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:08.666483 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:08.667337 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:08.667337 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:08.667337 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:08.667337 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:08.667337 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 22:11:08.667337 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 22:11:08.667337 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 22:11:08.667337 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 22:11:08.667337 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 22:11:08.667337 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 22:11:08.667337 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 20 22:11:08.667337 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:11:08.667337 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 328/642] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Sep 20 22:11:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:08.668022 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be5ef47-d45e-423f-91d8-b09528a057ed None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:08.680853 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-95c4bbcc-5e17-4f3a-ae57-32df0346ed45 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:11:08.680853 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:08.680853 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:08.680853 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:08.680853 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:08.680853 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:08.680853 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:08.680853 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:08.680853 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:08.680853 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:08.680853 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:08.680853 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:08.680853 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 22:11:08.680853 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 22:11:08.680853 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 22:11:08.680853 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 22:11:08.682047 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:08.682047 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:08.682047 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:08.682047 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:08.682047 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:08.682047 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:08.682047 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:08.682047 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:08.682047 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:08.682047 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:08.682047 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:08.682047 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:08.682047 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:08.682047 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:08.682047 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:08.682047 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:08.682047 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 22:11:08.683027 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 22:11:08.683027 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:11:08.683027 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:11:08.688302 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 315/643] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 20 22:11:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:08.688302 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c4bbcc-5e17-4f3a-ae57-32df0346ed45 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:08.699632 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:08.734394 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:08.777892 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be5ef47-d45e-423f-91d8-b09528a057ed None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:08.799420 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c4bbcc-5e17-4f3a-ae57-32df0346ed45 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:08.813896 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fc82c3-1ab0-4eb8-b457-4c69de90b885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:08.814547 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fc82c3-1ab0-4eb8-b457-4c69de90b885 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:08.814831 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fc82c3-1ab0-4eb8-b457-4c69de90b885 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:08.815103 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fc82c3-1ab0-4eb8-b457-4c69de90b885 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:08.822492 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fc82c3-1ab0-4eb8-b457-4c69de90b885 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:08.823990 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fc82c3-1ab0-4eb8-b457-4c69de90b885 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:08.834837 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3615fb9f-9cc8-496b-8c34-15480c0dc363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:08.835460 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3615fb9f-9cc8-496b-8c34-15480c0dc363 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:08.835736 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3615fb9f-9cc8-496b-8c34-15480c0dc363 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:08.836002 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3615fb9f-9cc8-496b-8c34-15480c0dc363 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:08.836130 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-b6fc82c3-1ab0-4eb8-b457-4c69de90b885 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 22:11:08.836130 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:08.836130 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:08.836130 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:08.836130 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:08.836130 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:08.836130 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:08.836130 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:08.836130 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:08.836130 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:08.836130 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:08.836130 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:08.836130 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 20 22:11:08.836130 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 20 22:11:08.836130 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 20 22:11:08.836924 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 20 22:11:08.836924 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:08.836924 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:08.836924 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:08.836924 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:08.836924 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:08.836924 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:08.836924 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:08.836924 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:08.836924 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:08.836924 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:08.836924 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:08.836924 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:08.836924 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:08.836924 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:08.836924 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:08.836924 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:08.837964 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 20 22:11:08.837964 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 20 22:11:08.837964 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 20 22:11:08.837964 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 20 22:11:08.837964 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 20 22:11:08.837964 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 20 22:11:08.837964 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 22:11:08.837964 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:11:08.837964 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 329/644] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Sep 20 22:11:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:08.837964 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fc82c3-1ab0-4eb8-b457-4c69de90b885 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:08.850525 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3615fb9f-9cc8-496b-8c34-15480c0dc363 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:08.851982 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3615fb9f-9cc8-496b-8c34-15480c0dc363 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:08.865881 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-3615fb9f-9cc8-496b-8c34-15480c0dc363 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:11:08.865881 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:08.865881 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:08.865881 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:08.865881 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:08.865881 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:08.865881 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:08.865881 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:08.865881 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:08.865881 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:08.865881 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:08.865881 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:08.865881 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 22:11:08.865881 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 22:11:08.865881 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 22:11:08.865881 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 22:11:08.867008 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:08.867008 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:08.867008 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:08.867008 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:08.867008 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:08.867008 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:08.867008 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:08.867008 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:08.867008 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:08.867008 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:08.867008 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:08.867008 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:08.867008 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:08.867008 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:08.867008 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:08.867008 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:08.867008 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 22:11:08.867916 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 22:11:08.867916 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:11:08.867916 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:11:08.867916 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 316/645] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 20 22:11:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:08.868148 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3615fb9f-9cc8-496b-8c34-15480c0dc363 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:08.930784 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:08.950957 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fc82c3-1ab0-4eb8-b457-4c69de90b885 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:08.969368 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:08.972927 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3615fb9f-9cc8-496b-8c34-15480c0dc363 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:08.989753 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b20825e-679d-4778-b26a-22ad69c0ebf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:08.990702 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b20825e-679d-4778-b26a-22ad69c0ebf6 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:08.990979 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b20825e-679d-4778-b26a-22ad69c0ebf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:08.991246 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b20825e-679d-4778-b26a-22ad69c0ebf6 None admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:08.991901 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b20825e-679d-4778-b26a-22ad69c0ebf6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:08.992200 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b20825e-679d-4778-b26a-22ad69c0ebf6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:08.994316 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b20825e-679d-4778-b26a-22ad69c0ebf6 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:09.007176 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 330/646] 10.222.0.33 () {56 vars in 1103 bytes} [Tue Sep 20 22:11:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:09.007176 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b20825e-679d-4778-b26a-22ad69c0ebf6 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:09.011788 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e6e278-7801-4541-8ef4-d662aab1e209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:09.012392 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e6e278-7801-4541-8ef4-d662aab1e209 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:09.012666 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e6e278-7801-4541-8ef4-d662aab1e209 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:09.012931 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e6e278-7801-4541-8ef4-d662aab1e209 None admin] PATH_INFO: `/v3/domains` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:09.013562 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e6e278-7801-4541-8ef4-d662aab1e209 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:09.014120 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e6e278-7801-4541-8ef4-d662aab1e209 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:09.015289 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e6e278-7801-4541-8ef4-d662aab1e209 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:09.027796 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 317/647] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 20 22:11:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:09.028355 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e6e278-7801-4541-8ef4-d662aab1e209 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:09.114534 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b20825e-679d-4778-b26a-22ad69c0ebf6 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:09.130924 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e6e278-7801-4541-8ef4-d662aab1e209 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:09.150002 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddee72fa-8964-4554-b09d-f2e73dabbf73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:09.150629 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddee72fa-8964-4554-b09d-f2e73dabbf73 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:09.150904 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddee72fa-8964-4554-b09d-f2e73dabbf73 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:09.151171 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddee72fa-8964-4554-b09d-f2e73dabbf73 None admin] PATH_INFO: `/v3/projects` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:09.151847 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddee72fa-8964-4554-b09d-f2e73dabbf73 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:09.152148 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddee72fa-8964-4554-b09d-f2e73dabbf73 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:09.153113 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:09.153565 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddee72fa-8964-4554-b09d-f2e73dabbf73 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:09.168109 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca58a567-632a-405a-b44f-e8783e0665fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:09.168763 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 331/648] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Sep 20 22:11:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:09.168873 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca58a567-632a-405a-b44f-e8783e0665fc None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:09.169179 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca58a567-632a-405a-b44f-e8783e0665fc None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:09.169492 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca58a567-632a-405a-b44f-e8783e0665fc None admin] PATH_INFO: `/v3/domains` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:09.170209 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca58a567-632a-405a-b44f-e8783e0665fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:09.170620 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca58a567-632a-405a-b44f-e8783e0665fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:09.171995 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca58a567-632a-405a-b44f-e8783e0665fc None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:09.174052 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddee72fa-8964-4554-b09d-f2e73dabbf73 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:09.186001 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 318/649] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 20 22:11:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:09.187004 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca58a567-632a-405a-b44f-e8783e0665fc None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:09.218613 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:09.282106 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddee72fa-8964-4554-b09d-f2e73dabbf73 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:09.300879 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca58a567-632a-405a-b44f-e8783e0665fc None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:09.319623 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20422e4a-8931-40c2-8239-632519bfac1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:09.320246 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20422e4a-8931-40c2-8239-632519bfac1c None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:09.320521 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20422e4a-8931-40c2-8239-632519bfac1c None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:09.320784 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20422e4a-8931-40c2-8239-632519bfac1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:09.330915 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20422e4a-8931-40c2-8239-632519bfac1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:09.332338 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20422e4a-8931-40c2-8239-632519bfac1c None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:09.336801 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee6a2ca-83ca-4855-b322-f9486ad0ac91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:09.337438 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee6a2ca-83ca-4855-b322-f9486ad0ac91 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:09.337720 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee6a2ca-83ca-4855-b322-f9486ad0ac91 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:09.337992 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee6a2ca-83ca-4855-b322-f9486ad0ac91 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:09.345608 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee6a2ca-83ca-4855-b322-f9486ad0ac91 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:09.347338 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee6a2ca-83ca-4855-b322-f9486ad0ac91 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:09.348388 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-20422e4a-8931-40c2-8239-632519bfac1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:11:09.348388 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:09.348388 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:09.348388 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:09.348388 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:09.348388 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:09.348388 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:09.348388 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:09.348388 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:09.348388 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:09.348388 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:09.348388 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:09.348388 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 22:11:09.348388 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 22:11:09.348388 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 22:11:09.348388 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 22:11:09.349299 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:09.349299 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:09.349299 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:09.349299 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:09.349299 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:09.349299 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:09.349299 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:09.349299 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:09.349299 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:09.349299 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:09.349299 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:09.349299 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:09.349299 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:09.349299 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:09.349299 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:09.349299 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:09.349299 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 22:11:09.350256 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 22:11:09.350256 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:11:09.350256 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:11:09.350891 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 332/650] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 20 22:11:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:09.351445 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20422e4a-8931-40c2-8239-632519bfac1c None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:09.362877 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-bee6a2ca-83ca-4855-b322-f9486ad0ac91 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 20 22:11:09.362877 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:09.362877 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:09.362877 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:09.362877 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:09.362877 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:09.362877 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:09.362877 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:09.362877 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:09.362877 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:09.362877 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:09.362877 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:09.362877 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 20 22:11:09.362877 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 20 22:11:09.362877 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 20 22:11:09.362877 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 20 22:11:09.363913 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:09.363913 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:09.363913 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 20 22:11:09.363913 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 22:11:09.363913 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 20 22:11:09.363913 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 22:11:09.363913 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:09.363913 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:09.363913 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:09.363913 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:09.363913 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:09.363913 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:09.363913 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:09.363913 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:09.363913 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:09.363913 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:09.363913 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:09.363913 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:09.364877 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:09.364877 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:09.364877 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 20 22:11:09.364877 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 20 22:11:09.364877 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 20 22:11:09.364877 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 20 22:11:09.364877 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 20 22:11:09.364877 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 20 22:11:09.364877 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 20 22:11:09.364877 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:11:09.364877 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 319/651] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 20 22:11:09 2022] GET /identity/v3/users/cinder => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:09.364877 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee6a2ca-83ca-4855-b322-f9486ad0ac91 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:09.415707 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:09.449707 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:09.459963 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20422e4a-8931-40c2-8239-632519bfac1c None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:09.483535 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee6a2ca-83ca-4855-b322-f9486ad0ac91 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:09.494755 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ce2d6f-4582-488a-abc8-7c880fa111ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:09.495359 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce2d6f-4582-488a-abc8-7c880fa111ca None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:09.495639 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce2d6f-4582-488a-abc8-7c880fa111ca None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:09.495911 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce2d6f-4582-488a-abc8-7c880fa111ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:09.496641 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ce2d6f-4582-488a-abc8-7c880fa111ca None admin] RBAC: Adding query filter params (role.id=6d6dcbd3bc16491db00308c3b7d27a63, scope.project.id=3ce415d02aa9489bae19cd514805fd8c, user.id=db7eed561e99452289a662ad326cf919) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:09.497065 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ce2d6f-4582-488a-abc8-7c880fa111ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:09.498365 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ce2d6f-4582-488a-abc8-7c880fa111ca None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:09.504380 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 333/652] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Sep 20 22:11:09 2022] GET /identity/v3/role_assignments?user.id=db7eed561e99452289a662ad326cf919&scope.project.id=3ce415d02aa9489bae19cd514805fd8c&role.id=6d6dcbd3bc16491db00308c3b7d27a63 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:09.504992 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ce2d6f-4582-488a-abc8-7c880fa111ca None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:09.534005 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0637ee-a54c-4703-a46f-124efe4a7563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:09.535292 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0637ee-a54c-4703-a46f-124efe4a7563 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:09.535750 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0637ee-a54c-4703-a46f-124efe4a7563 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:09.536439 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0637ee-a54c-4703-a46f-124efe4a7563 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:09.549599 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0637ee-a54c-4703-a46f-124efe4a7563 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:09.552140 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0637ee-a54c-4703-a46f-124efe4a7563 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:09.569925 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-7a0637ee-a54c-4703-a46f-124efe4a7563 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 20 22:11:09.569925 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:09.569925 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:09.569925 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:09.569925 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:09.569925 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:09.569925 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:09.569925 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:09.569925 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:09.569925 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:09.569925 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:09.569925 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:09.569925 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 20 22:11:09.569925 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 20 22:11:09.569925 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 20 22:11:09.569925 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 20 22:11:09.570985 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:09.570985 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:09.570985 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 20 22:11:09.570985 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 22:11:09.570985 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 20 22:11:09.570985 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 22:11:09.570985 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:09.570985 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:09.570985 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:09.570985 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:09.570985 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:09.570985 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:09.570985 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:09.570985 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:09.570985 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:09.570985 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:09.570985 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:09.570985 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:09.571928 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:09.571928 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:09.571928 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 20 22:11:09.571928 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 20 22:11:09.571928 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 20 22:11:09.571928 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 20 22:11:09.571928 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 20 22:11:09.571928 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 20 22:11:09.571928 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 20 22:11:09.571928 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:11:09.571928 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 320/653] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 20 22:11:09 2022] GET /identity/v3/users/glance => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:09.578803 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0637ee-a54c-4703-a46f-124efe4a7563 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:09.632597 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ce2d6f-4582-488a-abc8-7c880fa111ca None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:09.673677 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b7109c-feec-4983-8378-63776bec8ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:09.674368 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b7109c-feec-4983-8378-63776bec8ae2 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:09.674698 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b7109c-feec-4983-8378-63776bec8ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:09.674979 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b7109c-feec-4983-8378-63776bec8ae2 None admin] PATH_INFO: `/v3/domains` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:09.676098 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b7109c-feec-4983-8378-63776bec8ae2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:09.676098 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b7109c-feec-4983-8378-63776bec8ae2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:09.677382 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b7109c-feec-4983-8378-63776bec8ae2 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:09.692685 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 334/654] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 20 22:11:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:09.694284 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b7109c-feec-4983-8378-63776bec8ae2 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:09.713236 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:09.716385 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0637ee-a54c-4703-a46f-124efe4a7563 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:09.717850 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:09.765021 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d48705f-79c2-40c2-8cc5-9fd62748a974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:09.765564 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d48705f-79c2-40c2-8cc5-9fd62748a974 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:09.765845 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d48705f-79c2-40c2-8cc5-9fd62748a974 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:09.766116 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d48705f-79c2-40c2-8cc5-9fd62748a974 None admin] PATH_INFO: `/v3/users` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:09.766888 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d48705f-79c2-40c2-8cc5-9fd62748a974 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:09.767198 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d48705f-79c2-40c2-8cc5-9fd62748a974 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:09.768635 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d48705f-79c2-40c2-8cc5-9fd62748a974 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:09.789960 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 321/655] 10.222.0.33 () {56 vars in 1137 bytes} [Tue Sep 20 22:11:09 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:09.790679 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d48705f-79c2-40c2-8cc5-9fd62748a974 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:09.824268 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b7109c-feec-4983-8378-63776bec8ae2 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:09.859894 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18816cd-5d74-469a-8549-a73937f5ed6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:09.860504 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18816cd-5d74-469a-8549-a73937f5ed6a None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:09.860783 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18816cd-5d74-469a-8549-a73937f5ed6a None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:09.861056 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18816cd-5d74-469a-8549-a73937f5ed6a None admin] PATH_INFO: `/v3/users` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:09.861779 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18816cd-5d74-469a-8549-a73937f5ed6a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:09.862086 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18816cd-5d74-469a-8549-a73937f5ed6a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:09.863553 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18816cd-5d74-469a-8549-a73937f5ed6a None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:09.882818 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 335/656] 10.222.0.33 () {56 vars in 1137 bytes} [Tue Sep 20 22:11:09 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:09.884110 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3f7dd6-e8ba-42d5-941f-996abb9ca98d None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:09.884397 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3f7dd6-e8ba-42d5-941f-996abb9ca98d None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:09.884667 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3f7dd6-e8ba-42d5-941f-996abb9ca98d None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:09.885989 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 336/657] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:11:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:11:09.887316 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3f7dd6-e8ba-42d5-941f-996abb9ca98d None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:09.903649 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d48705f-79c2-40c2-8cc5-9fd62748a974 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:09.940048 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925d141e-415d-45e2-ad05-0fe33c48a47b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:09.940676 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925d141e-415d-45e2-ad05-0fe33c48a47b None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:09.941016 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925d141e-415d-45e2-ad05-0fe33c48a47b None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:09.941221 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925d141e-415d-45e2-ad05-0fe33c48a47b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:09.949585 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925d141e-415d-45e2-ad05-0fe33c48a47b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:09.952016 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925d141e-415d-45e2-ad05-0fe33c48a47b None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:09.968796 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-925d141e-415d-45e2-ad05-0fe33c48a47b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 20 22:11:09.968796 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:09.968796 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:09.968796 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:09.968796 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:09.968796 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:09.968796 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:09.968796 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:09.968796 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:09.968796 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:09.968796 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:09.968796 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:09.968796 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 20 22:11:09.968796 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 20 22:11:09.968796 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 20 22:11:09.968796 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 20 22:11:09.969780 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:09.969780 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:09.969780 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 20 22:11:09.969780 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 22:11:09.969780 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 20 22:11:09.969780 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 22:11:09.969780 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:09.969780 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:09.969780 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:09.969780 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:09.969780 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:09.969780 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:09.969780 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:09.969780 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:09.969780 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:09.969780 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:09.969780 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:09.969780 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:09.970782 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:09.970782 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:09.970782 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 20 22:11:09.970782 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 20 22:11:09.970782 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 20 22:11:09.970782 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 20 22:11:09.970782 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 20 22:11:09.970782 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 20 22:11:09.970782 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 20 22:11:09.970782 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:11:09.972160 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:09.977885 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 322/658] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Sep 20 22:11:09 2022] GET /identity/v3/users/neutron => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:09.977885 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925d141e-415d-45e2-ad05-0fe33c48a47b None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:09.995338 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:10.003472 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3f7dd6-e8ba-42d5-941f-996abb9ca98d None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:10.039682 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8d8bdb-45ad-48e0-8bd3-d73b3254bf6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:10.040210 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8d8bdb-45ad-48e0-8bd3-d73b3254bf6c None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:10.040486 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8d8bdb-45ad-48e0-8bd3-d73b3254bf6c None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:10.040755 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8d8bdb-45ad-48e0-8bd3-d73b3254bf6c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:10.080512 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925d141e-415d-45e2-ad05-0fe33c48a47b None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:10.114224 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8d8bdb-45ad-48e0-8bd3-d73b3254bf6c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:10.116294 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8d8bdb-45ad-48e0-8bd3-d73b3254bf6c None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:10.117086 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3aea69-7c52-4825-b17e-5af7ffc0f4d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:10.117697 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3aea69-7c52-4825-b17e-5af7ffc0f4d3 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:10.118022 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3aea69-7c52-4825-b17e-5af7ffc0f4d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:10.118240 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3aea69-7c52-4825-b17e-5af7ffc0f4d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:10.188548 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3aea69-7c52-4825-b17e-5af7ffc0f4d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:10.190068 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3aea69-7c52-4825-b17e-5af7ffc0f4d3 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:10.195758 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:10.209049 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:10.223358 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 337/659] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 20 22:11:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 20 22:11:10.225127 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a36b24a-bb61-4929-a931-f9e1f1288079 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:10.225411 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a36b24a-bb61-4929-a931-f9e1f1288079 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:10.225686 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a36b24a-bb61-4929-a931-f9e1f1288079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:10.247038 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-5a36b24a-bb61-4929-a931-f9e1f1288079 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:11:10.248509 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-5a36b24a-bb61-4929-a931-f9e1f1288079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:11:10.305038 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 323/660] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 20 22:11:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 20 22:11:10.305673 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3aea69-7c52-4825-b17e-5af7ffc0f4d3 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:10.328018 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 338/661] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:11:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 22:11:10.328867 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a36b24a-bb61-4929-a931-f9e1f1288079 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:10.436158 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a36b24a-bb61-4929-a931-f9e1f1288079 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:10.439131 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:10.439959 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3aea69-7c52-4825-b17e-5af7ffc0f4d3 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:10.459770 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:10.479561 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea0b972-ba6a-4ae9-8d2c-070984f43629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:10.480171 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea0b972-ba6a-4ae9-8d2c-070984f43629 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:10.480445 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea0b972-ba6a-4ae9-8d2c-070984f43629 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:10.480716 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea0b972-ba6a-4ae9-8d2c-070984f43629 None admin] PATH_INFO: `/v3/users` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:10.480897 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76d64b7-7872-4bce-887b-0ca07aecc63f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:10.481448 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea0b972-ba6a-4ae9-8d2c-070984f43629 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:10.481747 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea0b972-ba6a-4ae9-8d2c-070984f43629 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:10.482163 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76d64b7-7872-4bce-887b-0ca07aecc63f None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:10.482694 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76d64b7-7872-4bce-887b-0ca07aecc63f None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:10.483168 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76d64b7-7872-4bce-887b-0ca07aecc63f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:10.483356 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea0b972-ba6a-4ae9-8d2c-070984f43629 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:10.500635 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76d64b7-7872-4bce-887b-0ca07aecc63f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:10.503284 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76d64b7-7872-4bce-887b-0ca07aecc63f None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:10.509005 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 324/662] 10.222.0.33 () {56 vars in 1139 bytes} [Tue Sep 20 22:11:10 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:10.509005 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea0b972-ba6a-4ae9-8d2c-070984f43629 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:10.528065 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-c76d64b7-7872-4bce-887b-0ca07aecc63f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:11:10.528065 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:10.528065 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:10.528065 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:10.528065 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:10.528065 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:10.528065 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:10.528065 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:10.528065 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:10.528065 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:10.528065 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:10.528065 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:10.528065 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 22:11:10.528065 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 22:11:10.528065 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 22:11:10.528065 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 22:11:10.529029 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:10.529029 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:10.529029 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:10.529029 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:10.529029 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:10.529029 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:10.529029 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:10.529029 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:10.529029 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:10.529029 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:10.529029 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:10.529029 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:10.529029 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:10.529029 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:10.529029 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:10.529029 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:10.529029 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 22:11:10.529934 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 22:11:10.529934 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:11:10.529934 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:11:10.532418 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 339/663] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 20 22:11:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:10.533518 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76d64b7-7872-4bce-887b-0ca07aecc63f None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:10.613457 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea0b972-ba6a-4ae9-8d2c-070984f43629 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:10.649700 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cecfba-8d3b-477f-8235-f963c021584e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:10.650331 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cecfba-8d3b-477f-8235-f963c021584e None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:10.650612 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76d64b7-7872-4bce-887b-0ca07aecc63f None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:10.651039 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cecfba-8d3b-477f-8235-f963c021584e None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:10.651039 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cecfba-8d3b-477f-8235-f963c021584e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:10.661222 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cecfba-8d3b-477f-8235-f963c021584e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:10.663222 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cecfba-8d3b-477f-8235-f963c021584e None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:10.677623 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-78cecfba-8d3b-477f-8235-f963c021584e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:11:10.677623 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:10.677623 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:10.677623 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:10.677623 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:10.677623 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:10.677623 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:10.677623 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:10.677623 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:10.677623 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:10.677623 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:10.677623 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:10.677623 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 22:11:10.677623 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 22:11:10.677623 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 22:11:10.677623 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 22:11:10.678639 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:10.678639 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:10.678639 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:10.678639 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:10.678639 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:10.678639 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:10.678639 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:10.678639 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:10.678639 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:10.678639 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:10.678639 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:10.678639 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:10.678639 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:10.678639 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:10.678639 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:10.678639 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:10.678639 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 22:11:10.679797 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 22:11:10.679797 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:11:10.679797 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:11:10.679797 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 325/664] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 20 22:11:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:10.680621 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cecfba-8d3b-477f-8235-f963c021584e None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:10.689780 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd65f38-bd7f-4dde-92b6-de59685df50a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:10.690386 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd65f38-bd7f-4dde-92b6-de59685df50a None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:10.690708 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd65f38-bd7f-4dde-92b6-de59685df50a None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:10.690980 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd65f38-bd7f-4dde-92b6-de59685df50a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:10.714640 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:10.721128 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:10.772741 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd65f38-bd7f-4dde-92b6-de59685df50a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:10.774223 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd65f38-bd7f-4dde-92b6-de59685df50a None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:10.796688 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cecfba-8d3b-477f-8235-f963c021584e None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:10.832411 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376b4306-f4e6-46ef-b9fb-35da994636d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:10.833015 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b4306-f4e6-46ef-b9fb-35da994636d7 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:10.833290 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b4306-f4e6-46ef-b9fb-35da994636d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:10.833556 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b4306-f4e6-46ef-b9fb-35da994636d7 None admin] PATH_INFO: `/v3/domains` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:10.834837 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376b4306-f4e6-46ef-b9fb-35da994636d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:10.835138 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376b4306-f4e6-46ef-b9fb-35da994636d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:10.836500 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376b4306-f4e6-46ef-b9fb-35da994636d7 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:10.852259 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 326/665] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 20 22:11:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:10.852259 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376b4306-f4e6-46ef-b9fb-35da994636d7 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:10.887508 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 340/666] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 20 22:11:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 20 22:11:10.887508 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd65f38-bd7f-4dde-92b6-de59685df50a None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:10.941728 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:10.951450 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:10.956562 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376b4306-f4e6-46ef-b9fb-35da994636d7 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:10.991862 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c05141-7b5d-44d7-b04f-8041a164ba25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:10.992490 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c05141-7b5d-44d7-b04f-8041a164ba25 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:10.992768 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c05141-7b5d-44d7-b04f-8041a164ba25 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:10.993037 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c05141-7b5d-44d7-b04f-8041a164ba25 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:10.996089 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd65f38-bd7f-4dde-92b6-de59685df50a None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:11.003322 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c05141-7b5d-44d7-b04f-8041a164ba25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 22:11:11.008876 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-d5c05141-7b5d-44d7-b04f-8041a164ba25 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 20 22:11:11.008876 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:11.008876 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:11.008876 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:11.008876 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:11.008876 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:11.008876 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:11.008876 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:11.008876 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:11.008876 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:11.008876 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:11.008876 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:11.008876 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 22:11:11.008876 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 22:11:11.008876 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 22:11:11.008876 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 22:11:11.009806 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 22:11:11.009806 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 22:11:11.009806 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 22:11:11.009806 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 22:11:11.009806 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:11.009806 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:11.009806 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:11.009806 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:11.009806 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:11.009806 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:11.009806 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:11.009806 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:11.009806 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:11.009806 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:11.009806 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:11.009806 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:11.010694 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:11.010694 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:11.010694 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:11.010694 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:11.010694 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 22:11:11.010694 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 22:11:11.010694 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 22:11:11.010694 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 22:11:11.010694 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 22:11:11.010694 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 22:11:11.010694 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 20 22:11:11.010694 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:11:11.010694 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 327/667] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Sep 20 22:11:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:11.011383 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c05141-7b5d-44d7-b04f-8041a164ba25 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:11.036992 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279e9019-ad16-4e53-bc7b-0d418a84f9fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:11.037603 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279e9019-ad16-4e53-bc7b-0d418a84f9fa None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:11.037883 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279e9019-ad16-4e53-bc7b-0d418a84f9fa None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:11.038324 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279e9019-ad16-4e53-bc7b-0d418a84f9fa None admin] PATH_INFO: `/v3/domains` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:11.039387 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279e9019-ad16-4e53-bc7b-0d418a84f9fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:11.039701 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279e9019-ad16-4e53-bc7b-0d418a84f9fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:11.041056 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279e9019-ad16-4e53-bc7b-0d418a84f9fa None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:11.053292 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 341/668] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 20 22:11:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:11.054093 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279e9019-ad16-4e53-bc7b-0d418a84f9fa None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:11.122725 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c05141-7b5d-44d7-b04f-8041a164ba25 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:11.158137 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279e9019-ad16-4e53-bc7b-0d418a84f9fa None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:11.159006 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ddf47a-5bc4-443e-97a8-d4ebf712dd23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:11.159962 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ddf47a-5bc4-443e-97a8-d4ebf712dd23 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:11.160500 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ddf47a-5bc4-443e-97a8-d4ebf712dd23 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:11.160771 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ddf47a-5bc4-443e-97a8-d4ebf712dd23 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:11.168848 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ddf47a-5bc4-443e-97a8-d4ebf712dd23 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:11.170292 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ddf47a-5bc4-443e-97a8-d4ebf712dd23 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:11.176411 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:11.184361 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-84ddf47a-5bc4-443e-97a8-d4ebf712dd23 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 22:11:11.184361 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:11.184361 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:11.184361 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:11.184361 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:11.184361 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:11.184361 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:11.184361 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:11.184361 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:11.184361 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:11.184361 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:11.184361 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:11.184361 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 20 22:11:11.184361 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 20 22:11:11.184361 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 20 22:11:11.185279 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 20 22:11:11.185279 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:11.185279 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:11.185279 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:11.185279 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:11.185279 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:11.185279 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:11.185279 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:11.185279 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:11.185279 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:11.185279 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:11.185279 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:11.185279 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:11.185279 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:11.185279 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:11.185279 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:11.185279 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:11.186170 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 20 22:11:11.186170 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 20 22:11:11.186170 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 20 22:11:11.186170 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 20 22:11:11.186170 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 20 22:11:11.186170 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 20 22:11:11.186170 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 22:11:11.186170 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:11:11.186170 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 328/669] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Sep 20 22:11:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:11.186694 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ddf47a-5bc4-443e-97a8-d4ebf712dd23 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:11.201001 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:11.204777 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769b9d2c-5076-49c8-9a1f-1763aee3b000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:11.205444 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b9d2c-5076-49c8-9a1f-1763aee3b000 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:11.205722 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b9d2c-5076-49c8-9a1f-1763aee3b000 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:11.205999 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b9d2c-5076-49c8-9a1f-1763aee3b000 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:11.217336 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769b9d2c-5076-49c8-9a1f-1763aee3b000 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:11.218802 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769b9d2c-5076-49c8-9a1f-1763aee3b000 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:11.233113 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-769b9d2c-5076-49c8-9a1f-1763aee3b000 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:11:11.233113 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:11.233113 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:11.233113 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:11.233113 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:11.233113 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:11.233113 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:11.233113 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:11.233113 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:11.233113 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:11.233113 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:11.233113 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:11.233113 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 22:11:11.233113 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 22:11:11.233113 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 22:11:11.233113 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 22:11:11.234060 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:11.234060 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:11.234060 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:11.234060 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:11.234060 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:11.234060 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:11.234060 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:11.234060 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:11.234060 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:11.234060 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:11.234060 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:11.234060 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:11.234060 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:11.234060 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:11.234060 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:11.234060 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:11.234060 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 22:11:11.234994 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 22:11:11.234994 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:11:11.234994 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:11:11.234994 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 342/670] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 20 22:11:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:11.234994 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769b9d2c-5076-49c8-9a1f-1763aee3b000 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:11.306897 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ddf47a-5bc4-443e-97a8-d4ebf712dd23 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:11.340898 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c781481-e459-4dc7-8820-09c89a3854f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:11.341511 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c781481-e459-4dc7-8820-09c89a3854f9 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:11.341792 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c781481-e459-4dc7-8820-09c89a3854f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:11.342078 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c781481-e459-4dc7-8820-09c89a3854f9 None admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:11.342762 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c781481-e459-4dc7-8820-09c89a3854f9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:11.343069 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c781481-e459-4dc7-8820-09c89a3854f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:11.344437 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c781481-e459-4dc7-8820-09c89a3854f9 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:11.347537 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769b9d2c-5076-49c8-9a1f-1763aee3b000 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:11.352424 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 329/671] 10.222.0.33 () {56 vars in 1103 bytes} [Tue Sep 20 22:11:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:11.353233 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c781481-e459-4dc7-8820-09c89a3854f9 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:11.387454 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03b4ac1-1a18-4f4e-8186-04d2406019d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:11.388413 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03b4ac1-1a18-4f4e-8186-04d2406019d3 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:11.388869 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03b4ac1-1a18-4f4e-8186-04d2406019d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:11.389417 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03b4ac1-1a18-4f4e-8186-04d2406019d3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:11.397021 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03b4ac1-1a18-4f4e-8186-04d2406019d3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:11.398845 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03b4ac1-1a18-4f4e-8186-04d2406019d3 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:11.411426 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-f03b4ac1-1a18-4f4e-8186-04d2406019d3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 22:11:11.411426 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:11.411426 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:11.411426 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:11.411426 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:11.411426 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:11.411426 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:11.411426 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:11.411426 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:11.411426 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:11.411426 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:11.411426 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:11.411426 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 20 22:11:11.411426 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 20 22:11:11.411426 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 20 22:11:11.413089 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 20 22:11:11.413089 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:11.413089 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:11.413089 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:11.413089 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:11.413089 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:11.413089 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:11.413089 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:11.413089 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:11.413089 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:11.413089 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:11.413089 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:11.413089 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:11.413089 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:11.413089 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:11.413089 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:11.413089 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:11.414111 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 20 22:11:11.414111 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 20 22:11:11.414111 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 20 22:11:11.414111 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 20 22:11:11.414111 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 20 22:11:11.414111 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 20 22:11:11.414111 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 22:11:11.414111 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:11:11.415818 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 343/672] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Sep 20 22:11:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:11.416877 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03b4ac1-1a18-4f4e-8186-04d2406019d3 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:11.434291 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:11.455833 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:11.470188 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c781481-e459-4dc7-8820-09c89a3854f9 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:11.506983 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f941bad-2be1-4652-9adf-673246ba2d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:11.507597 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f941bad-2be1-4652-9adf-673246ba2d4b None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:11.507877 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f941bad-2be1-4652-9adf-673246ba2d4b None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:11.508144 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f941bad-2be1-4652-9adf-673246ba2d4b None admin] PATH_INFO: `/v3/projects` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:11.508831 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f941bad-2be1-4652-9adf-673246ba2d4b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:11.509133 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f941bad-2be1-4652-9adf-673246ba2d4b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:11.510565 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f941bad-2be1-4652-9adf-673246ba2d4b None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:11.522586 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 330/673] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Sep 20 22:11:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:11.523378 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f941bad-2be1-4652-9adf-673246ba2d4b None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:11.538875 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03b4ac1-1a18-4f4e-8186-04d2406019d3 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:11.574438 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52a793f-fc28-4063-a9c4-0fc6b5c20d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:11.575078 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52a793f-fc28-4063-a9c4-0fc6b5c20d2b None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:11.575468 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52a793f-fc28-4063-a9c4-0fc6b5c20d2b None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:11.575737 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52a793f-fc28-4063-a9c4-0fc6b5c20d2b None admin] PATH_INFO: `/v3/domains` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:11.576369 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52a793f-fc28-4063-a9c4-0fc6b5c20d2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:11.576664 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52a793f-fc28-4063-a9c4-0fc6b5c20d2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:11.578008 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52a793f-fc28-4063-a9c4-0fc6b5c20d2b None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:11.590845 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 344/674] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 20 22:11:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:11.591874 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52a793f-fc28-4063-a9c4-0fc6b5c20d2b None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:11.631260 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f941bad-2be1-4652-9adf-673246ba2d4b None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:11.662740 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:11.669056 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4021c2c9-b5aa-4a92-ae82-15a289bab791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:11.669722 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4021c2c9-b5aa-4a92-ae82-15a289bab791 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:11.670003 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4021c2c9-b5aa-4a92-ae82-15a289bab791 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:11.670274 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4021c2c9-b5aa-4a92-ae82-15a289bab791 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:11.682803 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4021c2c9-b5aa-4a92-ae82-15a289bab791 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:11.684297 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4021c2c9-b5aa-4a92-ae82-15a289bab791 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:11.687598 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:11.701405 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52a793f-fc28-4063-a9c4-0fc6b5c20d2b None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:11.701899 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-4021c2c9-b5aa-4a92-ae82-15a289bab791 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:11:11.701899 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:11.701899 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:11.701899 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:11.701899 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:11.701899 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:11.701899 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:11.701899 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:11.701899 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:11.701899 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:11.701899 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:11.701899 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:11.701899 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 22:11:11.701899 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 22:11:11.701899 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 22:11:11.701899 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 22:11:11.702812 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:11.702812 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:11.702812 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:11.702812 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:11.702812 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:11.702812 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:11.702812 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:11.702812 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:11.702812 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:11.702812 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:11.702812 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:11.702812 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:11.702812 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:11.702812 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:11.702812 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:11.702812 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:11.702812 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 22:11:11.703698 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 22:11:11.703698 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:11:11.703698 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:11:11.703698 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 331/675] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 20 22:11:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:11.703939 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4021c2c9-b5aa-4a92-ae82-15a289bab791 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:11.742684 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4965a25e-0aed-47f5-bb3e-4fba534b0d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:11.743342 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4965a25e-0aed-47f5-bb3e-4fba534b0d63 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:11.743623 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4965a25e-0aed-47f5-bb3e-4fba534b0d63 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:11.743894 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4965a25e-0aed-47f5-bb3e-4fba534b0d63 None admin] PATH_INFO: `/v3/projects` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:11.744746 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4965a25e-0aed-47f5-bb3e-4fba534b0d63 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:11.745062 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4965a25e-0aed-47f5-bb3e-4fba534b0d63 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:11.746493 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4965a25e-0aed-47f5-bb3e-4fba534b0d63 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:11.759010 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 345/676] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Sep 20 22:11:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:11.765451 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4965a25e-0aed-47f5-bb3e-4fba534b0d63 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:11.822833 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4021c2c9-b5aa-4a92-ae82-15a289bab791 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:11.856913 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e606ae2-9bfb-4a0d-9dcb-2957f6ca3458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:11.857510 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e606ae2-9bfb-4a0d-9dcb-2957f6ca3458 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:11.857788 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e606ae2-9bfb-4a0d-9dcb-2957f6ca3458 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:11.858059 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e606ae2-9bfb-4a0d-9dcb-2957f6ca3458 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:11.858805 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e606ae2-9bfb-4a0d-9dcb-2957f6ca3458 None admin] RBAC: Adding query filter params (role.id=6d6dcbd3bc16491db00308c3b7d27a63, scope.project.id=3ce415d02aa9489bae19cd514805fd8c, user.id=6577c8b14c1f4279beac13b9ba11aba1) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:11.859110 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e606ae2-9bfb-4a0d-9dcb-2957f6ca3458 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:11.860541 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e606ae2-9bfb-4a0d-9dcb-2957f6ca3458 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:11.865597 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4965a25e-0aed-47f5-bb3e-4fba534b0d63 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:11.866460 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 332/677] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Sep 20 22:11:11 2022] GET /identity/v3/role_assignments?user.id=6577c8b14c1f4279beac13b9ba11aba1&scope.project.id=3ce415d02aa9489bae19cd514805fd8c&role.id=6d6dcbd3bc16491db00308c3b7d27a63 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:11.867087 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e606ae2-9bfb-4a0d-9dcb-2957f6ca3458 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:11.915136 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa01076-73b1-4e7e-84ee-1d0375078104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:11.915713 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa01076-73b1-4e7e-84ee-1d0375078104 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:11.915993 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa01076-73b1-4e7e-84ee-1d0375078104 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:11.916268 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa01076-73b1-4e7e-84ee-1d0375078104 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:11.918430 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:11.924748 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa01076-73b1-4e7e-84ee-1d0375078104 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:11.926223 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa01076-73b1-4e7e-84ee-1d0375078104 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:11.940713 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-6aa01076-73b1-4e7e-84ee-1d0375078104 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 22:11:11.940713 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:11.940713 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:11.940713 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:11.940713 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:11.940713 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:11.940713 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:11.940713 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:11.940713 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:11.940713 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:11.940713 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:11.940713 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:11.940713 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 20 22:11:11.940713 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 20 22:11:11.940713 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 20 22:11:11.941704 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 20 22:11:11.941704 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:11.941704 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:11.941704 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:11.941704 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:11.941704 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:11.941704 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:11.941704 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:11.941704 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:11.941704 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:11.941704 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:11.941704 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:11.941704 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:11.941704 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:11.941704 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:11.941704 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:11.941704 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:11.948213 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 20 22:11:11.948213 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 20 22:11:11.948213 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 20 22:11:11.948213 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 20 22:11:11.948213 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 20 22:11:11.948213 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 20 22:11:11.948213 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 22:11:11.948213 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:11:11.948213 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 346/678] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Sep 20 22:11:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:11.948213 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa01076-73b1-4e7e-84ee-1d0375078104 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:11.957800 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:11.985405 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e606ae2-9bfb-4a0d-9dcb-2957f6ca3458 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:12.022790 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4657d920-1152-4c54-bbaf-917e9b06e0a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:12.023577 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4657d920-1152-4c54-bbaf-917e9b06e0a4 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:12.023863 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4657d920-1152-4c54-bbaf-917e9b06e0a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:12.024135 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4657d920-1152-4c54-bbaf-917e9b06e0a4 None admin] PATH_INFO: `/v3/domains` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:12.024799 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4657d920-1152-4c54-bbaf-917e9b06e0a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:12.025104 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4657d920-1152-4c54-bbaf-917e9b06e0a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:12.026539 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4657d920-1152-4c54-bbaf-917e9b06e0a4 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:12.043032 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 333/679] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 20 22:11:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:12.044859 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc4bdaf-8e1a-4608-bd29-6e165c4752ea None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:12.044859 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc4bdaf-8e1a-4608-bd29-6e165c4752ea None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:12.045031 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc4bdaf-8e1a-4608-bd29-6e165c4752ea None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:12.046610 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 334/680] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:11:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:11:12.047041 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc4bdaf-8e1a-4608-bd29-6e165c4752ea None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:12.064934 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa01076-73b1-4e7e-84ee-1d0375078104 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:12.106038 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b688c3-1264-4c30-8994-2327c284b103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:12.106693 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b688c3-1264-4c30-8994-2327c284b103 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:12.106975 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b688c3-1264-4c30-8994-2327c284b103 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:12.107687 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b688c3-1264-4c30-8994-2327c284b103 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:12.108430 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b688c3-1264-4c30-8994-2327c284b103 None admin] RBAC: Adding query filter params (role.id=6d6dcbd3bc16491db00308c3b7d27a63, scope.project.id=3ce415d02aa9489bae19cd514805fd8c, user.id=fbecfbbf24fd425ca99499fd44d8c7a8) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:12.108741 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b688c3-1264-4c30-8994-2327c284b103 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:12.110157 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b688c3-1264-4c30-8994-2327c284b103 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:12.117423 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 347/681] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Sep 20 22:11:11 2022] GET /identity/v3/role_assignments?user.id=fbecfbbf24fd425ca99499fd44d8c7a8&scope.project.id=3ce415d02aa9489bae19cd514805fd8c&role.id=6d6dcbd3bc16491db00308c3b7d27a63 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:12.119065 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18243ddf-8d45-4d3f-a8fa-c9fb76a99652 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:12.119450 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18243ddf-8d45-4d3f-a8fa-c9fb76a99652 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:12.119926 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18243ddf-8d45-4d3f-a8fa-c9fb76a99652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:12.142144 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-18243ddf-8d45-4d3f-a8fa-c9fb76a99652 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:11:12.143583 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-18243ddf-8d45-4d3f-a8fa-c9fb76a99652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:11:12.175124 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc4bdaf-8e1a-4608-bd29-6e165c4752ea None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:12.185979 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:12.217673 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371faa0e-0bbf-4999-8015-10471be3ae03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:12.218728 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371faa0e-0bbf-4999-8015-10471be3ae03 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:12.218728 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371faa0e-0bbf-4999-8015-10471be3ae03 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:12.219011 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371faa0e-0bbf-4999-8015-10471be3ae03 None admin] PATH_INFO: `/v3/projects` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:12.219658 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371faa0e-0bbf-4999-8015-10471be3ae03 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:12.219967 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371faa0e-0bbf-4999-8015-10471be3ae03 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:12.221429 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371faa0e-0bbf-4999-8015-10471be3ae03 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:12.235455 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 335/682] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Sep 20 22:11:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:12.236502 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371faa0e-0bbf-4999-8015-10471be3ae03 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:12.244414 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 348/683] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:11:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 22:11:12.245593 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18243ddf-8d45-4d3f-a8fa-c9fb76a99652 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:12.250783 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:12.371994 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371faa0e-0bbf-4999-8015-10471be3ae03 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:12.381842 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18243ddf-8d45-4d3f-a8fa-c9fb76a99652 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:12.414757 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa74abbd-e6ac-4de7-8468-8daf8f1fc842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:12.415915 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa74abbd-e6ac-4de7-8468-8daf8f1fc842 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:12.416468 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa74abbd-e6ac-4de7-8468-8daf8f1fc842 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:12.416821 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa74abbd-e6ac-4de7-8468-8daf8f1fc842 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:12.420116 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe6e9b8-96c8-40f8-8dba-c6c3bfe6040d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:12.420723 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe6e9b8-96c8-40f8-8dba-c6c3bfe6040d None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:12.420999 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe6e9b8-96c8-40f8-8dba-c6c3bfe6040d None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:12.421266 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe6e9b8-96c8-40f8-8dba-c6c3bfe6040d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:12.421987 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe6e9b8-96c8-40f8-8dba-c6c3bfe6040d None admin] RBAC: Adding query filter params (role.id=6d6dcbd3bc16491db00308c3b7d27a63, scope.project.id=3ce415d02aa9489bae19cd514805fd8c, user.id=e9b0b3ca4ecd41aaba9cf8e0f91fbf54) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:12.422293 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe6e9b8-96c8-40f8-8dba-c6c3bfe6040d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:12.423766 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe6e9b8-96c8-40f8-8dba-c6c3bfe6040d None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:12.424769 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa74abbd-e6ac-4de7-8468-8daf8f1fc842 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:12.427202 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa74abbd-e6ac-4de7-8468-8daf8f1fc842 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:12.431642 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 349/684] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Sep 20 22:11:12 2022] GET /identity/v3/role_assignments?user.id=e9b0b3ca4ecd41aaba9cf8e0f91fbf54&scope.project.id=3ce415d02aa9489bae19cd514805fd8c&role.id=6d6dcbd3bc16491db00308c3b7d27a63 => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:12.442241 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-fa74abbd-e6ac-4de7-8468-8daf8f1fc842 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 20 22:11:12.442241 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:12.442241 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:12.442241 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:12.442241 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:12.442241 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:12.442241 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:12.442241 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:12.442241 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:12.442241 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:12.442241 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:12.442241 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:12.442241 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 20 22:11:12.442241 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 20 22:11:12.442241 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 20 22:11:12.442241 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 20 22:11:12.443348 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:12.443348 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:12.443348 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 20 22:11:12.443348 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 22:11:12.443348 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 20 22:11:12.443348 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 22:11:12.443348 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:12.443348 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:12.443348 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:12.443348 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:12.443348 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:12.443348 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:12.443348 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:12.443348 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:12.443348 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:12.443348 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:12.443348 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:12.443348 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:12.444291 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:12.444291 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:12.444291 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 20 22:11:12.444291 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 20 22:11:12.444291 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 20 22:11:12.444291 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 20 22:11:12.444291 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 20 22:11:12.444291 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 20 22:11:12.444291 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 20 22:11:12.444291 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:11:12.444291 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 336/685] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Sep 20 22:11:12 2022] GET /identity/v3/users/swift => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:12.451098 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe6e9b8-96c8-40f8-8dba-c6c3bfe6040d None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:12.530343 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:12.554273 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa74abbd-e6ac-4de7-8468-8daf8f1fc842 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:12.584553 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe6e9b8-96c8-40f8-8dba-c6c3bfe6040d None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:12.591607 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:12.635765 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281fd4c6-37d3-405d-bf88-da0c8ba02291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:12.636499 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281fd4c6-37d3-405d-bf88-da0c8ba02291 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:12.636778 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281fd4c6-37d3-405d-bf88-da0c8ba02291 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:12.637049 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281fd4c6-37d3-405d-bf88-da0c8ba02291 None admin] PATH_INFO: `/v3/users` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:12.637791 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281fd4c6-37d3-405d-bf88-da0c8ba02291 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:12.638097 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281fd4c6-37d3-405d-bf88-da0c8ba02291 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:12.640399 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281fd4c6-37d3-405d-bf88-da0c8ba02291 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:12.663337 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 350/686] 10.222.0.33 () {56 vars in 1135 bytes} [Tue Sep 20 22:11:12 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:12.668949 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281fd4c6-37d3-405d-bf88-da0c8ba02291 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:12.696773 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa74abbd-e6ac-4de7-8468-8daf8f1fc842 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:12.740521 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46898572-317b-406a-b3ca-d58650f5a2bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:12.741167 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46898572-317b-406a-b3ca-d58650f5a2bc None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:12.741445 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46898572-317b-406a-b3ca-d58650f5a2bc None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:12.741714 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46898572-317b-406a-b3ca-d58650f5a2bc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:12.753738 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46898572-317b-406a-b3ca-d58650f5a2bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 22:11:12.762372 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-46898572-317b-406a-b3ca-d58650f5a2bc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 22:11:12.762372 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:12.762372 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:12.762372 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:12.762372 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:12.762372 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:12.762372 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:12.762372 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:12.762372 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:12.762372 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:12.762372 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:12.762372 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:12.762372 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 22:11:12.762372 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 22:11:12.762372 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 22:11:12.762372 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 22:11:12.764500 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 22:11:12.764500 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 22:11:12.764500 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 22:11:12.764500 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 22:11:12.764500 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:12.764500 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:12.764500 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:12.764500 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:12.764500 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:12.764500 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:12.764500 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:12.764500 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:12.764500 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:12.764500 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:12.764500 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:12.764500 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:12.766413 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:12.766413 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:12.766413 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:12.766413 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:12.766413 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 22:11:12.766413 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 22:11:12.766413 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 22:11:12.766413 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 22:11:12.766413 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 22:11:12.766413 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 22:11:12.766413 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 22:11:12.766413 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:11:12.766413 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 337/687] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Sep 20 22:11:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:12.775578 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46898572-317b-406a-b3ca-d58650f5a2bc None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:12.806730 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281fd4c6-37d3-405d-bf88-da0c8ba02291 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:12.833867 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:12.846638 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333dd252-4835-48b7-a8a4-9fe1c192b347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:12.847305 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333dd252-4835-48b7-a8a4-9fe1c192b347 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:12.847589 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333dd252-4835-48b7-a8a4-9fe1c192b347 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:12.848100 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333dd252-4835-48b7-a8a4-9fe1c192b347 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:12.922445 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333dd252-4835-48b7-a8a4-9fe1c192b347 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:12.924360 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333dd252-4835-48b7-a8a4-9fe1c192b347 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:12.992065 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:13.035582 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46898572-317b-406a-b3ca-d58650f5a2bc None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:13.041255 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 351/688] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 20 22:11:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 20 22:11:13.046550 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333dd252-4835-48b7-a8a4-9fe1c192b347 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:13.077319 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:13.120375 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f68cd1-e61f-4d53-b1f5-7d770ad7f6da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:13.120935 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f68cd1-e61f-4d53-b1f5-7d770ad7f6da None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:13.121216 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f68cd1-e61f-4d53-b1f5-7d770ad7f6da None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:13.121491 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f68cd1-e61f-4d53-b1f5-7d770ad7f6da None admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:13.122158 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f68cd1-e61f-4d53-b1f5-7d770ad7f6da None admin] RBAC: Adding query filter params (name=admin) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:13.122464 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f68cd1-e61f-4d53-b1f5-7d770ad7f6da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:13.123855 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f68cd1-e61f-4d53-b1f5-7d770ad7f6da None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:13.138386 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 338/689] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 20 22:11:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:13.145459 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f68cd1-e61f-4d53-b1f5-7d770ad7f6da None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:13.186988 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333dd252-4835-48b7-a8a4-9fe1c192b347 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:13.226413 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47111b2a-cc9a-4841-b5dc-0af31af072d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:13.227158 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47111b2a-cc9a-4841-b5dc-0af31af072d2 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:13.227439 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47111b2a-cc9a-4841-b5dc-0af31af072d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:13.227710 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47111b2a-cc9a-4841-b5dc-0af31af072d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:13.242593 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47111b2a-cc9a-4841-b5dc-0af31af072d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:13.245251 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47111b2a-cc9a-4841-b5dc-0af31af072d2 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:13.280367 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-47111b2a-cc9a-4841-b5dc-0af31af072d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:11:13.280367 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:13.280367 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:13.280367 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:13.280367 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:13.280367 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:13.280367 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:13.280367 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:13.280367 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:13.280367 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:13.280367 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:13.280367 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:13.280367 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 22:11:13.280367 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 22:11:13.280367 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 22:11:13.280367 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 22:11:13.282379 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:13.282379 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:13.282379 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:13.282379 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:13.282379 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:13.282379 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:13.282379 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:13.282379 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:13.282379 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:13.282379 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:13.282379 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:13.282379 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:13.282379 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:13.282379 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:13.282379 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:13.282379 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:13.282379 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 22:11:13.283674 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 22:11:13.283674 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:11:13.283674 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:11:13.283674 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 352/690] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 20 22:11:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 20 22:11:13.290589 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47111b2a-cc9a-4841-b5dc-0af31af072d2 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:13.365698 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f68cd1-e61f-4d53-b1f5-7d770ad7f6da None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:13.436200 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1da130-448a-4538-928c-fcab913b0320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:13.436905 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1da130-448a-4538-928c-fcab913b0320 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:13.437244 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1da130-448a-4538-928c-fcab913b0320 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:13.437568 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1da130-448a-4538-928c-fcab913b0320 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:13.450165 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:13.459601 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1da130-448a-4538-928c-fcab913b0320 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:13.461179 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1da130-448a-4538-928c-fcab913b0320 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:13.476708 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:13.478486 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47111b2a-cc9a-4841-b5dc-0af31af072d2 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:13.487215 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-6a1da130-448a-4538-928c-fcab913b0320 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:11:13.487215 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:13.487215 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:13.487215 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:13.487215 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:13.487215 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:13.487215 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:13.487215 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:13.487215 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:13.487215 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:13.487215 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:13.487215 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:13.487215 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 22:11:13.487215 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 22:11:13.487215 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 22:11:13.487215 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 22:11:13.488377 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:13.488377 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:13.488377 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:13.488377 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:13.488377 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:13.488377 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:13.488377 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:13.488377 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:13.488377 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:13.488377 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:13.488377 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:13.488377 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:13.488377 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:13.488377 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:13.488377 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:13.488377 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:13.488377 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 22:11:13.489455 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 22:11:13.489455 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:11:13.489455 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:11:13.490548 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 339/691] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 20 22:11:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:13.496866 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1da130-448a-4538-928c-fcab913b0320 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:13.536889 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b34723-0d5b-4d52-ba4a-a73f5f7ba748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:13.539875 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b34723-0d5b-4d52-ba4a-a73f5f7ba748 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:13.540395 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b34723-0d5b-4d52-ba4a-a73f5f7ba748 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:13.540864 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b34723-0d5b-4d52-ba4a-a73f5f7ba748 None admin] PATH_INFO: `/v3/domains` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:13.541700 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b34723-0d5b-4d52-ba4a-a73f5f7ba748 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:13.543421 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b34723-0d5b-4d52-ba4a-a73f5f7ba748 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:13.545654 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b34723-0d5b-4d52-ba4a-a73f5f7ba748 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:13.573486 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 353/692] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 20 22:11:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:13.578960 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b34723-0d5b-4d52-ba4a-a73f5f7ba748 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:13.714215 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1da130-448a-4538-928c-fcab913b0320 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:13.726991 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b34723-0d5b-4d52-ba4a-a73f5f7ba748 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:13.779099 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7a3fa6-257f-484f-8dd8-f81fb65d9b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:13.779632 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a3fa6-257f-484f-8dd8-f81fb65d9b8c None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:13.779910 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a3fa6-257f-484f-8dd8-f81fb65d9b8c None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:13.780179 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a3fa6-257f-484f-8dd8-f81fb65d9b8c None admin] PATH_INFO: `/v3/domains` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:13.780826 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7a3fa6-257f-484f-8dd8-f81fb65d9b8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:13.781129 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7a3fa6-257f-484f-8dd8-f81fb65d9b8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:13.782496 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7a3fa6-257f-484f-8dd8-f81fb65d9b8c None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:13.793582 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33afecf-0f58-4961-b2f2-28666b815a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:13.794222 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33afecf-0f58-4961-b2f2-28666b815a77 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:13.794497 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33afecf-0f58-4961-b2f2-28666b815a77 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:13.794799 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33afecf-0f58-4961-b2f2-28666b815a77 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:13.806865 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33afecf-0f58-4961-b2f2-28666b815a77 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:13.807456 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 340/693] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 20 22:11:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 22:11:13.808420 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33afecf-0f58-4961-b2f2-28666b815a77 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:13.809330 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:13.811312 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7a3fa6-257f-484f-8dd8-f81fb65d9b8c None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:13.831796 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-a33afecf-0f58-4961-b2f2-28666b815a77 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 22:11:13.831796 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:13.831796 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:13.831796 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:13.831796 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:13.831796 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:13.831796 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:13.831796 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:13.831796 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:13.831796 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:13.831796 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:13.831796 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:13.831796 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 20 22:11:13.831796 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 20 22:11:13.831796 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 20 22:11:13.832748 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 20 22:11:13.832748 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:13.832748 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:13.832748 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:13.832748 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:13.832748 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:13.832748 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:13.832748 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:13.832748 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:13.832748 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:13.832748 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:13.832748 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:13.832748 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:13.832748 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:13.832748 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:13.832748 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:13.832748 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:13.834435 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 20 22:11:13.834435 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 20 22:11:13.834435 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 20 22:11:13.834435 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 20 22:11:13.834435 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 20 22:11:13.834435 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 20 22:11:13.834435 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 22:11:13.834435 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:11:13.834435 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 354/694] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Sep 20 22:11:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:13.839408 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33afecf-0f58-4961-b2f2-28666b815a77 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:13.890480 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:13.935261 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7a3fa6-257f-484f-8dd8-f81fb65d9b8c None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:13.974164 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3a2f54-3952-4722-97bc-0a40873324f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:13.975775 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a2f54-3952-4722-97bc-0a40873324f3 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:13.976327 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a2f54-3952-4722-97bc-0a40873324f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:13.976798 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a2f54-3952-4722-97bc-0a40873324f3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:13.985164 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3a2f54-3952-4722-97bc-0a40873324f3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:13.986872 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3a2f54-3952-4722-97bc-0a40873324f3 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:13.999893 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-bf3a2f54-3952-4722-97bc-0a40873324f3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 20 22:11:13.999893 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:13.999893 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:13.999893 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:13.999893 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:13.999893 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:13.999893 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:13.999893 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:13.999893 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:13.999893 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:13.999893 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:13.999893 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:13.999893 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 20 22:11:13.999893 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 20 22:11:13.999893 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 20 22:11:13.999893 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 20 22:11:14.000862 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:14.000862 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:14.000862 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 20 22:11:14.000862 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 22:11:14.000862 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 20 22:11:14.000862 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 22:11:14.000862 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:14.000862 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:14.000862 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:14.000862 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:14.000862 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:14.000862 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:14.000862 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:14.000862 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:14.000862 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:14.000862 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:14.000862 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:14.000862 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:14.001820 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:14.001820 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:14.001820 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 20 22:11:14.001820 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 20 22:11:14.001820 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 20 22:11:14.001820 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 20 22:11:14.001820 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 20 22:11:14.001820 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 20 22:11:14.001820 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 20 22:11:14.001820 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:11:14.004580 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 341/695] 10.222.0.33 () {56 vars in 1093 bytes} [Tue Sep 20 22:11:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:14.009795 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3a2f54-3952-4722-97bc-0a40873324f3 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:14.096824 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33afecf-0f58-4961-b2f2-28666b815a77 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:14.174963 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf07d4c8-f9ad-4a73-ab59-0b085b8b90e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:14.175936 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf07d4c8-f9ad-4a73-ab59-0b085b8b90e9 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:14.176486 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf07d4c8-f9ad-4a73-ab59-0b085b8b90e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:14.176953 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf07d4c8-f9ad-4a73-ab59-0b085b8b90e9 None admin] PATH_INFO: `/v3/projects` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:14.177935 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf07d4c8-f9ad-4a73-ab59-0b085b8b90e9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:14.178444 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf07d4c8-f9ad-4a73-ab59-0b085b8b90e9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:14.180984 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf07d4c8-f9ad-4a73-ab59-0b085b8b90e9 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:14.209611 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3a2f54-3952-4722-97bc-0a40873324f3 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:14.209931 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 355/696] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Sep 20 22:11:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:14.212676 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf07d4c8-f9ad-4a73-ab59-0b085b8b90e9 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:14.250320 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ba8741-882e-4876-9396-f3241214496f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:14.251624 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ba8741-882e-4876-9396-f3241214496f None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:14.252153 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ba8741-882e-4876-9396-f3241214496f None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:14.252793 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ba8741-882e-4876-9396-f3241214496f None admin] PATH_INFO: `/v3/users` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:14.254334 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ba8741-882e-4876-9396-f3241214496f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:14.255005 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ba8741-882e-4876-9396-f3241214496f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:14.257810 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ba8741-882e-4876-9396-f3241214496f None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:14.266738 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:14.296037 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 342/697] 10.222.0.33 () {56 vars in 1133 bytes} [Tue Sep 20 22:11:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 22:11:14.302013 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:14.303524 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ba8741-882e-4876-9396-f3241214496f None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:14.394621 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf07d4c8-f9ad-4a73-ab59-0b085b8b90e9 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:14.467625 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30689b6-462e-4153-9c9c-f382a6994f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:14.468239 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30689b6-462e-4153-9c9c-f382a6994f08 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:14.468517 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30689b6-462e-4153-9c9c-f382a6994f08 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:14.468789 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30689b6-462e-4153-9c9c-f382a6994f08 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:14.469526 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30689b6-462e-4153-9c9c-f382a6994f08 None admin] RBAC: Adding query filter params (role.id=6d6dcbd3bc16491db00308c3b7d27a63, scope.project.id=3ce415d02aa9489bae19cd514805fd8c, user.id=257983500d7b430c8f0377b2aa743ae0) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:14.469827 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30689b6-462e-4153-9c9c-f382a6994f08 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:14.471299 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30689b6-462e-4153-9c9c-f382a6994f08 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:14.483505 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ba8741-882e-4876-9396-f3241214496f None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:14.485633 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 356/698] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Sep 20 22:11:14 2022] GET /identity/v3/role_assignments?user.id=257983500d7b430c8f0377b2aa743ae0&scope.project.id=3ce415d02aa9489bae19cd514805fd8c&role.id=6d6dcbd3bc16491db00308c3b7d27a63 => generated 608 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:14.520656 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b457351-2a28-4f14-87dd-d894e0c58335 None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:14.521143 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b457351-2a28-4f14-87dd-d894e0c58335 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:14.521656 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b457351-2a28-4f14-87dd-d894e0c58335 None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:14.523579 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 357/699] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:11:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:11:14.529783 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9e834d-1d1d-41ac-a447-76b6fd42535d None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:14.530081 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9e834d-1d1d-41ac-a447-76b6fd42535d None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:14.530399 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9e834d-1d1d-41ac-a447-76b6fd42535d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:14.556674 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-af9e834d-1d1d-41ac-a447-76b6fd42535d None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:11:14.558073 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-af9e834d-1d1d-41ac-a447-76b6fd42535d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:11:14.586026 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f41666b-0a65-4202-b1e1-57e9a8940f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:14.586766 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41666b-0a65-4202-b1e1-57e9a8940f07 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:14.586968 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41666b-0a65-4202-b1e1-57e9a8940f07 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:14.587243 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41666b-0a65-4202-b1e1-57e9a8940f07 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:14.691477 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:14.704168 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 358/700] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:11:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 20 22:11:14.723682 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f41666b-0a65-4202-b1e1-57e9a8940f07 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:14.725167 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f41666b-0a65-4202-b1e1-57e9a8940f07 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:14.834145 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 343/701] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 20 22:11:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 20 22:11:14.839640 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9e834d-1d1d-41ac-a447-76b6fd42535d None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:14.907164 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:14.961819 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9e834d-1d1d-41ac-a447-76b6fd42535d None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:14.981305 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b3f26c-ed76-4550-ad86-337af0fd1679 None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:14.981627 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b3f26c-ed76-4550-ad86-337af0fd1679 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:14.981856 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b3f26c-ed76-4550-ad86-337af0fd1679 None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:14.983485 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 344/702] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:11:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:11:14.988548 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6f0c75-090c-489c-b993-94a2ed5904c6 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:14.988834 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6f0c75-090c-489c-b993-94a2ed5904c6 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:14.989110 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6f0c75-090c-489c-b993-94a2ed5904c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:15.006263 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99afb80f-edb7-4589-9f86-8b82a86444f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:15.006966 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99afb80f-edb7-4589-9f86-8b82a86444f6 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:15.007239 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99afb80f-edb7-4589-9f86-8b82a86444f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:15.007502 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99afb80f-edb7-4589-9f86-8b82a86444f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:15.013231 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-ef6f0c75-090c-489c-b993-94a2ed5904c6 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:11:15.015057 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-ef6f0c75-090c-489c-b993-94a2ed5904c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:11:15.018991 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99afb80f-edb7-4589-9f86-8b82a86444f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:15.020442 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99afb80f-edb7-4589-9f86-8b82a86444f6 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:15.037011 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-99afb80f-edb7-4589-9f86-8b82a86444f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:11:15.037011 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:15.037011 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:15.037011 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:15.037011 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:15.037011 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:15.037011 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:15.037011 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:15.037011 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:15.037011 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:15.037011 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:15.037011 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:15.037011 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 22:11:15.037011 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 22:11:15.037011 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 22:11:15.037011 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 22:11:15.038107 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:15.038107 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:15.038107 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:15.038107 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:15.038107 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:15.038107 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:15.038107 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:15.038107 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:15.038107 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:15.038107 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:15.038107 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:15.038107 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:15.038107 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:15.038107 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:15.038107 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:15.038107 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:15.038107 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 22:11:15.039081 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 22:11:15.039081 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:11:15.039081 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:11:15.039081 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 359/703] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 20 22:11:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:15.039730 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d8e3e0-4d7f-4848-8828-346339e61877 None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:15.039891 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d8e3e0-4d7f-4848-8828-346339e61877 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:15.040143 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d8e3e0-4d7f-4848-8828-346339e61877 None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:15.041566 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 360/704] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:11:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:11:15.046043 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d8e3e0-4d7f-4848-8828-346339e61877 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:15.098192 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 345/705] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:11:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 20 22:11:15.102862 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea84b85-24fa-464f-9a40-f55882f43d04 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:15.102862 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea84b85-24fa-464f-9a40-f55882f43d04 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:15.102862 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea84b85-24fa-464f-9a40-f55882f43d04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:15.131415 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-cea84b85-24fa-464f-9a40-f55882f43d04 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:11:15.133226 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-cea84b85-24fa-464f-9a40-f55882f43d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:11:15.135839 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:15.174778 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d8e3e0-4d7f-4848-8828-346339e61877 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:15.176754 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:15.217523 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 346/706] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:11:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 22:11:15.218693 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea84b85-24fa-464f-9a40-f55882f43d04 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:15.219797 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0695cf8f-ec7d-4dae-8633-2978c975ba76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:15.220404 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0695cf8f-ec7d-4dae-8633-2978c975ba76 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:15.220678 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0695cf8f-ec7d-4dae-8633-2978c975ba76 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:15.220946 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0695cf8f-ec7d-4dae-8633-2978c975ba76 None admin] PATH_INFO: `/v3/domains` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:15.221854 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0695cf8f-ec7d-4dae-8633-2978c975ba76 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:15.222159 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0695cf8f-ec7d-4dae-8633-2978c975ba76 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:15.225097 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0695cf8f-ec7d-4dae-8633-2978c975ba76 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:15.242546 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 361/707] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 20 22:11:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:15.247557 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0695cf8f-ec7d-4dae-8633-2978c975ba76 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:15.393747 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea84b85-24fa-464f-9a40-f55882f43d04 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:15.416816 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0695cf8f-ec7d-4dae-8633-2978c975ba76 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:15.432468 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a568eead-6889-490f-a8e6-1984123cdcf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:15.433366 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a568eead-6889-490f-a8e6-1984123cdcf4 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:15.433821 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a568eead-6889-490f-a8e6-1984123cdcf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:15.434293 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a568eead-6889-490f-a8e6-1984123cdcf4 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:15.435220 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a568eead-6889-490f-a8e6-1984123cdcf4 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:15.436861 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a568eead-6889-490f-a8e6-1984123cdcf4 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:15.449027 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-a568eead-6889-490f-a8e6-1984123cdcf4 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 20 22:11:15.449027 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:15.449027 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 20 22:11:15.449027 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 20 22:11:15.449027 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 20 22:11:15.449027 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 20 22:11:15.449027 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 20 22:11:15.449027 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 20 22:11:15.449027 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 20 22:11:15.449027 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:11:15.449027 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 20 22:11:15.449027 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:11:15.449027 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:15.449027 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:15.449027 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:15.449027 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:15.449027 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:15.450059 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:15.450059 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:15.450059 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:15.450059 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:15.450059 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:15.450059 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:15.450059 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 20 22:11:15.450059 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 20 22:11:15.450059 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 20 22:11:15.450059 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 20 22:11:15.450059 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:15.450059 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:15.450059 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:15.450059 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:15.450059 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:15.450059 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:15.450984 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:15.450984 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:15.450984 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:15.450984 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:15.450984 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:15.450984 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:15.450984 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:15.450984 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:15.450984 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:15.450984 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:15.450984 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 20 22:11:15.450984 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 20 22:11:15.450984 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 20 22:11:15.450984 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:11:15.451718 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 347/708] 10.222.0.33 () {56 vars in 1129 bytes} [Tue Sep 20 22:11:15 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:15.451787 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a568eead-6889-490f-a8e6-1984123cdcf4 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:15.457495 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f5655d-7c1f-4182-beea-ef5bcaed3d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:15.457495 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f5655d-7c1f-4182-beea-ef5bcaed3d5f None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:15.457495 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f5655d-7c1f-4182-beea-ef5bcaed3d5f None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:15.457495 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f5655d-7c1f-4182-beea-ef5bcaed3d5f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:15.460484 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:15.471280 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f5655d-7c1f-4182-beea-ef5bcaed3d5f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:15.473785 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f5655d-7c1f-4182-beea-ef5bcaed3d5f None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:15.488286 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-b7f5655d-7c1f-4182-beea-ef5bcaed3d5f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 22:11:15.488286 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:15.488286 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:15.488286 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:15.488286 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:15.488286 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:15.488286 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:15.488286 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:15.488286 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:15.488286 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:15.488286 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:15.488286 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:15.488286 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 20 22:11:15.488286 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 20 22:11:15.488286 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 20 22:11:15.489212 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 20 22:11:15.489212 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:15.489212 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:15.489212 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:15.489212 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:15.489212 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:15.489212 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:15.489212 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:15.489212 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:15.489212 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:15.489212 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:15.489212 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:15.489212 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:15.489212 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:15.489212 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:15.489212 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:15.489212 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:15.490740 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 20 22:11:15.490740 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 20 22:11:15.490740 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 20 22:11:15.490740 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 20 22:11:15.490740 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 20 22:11:15.490740 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 20 22:11:15.490740 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 22:11:15.490740 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:11:15.496408 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 362/709] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Sep 20 22:11:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:15.496408 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f5655d-7c1f-4182-beea-ef5bcaed3d5f None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:15.522240 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:15.583250 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a568eead-6889-490f-a8e6-1984123cdcf4 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:15.606307 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f5655d-7c1f-4182-beea-ef5bcaed3d5f None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:15.620229 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb69e97-5886-4d3d-b875-6defff64688f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:15.620867 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb69e97-5886-4d3d-b875-6defff64688f None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:15.621184 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb69e97-5886-4d3d-b875-6defff64688f None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:15.621389 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb69e97-5886-4d3d-b875-6defff64688f None admin] PATH_INFO: `/v3/services/network` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:15.621964 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb69e97-5886-4d3d-b875-6defff64688f None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:15.623353 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb69e97-5886-4d3d-b875-6defff64688f None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:15.632558 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-3bb69e97-5886-4d3d-b875-6defff64688f None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 20 22:11:15.632558 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:15.632558 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 20 22:11:15.632558 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 20 22:11:15.632558 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 20 22:11:15.632558 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 20 22:11:15.632558 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 20 22:11:15.632558 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 20 22:11:15.632558 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 20 22:11:15.632558 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:11:15.632558 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 20 22:11:15.632558 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:11:15.632558 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:15.632558 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:15.632558 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:15.632558 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:15.632558 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:15.633584 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:15.633584 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:15.633584 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:15.633584 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:15.633584 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:15.633584 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:15.633584 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 20 22:11:15.633584 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 20 22:11:15.633584 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 20 22:11:15.633584 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 20 22:11:15.633584 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:15.633584 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:15.633584 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:15.633584 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:15.633584 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:15.633584 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:15.634422 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:15.634422 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:15.634422 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:15.634422 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:15.634422 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:15.634422 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:15.634422 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:15.634422 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:15.634422 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:15.634422 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:15.634422 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 20 22:11:15.634422 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 20 22:11:15.634422 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 20 22:11:15.634422 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:11:15.634422 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 348/710] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Sep 20 22:11:15 2022] GET /identity/v3/services/network => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:15.635246 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb69e97-5886-4d3d-b875-6defff64688f None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:15.645792 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288150cf-2c07-4da6-ab91-b9560fb4fa8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:15.647000 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288150cf-2c07-4da6-ab91-b9560fb4fa8a None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:15.647278 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288150cf-2c07-4da6-ab91-b9560fb4fa8a None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:15.647546 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288150cf-2c07-4da6-ab91-b9560fb4fa8a None admin] PATH_INFO: `/v3/services` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:15.648171 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288150cf-2c07-4da6-ab91-b9560fb4fa8a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:15.648468 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288150cf-2c07-4da6-ab91-b9560fb4fa8a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:15.649808 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288150cf-2c07-4da6-ab91-b9560fb4fa8a None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:15.654532 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 363/711] 10.222.0.33 () {56 vars in 1124 bytes} [Tue Sep 20 22:11:15 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:15.655409 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288150cf-2c07-4da6-ab91-b9560fb4fa8a None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:15.709628 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:15.745978 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb69e97-5886-4d3d-b875-6defff64688f None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:15.747735 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:15.763917 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288150cf-2c07-4da6-ab91-b9560fb4fa8a None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:15.780405 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22e9ab0-f982-401c-bacd-96cb805f343b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:15.781005 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22e9ab0-f982-401c-bacd-96cb805f343b None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:15.781285 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22e9ab0-f982-401c-bacd-96cb805f343b None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:15.781563 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22e9ab0-f982-401c-bacd-96cb805f343b None admin] PATH_INFO: `/v3/projects` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:15.782230 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22e9ab0-f982-401c-bacd-96cb805f343b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:15.782548 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22e9ab0-f982-401c-bacd-96cb805f343b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:15.783955 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22e9ab0-f982-401c-bacd-96cb805f343b None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:15.796606 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 349/712] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Sep 20 22:11:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:15.797391 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22e9ab0-f982-401c-bacd-96cb805f343b None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:15.805035 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ec6191-055b-4c9b-93d6-c639e9665dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:15.805688 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ec6191-055b-4c9b-93d6-c639e9665dfa None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:15.805968 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ec6191-055b-4c9b-93d6-c639e9665dfa None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:15.806241 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ec6191-055b-4c9b-93d6-c639e9665dfa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:15.818717 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ec6191-055b-4c9b-93d6-c639e9665dfa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:15.820223 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ec6191-055b-4c9b-93d6-c639e9665dfa None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:15.835278 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-a9ec6191-055b-4c9b-93d6-c639e9665dfa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:11:15.835278 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:15.835278 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:15.835278 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:15.835278 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:15.835278 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:15.835278 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:15.835278 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:15.835278 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:15.835278 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:15.835278 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:15.835278 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:15.835278 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 22:11:15.835278 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 22:11:15.835278 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 22:11:15.835278 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 22:11:15.836235 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:15.836235 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:15.836235 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:15.836235 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:15.836235 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:15.836235 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:15.836235 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:15.836235 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:15.836235 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:15.836235 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:15.836235 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:15.836235 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:15.836235 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:15.836235 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:15.836235 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:15.836235 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:15.836235 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 22:11:15.837126 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 22:11:15.837126 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:11:15.837126 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:11:15.837126 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 364/713] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 20 22:11:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:15.837842 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ec6191-055b-4c9b-93d6-c639e9665dfa None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:15.909407 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22e9ab0-f982-401c-bacd-96cb805f343b None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:15.936563 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:15.945029 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ec6191-055b-4c9b-93d6-c639e9665dfa None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:15.945510 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452ae84d-7cbc-41eb-a224-0fcbeb6c79b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:15.945975 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452ae84d-7cbc-41eb-a224-0fcbeb6c79b1 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:15.946243 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452ae84d-7cbc-41eb-a224-0fcbeb6c79b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:15.946536 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452ae84d-7cbc-41eb-a224-0fcbeb6c79b1 None admin] PATH_INFO: `/v3/services` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:15.947152 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452ae84d-7cbc-41eb-a224-0fcbeb6c79b1 None admin] RBAC: Adding query filter params (name=network) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:15.947457 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452ae84d-7cbc-41eb-a224-0fcbeb6c79b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:15.948816 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452ae84d-7cbc-41eb-a224-0fcbeb6c79b1 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:15.953286 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 350/714] 10.222.0.33 () {56 vars in 1112 bytes} [Tue Sep 20 22:11:15 2022] GET /identity/v3/services?name=network => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:15.958459 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452ae84d-7cbc-41eb-a224-0fcbeb6c79b1 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:15.984004 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bfd741-c144-46af-897b-852a4a0ddf8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:15.984607 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bfd741-c144-46af-897b-852a4a0ddf8d None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:15.984885 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bfd741-c144-46af-897b-852a4a0ddf8d None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:15.985155 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bfd741-c144-46af-897b-852a4a0ddf8d None admin] PATH_INFO: `/v3/services` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:15.985785 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bfd741-c144-46af-897b-852a4a0ddf8d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:15.986087 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bfd741-c144-46af-897b-852a4a0ddf8d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:15.987474 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bfd741-c144-46af-897b-852a4a0ddf8d None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:15.993589 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 365/715] 10.222.0.33 () {56 vars in 1124 bytes} [Tue Sep 20 22:11:15 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:15.994349 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bfd741-c144-46af-897b-852a4a0ddf8d None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:15.996932 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:16.109437 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452ae84d-7cbc-41eb-a224-0fcbeb6c79b1 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:16.122738 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bfd741-c144-46af-897b-852a4a0ddf8d None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:16.152294 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab4ac6a-acd0-4ffa-940d-b5eaedcf1b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:16.153461 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab4ac6a-acd0-4ffa-940d-b5eaedcf1b26 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:16.153757 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab4ac6a-acd0-4ffa-940d-b5eaedcf1b26 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:16.154027 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab4ac6a-acd0-4ffa-940d-b5eaedcf1b26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:16.154840 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab4ac6a-acd0-4ffa-940d-b5eaedcf1b26 None admin] RBAC: Adding query filter params (role.id=8a829170b29d42d6af589399e51edb0f, scope.project.id=3ce415d02aa9489bae19cd514805fd8c, user.id=db7eed561e99452289a662ad326cf919) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:16.155415 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab4ac6a-acd0-4ffa-940d-b5eaedcf1b26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:16.157136 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab4ac6a-acd0-4ffa-940d-b5eaedcf1b26 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:16.170908 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 351/716] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Sep 20 22:11:15 2022] GET /identity/v3/role_assignments?user.id=db7eed561e99452289a662ad326cf919&scope.project.id=3ce415d02aa9489bae19cd514805fd8c&role.id=8a829170b29d42d6af589399e51edb0f => generated 259 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:16.170908 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab4ac6a-acd0-4ffa-940d-b5eaedcf1b26 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:16.172669 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64324901-0919-4a84-9c79-2649a03c6b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:16.173870 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64324901-0919-4a84-9c79-2649a03c6b01 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:16.173870 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64324901-0919-4a84-9c79-2649a03c6b01 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:16.173870 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64324901-0919-4a84-9c79-2649a03c6b01 None admin] PATH_INFO: `/v3/domains` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:16.175670 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64324901-0919-4a84-9c79-2649a03c6b01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:16.175670 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64324901-0919-4a84-9c79-2649a03c6b01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:16.176277 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64324901-0919-4a84-9c79-2649a03c6b01 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:16.199018 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 366/717] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 20 22:11:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:16.204604 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64324901-0919-4a84-9c79-2649a03c6b01 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:16.252581 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:16.289740 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:16.336298 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab4ac6a-acd0-4ffa-940d-b5eaedcf1b26 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:16.362367 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64324901-0919-4a84-9c79-2649a03c6b01 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:16.406664 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceae077f-f764-49cb-a28e-bb8093f8e326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:16.407254 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceae077f-f764-49cb-a28e-bb8093f8e326 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:16.407529 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceae077f-f764-49cb-a28e-bb8093f8e326 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:16.407798 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceae077f-f764-49cb-a28e-bb8093f8e326 None admin] PATH_INFO: `/v3/services` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:16.408427 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceae077f-f764-49cb-a28e-bb8093f8e326 None admin] RBAC: Adding query filter params (type=network) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:16.408726 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceae077f-f764-49cb-a28e-bb8093f8e326 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:16.411255 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceae077f-f764-49cb-a28e-bb8093f8e326 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:16.419932 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 352/718] 10.222.0.33 () {56 vars in 1112 bytes} [Tue Sep 20 22:11:16 2022] GET /identity/v3/services?type=network => generated 124 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:16.429919 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b201d07-b60e-4f6e-a563-67eecd6df4f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:16.430591 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b201d07-b60e-4f6e-a563-67eecd6df4f8 None admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:16.430926 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b201d07-b60e-4f6e-a563-67eecd6df4f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:16.431199 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b201d07-b60e-4f6e-a563-67eecd6df4f8 None admin] PATH_INFO: `/v3/users` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:16.431933 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b201d07-b60e-4f6e-a563-67eecd6df4f8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:16.433433 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b201d07-b60e-4f6e-a563-67eecd6df4f8 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:16.457589 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 367/719] 10.222.0.33 () {60 vars in 1132 bytes} [Tue Sep 20 22:11:16 2022] POST /identity/v3/users => generated 254 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:11:17.205990 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0702e62a-17e3-4e8f-a447-546485b7ad00 None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:17.206528 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0702e62a-17e3-4e8f-a447-546485b7ad00 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:17.206528 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0702e62a-17e3-4e8f-a447-546485b7ad00 None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:17.208244 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 353/720] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:11:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:11:17.213787 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d046a8ec-16b1-48db-b50b-4a5496d3aa34 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:17.214198 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d046a8ec-16b1-48db-b50b-4a5496d3aa34 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:17.214368 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d046a8ec-16b1-48db-b50b-4a5496d3aa34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:17.233275 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-d046a8ec-16b1-48db-b50b-4a5496d3aa34 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:11:17.234468 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-d046a8ec-16b1-48db-b50b-4a5496d3aa34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:11:17.331191 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 368/721] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:11:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 22:11:17.662926 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0702e62a-17e3-4e8f-a447-546485b7ad00 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:17.797230 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0702e62a-17e3-4e8f-a447-546485b7ad00 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:17.822605 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:17.842943 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b606431-56ac-4de7-958e-d970ded6b6fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:17.843567 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b606431-56ac-4de7-958e-d970ded6b6fb None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:17.843844 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b606431-56ac-4de7-958e-d970ded6b6fb None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:17.846911 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b606431-56ac-4de7-958e-d970ded6b6fb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:17.860942 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b606431-56ac-4de7-958e-d970ded6b6fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 22:11:17.866182 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-1b606431-56ac-4de7-958e-d970ded6b6fb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 22:11:17.866182 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:17.866182 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:17.866182 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:17.866182 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:17.866182 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:17.866182 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:17.866182 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:17.866182 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:17.866182 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:17.866182 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:17.866182 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:17.866182 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 22:11:17.866182 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 22:11:17.866182 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 22:11:17.866182 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 22:11:17.867165 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 22:11:17.867165 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 22:11:17.867165 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 22:11:17.867165 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 22:11:17.867165 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:17.867165 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:17.867165 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:17.867165 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:17.867165 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:17.867165 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:17.867165 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:17.867165 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:17.867165 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:17.867165 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:17.867165 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:17.867165 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:17.867995 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:17.867995 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:17.867995 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:17.867995 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:17.867995 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 22:11:17.867995 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 22:11:17.867995 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 22:11:17.867995 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 22:11:17.867995 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 22:11:17.867995 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 22:11:17.867995 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 22:11:17.867995 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:11:17.867995 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 354/722] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Sep 20 22:11:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:17.873235 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d046a8ec-16b1-48db-b50b-4a5496d3aa34 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:17.947055 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:18.013136 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d046a8ec-16b1-48db-b50b-4a5496d3aa34 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:18.064137 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edce2d8-4150-42d1-a0da-c93bae2f0cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:18.064746 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edce2d8-4150-42d1-a0da-c93bae2f0cc3 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:18.065022 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edce2d8-4150-42d1-a0da-c93bae2f0cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:18.065292 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edce2d8-4150-42d1-a0da-c93bae2f0cc3 None admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:18.066004 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edce2d8-4150-42d1-a0da-c93bae2f0cc3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:18.066305 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edce2d8-4150-42d1-a0da-c93bae2f0cc3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:18.067734 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edce2d8-4150-42d1-a0da-c93bae2f0cc3 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:18.082401 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 369/723] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 20 22:11:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:18.088310 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b606431-56ac-4de7-958e-d970ded6b6fb None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:18.229121 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b606431-56ac-4de7-958e-d970ded6b6fb None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:18.277073 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58bef89-84e0-4002-9d09-7896249ff78d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:18.277699 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58bef89-84e0-4002-9d09-7896249ff78d None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:18.277973 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58bef89-84e0-4002-9d09-7896249ff78d None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:18.278240 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58bef89-84e0-4002-9d09-7896249ff78d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:18.292600 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58bef89-84e0-4002-9d09-7896249ff78d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:18.292600 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58bef89-84e0-4002-9d09-7896249ff78d None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:18.309321 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-e58bef89-84e0-4002-9d09-7896249ff78d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:11:18.309321 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:18.309321 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:18.309321 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:18.309321 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:18.309321 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:18.309321 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:18.309321 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:18.309321 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:18.309321 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:18.309321 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:18.309321 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:18.309321 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 22:11:18.309321 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 22:11:18.309321 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 22:11:18.309321 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 22:11:18.310366 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:18.310366 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:18.310366 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:18.310366 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:18.310366 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:18.310366 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:18.310366 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:18.310366 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:18.310366 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:18.310366 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:18.310366 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:18.310366 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:18.310366 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:18.310366 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:18.310366 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:18.310366 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:18.310366 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 22:11:18.311293 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 22:11:18.311293 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:11:18.311293 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:11:18.311293 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 355/724] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 20 22:11:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:18.313907 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edce2d8-4150-42d1-a0da-c93bae2f0cc3 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:18.453854 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edce2d8-4150-42d1-a0da-c93bae2f0cc3 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:18.468100 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:18.501592 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12013119-8e02-468a-9e86-4b1910320dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:18.502168 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12013119-8e02-468a-9e86-4b1910320dd4 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:18.502446 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12013119-8e02-468a-9e86-4b1910320dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:18.502737 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12013119-8e02-468a-9e86-4b1910320dd4 None admin] PATH_INFO: `/v3/domains` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:18.503372 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12013119-8e02-468a-9e86-4b1910320dd4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:18.503669 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12013119-8e02-468a-9e86-4b1910320dd4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:18.505127 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12013119-8e02-468a-9e86-4b1910320dd4 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:18.525501 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 370/725] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 20 22:11:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:18.530979 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58bef89-84e0-4002-9d09-7896249ff78d None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:18.577057 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:18.673337 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58bef89-84e0-4002-9d09-7896249ff78d None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:18.724772 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a2050d-8b80-4289-8af9-fc23e3796608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:18.725419 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a2050d-8b80-4289-8af9-fc23e3796608 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:18.725693 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a2050d-8b80-4289-8af9-fc23e3796608 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:18.725959 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a2050d-8b80-4289-8af9-fc23e3796608 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:18.734396 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a2050d-8b80-4289-8af9-fc23e3796608 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:18.735943 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a2050d-8b80-4289-8af9-fc23e3796608 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:18.750255 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-29a2050d-8b80-4289-8af9-fc23e3796608 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 20 22:11:18.750255 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:18.750255 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:18.750255 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:18.750255 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:18.750255 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:18.750255 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:18.750255 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:18.750255 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:18.750255 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:18.750255 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:18.750255 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:18.750255 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 20 22:11:18.750255 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 20 22:11:18.750255 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 20 22:11:18.750255 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 20 22:11:18.751328 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:18.751328 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:18.751328 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 20 22:11:18.751328 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 22:11:18.751328 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 20 22:11:18.751328 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 22:11:18.751328 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:18.751328 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:18.751328 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:18.751328 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:18.751328 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:18.751328 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:18.751328 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:18.751328 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:18.751328 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:18.751328 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:18.751328 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:18.751328 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:18.752318 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:18.752318 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:18.752318 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 20 22:11:18.752318 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 20 22:11:18.752318 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 20 22:11:18.752318 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 20 22:11:18.752318 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 20 22:11:18.752318 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 20 22:11:18.752318 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 20 22:11:18.752318 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:11:18.755167 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 356/726] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Sep 20 22:11:18 2022] GET /identity/v3/users/swift => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:18.761108 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12013119-8e02-468a-9e86-4b1910320dd4 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:18.877407 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12013119-8e02-468a-9e86-4b1910320dd4 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:18.909764 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e57f5-b6cb-480b-9021-52eebf21b00e None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:18.910082 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e57f5-b6cb-480b-9021-52eebf21b00e None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:18.910325 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e57f5-b6cb-480b-9021-52eebf21b00e None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:18.912861 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 357/727] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:11:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:11:18.918671 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2652d1-955e-4fea-b2d8-6367b563ab23 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:18.918977 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2652d1-955e-4fea-b2d8-6367b563ab23 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:18.919228 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2652d1-955e-4fea-b2d8-6367b563ab23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:18.930037 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbd84da-f59a-406e-a6d6-8750c1a2961b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:18.930707 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbd84da-f59a-406e-a6d6-8750c1a2961b None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:18.930987 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbd84da-f59a-406e-a6d6-8750c1a2961b None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:18.931260 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbd84da-f59a-406e-a6d6-8750c1a2961b None admin] PATH_INFO: `/v3/users` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:18.931992 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbd84da-f59a-406e-a6d6-8750c1a2961b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:18.932296 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbd84da-f59a-406e-a6d6-8750c1a2961b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:18.933720 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbd84da-f59a-406e-a6d6-8750c1a2961b None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:18.950999 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-fd2652d1-955e-4fea-b2d8-6367b563ab23 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:11:18.952189 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-fd2652d1-955e-4fea-b2d8-6367b563ab23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:11:18.970932 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 371/728] 10.222.0.33 () {56 vars in 1135 bytes} [Tue Sep 20 22:11:18 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:18.978073 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbd84da-f59a-406e-a6d6-8750c1a2961b None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:19.028446 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:19.053579 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 358/729] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:11:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 20 22:11:19.063312 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fe3a03-6603-4081-808c-f5b7b2e89993 None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:19.063603 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fe3a03-6603-4081-808c-f5b7b2e89993 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:19.063883 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fe3a03-6603-4081-808c-f5b7b2e89993 None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:19.065394 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 359/730] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:11:19 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:11:19.074734 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaefaa6-a287-4078-952a-c5b51bcb4ab4 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:19.075017 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaefaa6-a287-4078-952a-c5b51bcb4ab4 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:19.075294 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaefaa6-a287-4078-952a-c5b51bcb4ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:19.113164 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbd84da-f59a-406e-a6d6-8750c1a2961b None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:19.114254 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-0aaefaa6-a287-4078-952a-c5b51bcb4ab4 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:11:19.115733 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-0aaefaa6-a287-4078-952a-c5b51bcb4ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:11:19.140521 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:19.152704 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22289910-8c4d-42df-a478-431431ff0b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:19.153333 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22289910-8c4d-42df-a478-431431ff0b48 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:19.153610 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22289910-8c4d-42df-a478-431431ff0b48 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:19.153875 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22289910-8c4d-42df-a478-431431ff0b48 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:19.234088 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22289910-8c4d-42df-a478-431431ff0b48 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:19.235650 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22289910-8c4d-42df-a478-431431ff0b48 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:19.236055 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 360/731] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:11:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 20 22:11:19.243137 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d27f355-75ee-4b57-b925-fdd8831661cb None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:19.243706 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d27f355-75ee-4b57-b925-fdd8831661cb None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:19.244195 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d27f355-75ee-4b57-b925-fdd8831661cb None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:19.246149 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 361/732] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:11:19 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:11:19.251288 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6caafc-253e-426f-8493-cb96b8225b8b None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:19.251905 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6caafc-253e-426f-8493-cb96b8225b8b None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:19.252380 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6caafc-253e-426f-8493-cb96b8225b8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:19.265646 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:19.283714 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-ac6caafc-253e-426f-8493-cb96b8225b8b None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:11:19.284831 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-ac6caafc-253e-426f-8493-cb96b8225b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:11:19.342980 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 372/733] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 20 22:11:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 20 22:11:19.344306 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c92460-9c90-490e-a806-c83005b7caaf None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:19.344590 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c92460-9c90-490e-a806-c83005b7caaf None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:19.344860 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c92460-9c90-490e-a806-c83005b7caaf None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:19.346329 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 373/734] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:11:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:11:19.350494 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c92460-9c90-490e-a806-c83005b7caaf None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:19.386761 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 362/735] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:11:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 20 22:11:19.388705 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f465b0a-0f58-4fd9-9bff-9efbb2194091 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:19.389083 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f465b0a-0f58-4fd9-9bff-9efbb2194091 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:19.389359 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f465b0a-0f58-4fd9-9bff-9efbb2194091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:19.409808 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-3f465b0a-0f58-4fd9-9bff-9efbb2194091 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:11:19.411020 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-3f465b0a-0f58-4fd9-9bff-9efbb2194091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:11:19.470866 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c92460-9c90-490e-a806-c83005b7caaf None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:19.479017 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 363/736] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:11:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 22:11:19.479995 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f465b0a-0f58-4fd9-9bff-9efbb2194091 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:19.492006 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:19.514687 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:19.538112 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac75e73-4ef8-4019-9a98-01d11edff178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:19.538692 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac75e73-4ef8-4019-9a98-01d11edff178 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:19.538967 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac75e73-4ef8-4019-9a98-01d11edff178 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:19.539233 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac75e73-4ef8-4019-9a98-01d11edff178 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:19.556510 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac75e73-4ef8-4019-9a98-01d11edff178 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:19.558135 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac75e73-4ef8-4019-9a98-01d11edff178 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:19.573642 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-aac75e73-4ef8-4019-9a98-01d11edff178 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:11:19.573642 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:19.573642 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:19.573642 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:19.573642 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:19.573642 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:19.573642 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:19.573642 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:19.573642 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:19.573642 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:19.573642 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:19.573642 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:19.573642 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 22:11:19.573642 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 22:11:19.573642 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 22:11:19.573642 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 22:11:19.574606 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:19.574606 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:19.574606 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:19.574606 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:19.574606 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:19.574606 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:19.574606 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:19.574606 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:19.574606 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:19.574606 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:19.574606 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:19.574606 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:19.574606 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:19.574606 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:19.574606 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:19.574606 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:19.574606 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 22:11:19.575897 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 22:11:19.575897 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:11:19.575897 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:11:19.575897 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 374/737] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 20 22:11:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:19.576834 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac75e73-4ef8-4019-9a98-01d11edff178 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:19.627565 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f465b0a-0f58-4fd9-9bff-9efbb2194091 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:19.665610 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a578a8a-62f8-438d-8b0f-053261b913fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:19.666440 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a578a8a-62f8-438d-8b0f-053261b913fc None admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:19.666924 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a578a8a-62f8-438d-8b0f-053261b913fc None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:19.667364 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a578a8a-62f8-438d-8b0f-053261b913fc None admin] PATH_INFO: `/v3/services` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:19.668293 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a578a8a-62f8-438d-8b0f-053261b913fc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:19.669927 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a578a8a-62f8-438d-8b0f-053261b913fc None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:19.685780 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac75e73-4ef8-4019-9a98-01d11edff178 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:19.690988 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 364/738] 10.222.0.33 () {60 vars in 1141 bytes} [Tue Sep 20 22:11:19 2022] POST /identity/v3/services => generated 251 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:11:19.692128 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a578a8a-62f8-438d-8b0f-053261b913fc None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:19.738305 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd01f4e8-42d2-4943-a5f1-753355ee77fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:19.740370 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd01f4e8-42d2-4943-a5f1-753355ee77fa None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:19.740370 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd01f4e8-42d2-4943-a5f1-753355ee77fa None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:19.740370 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd01f4e8-42d2-4943-a5f1-753355ee77fa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:19.753691 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd01f4e8-42d2-4943-a5f1-753355ee77fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 22:11:19.760384 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-bd01f4e8-42d2-4943-a5f1-753355ee77fa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 22:11:19.760384 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:19.760384 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:19.760384 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:19.760384 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:19.760384 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:19.760384 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:19.760384 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:19.760384 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:19.760384 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:19.760384 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:19.760384 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:19.760384 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 22:11:19.760384 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 22:11:19.760384 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 22:11:19.760384 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 22:11:19.761399 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 22:11:19.761399 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 22:11:19.761399 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 22:11:19.761399 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 22:11:19.761399 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:19.761399 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:19.761399 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:19.761399 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:19.761399 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:19.761399 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:19.761399 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:19.761399 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:19.761399 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:19.761399 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:19.761399 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:19.761399 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:19.762659 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:19.762659 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:19.762659 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:19.762659 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:19.762659 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 22:11:19.762659 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 22:11:19.762659 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 22:11:19.762659 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 22:11:19.762659 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 22:11:19.762659 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 22:11:19.762659 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 22:11:19.762659 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:11:19.766889 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 375/739] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Sep 20 22:11:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:19.767954 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd01f4e8-42d2-4943-a5f1-753355ee77fa None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:19.789061 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:19.813397 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:19.825907 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a578a8a-62f8-438d-8b0f-053261b913fc None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:19.862717 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8b8a38-a0e5-416d-b4f8-b4ed429dea38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:19.863333 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8b8a38-a0e5-416d-b4f8-b4ed429dea38 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:19.863609 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8b8a38-a0e5-416d-b4f8-b4ed429dea38 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:19.863877 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8b8a38-a0e5-416d-b4f8-b4ed429dea38 None admin] PATH_INFO: `/v3/domains` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:19.864528 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8b8a38-a0e5-416d-b4f8-b4ed429dea38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:19.865478 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8b8a38-a0e5-416d-b4f8-b4ed429dea38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:19.866888 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8b8a38-a0e5-416d-b4f8-b4ed429dea38 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:19.880156 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 365/740] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 20 22:11:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:19.881891 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8b8a38-a0e5-416d-b4f8-b4ed429dea38 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:19.892700 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd01f4e8-42d2-4943-a5f1-753355ee77fa None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:19.929205 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1d3f10-b1b4-4b6b-b2f5-f71a63c78434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:19.930200 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1d3f10-b1b4-4b6b-b2f5-f71a63c78434 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:19.930474 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1d3f10-b1b4-4b6b-b2f5-f71a63c78434 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:19.930851 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1d3f10-b1b4-4b6b-b2f5-f71a63c78434 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:19.942755 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1d3f10-b1b4-4b6b-b2f5-f71a63c78434 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 22:11:19.948429 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-db1d3f10-b1b4-4b6b-b2f5-f71a63c78434 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 20 22:11:19.948429 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:19.948429 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:19.948429 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:19.948429 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:19.948429 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:19.948429 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:19.948429 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:19.948429 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:19.948429 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:19.948429 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:19.948429 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:19.948429 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 22:11:19.948429 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 22:11:19.948429 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 22:11:19.948429 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 22:11:19.949341 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 22:11:19.949341 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 22:11:19.949341 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 22:11:19.949341 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 22:11:19.949341 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:19.949341 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:19.949341 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:19.949341 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:19.949341 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:19.949341 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:19.949341 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:19.949341 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:19.949341 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:19.949341 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:19.949341 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:19.949341 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:19.950203 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:19.950203 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:19.950203 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:19.950203 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:19.950203 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 22:11:19.950203 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 22:11:19.950203 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 22:11:19.950203 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 22:11:19.950203 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 22:11:19.950203 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 22:11:19.950203 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 20 22:11:19.950203 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:11:19.950203 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 376/741] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Sep 20 22:11:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:19.950935 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1d3f10-b1b4-4b6b-b2f5-f71a63c78434 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:19.999521 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8b8a38-a0e5-416d-b4f8-b4ed429dea38 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:20.055729 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:20.063579 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1d3f10-b1b4-4b6b-b2f5-f71a63c78434 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:20.100516 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5def2497-3fc8-4a9d-932b-f704643b7dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:20.101123 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5def2497-3fc8-4a9d-932b-f704643b7dfa None admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:20.101394 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5def2497-3fc8-4a9d-932b-f704643b7dfa None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:20.101658 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5def2497-3fc8-4a9d-932b-f704643b7dfa None admin] PATH_INFO: `/v3/services` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:20.102307 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5def2497-3fc8-4a9d-932b-f704643b7dfa None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:20.103705 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5def2497-3fc8-4a9d-932b-f704643b7dfa None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:20.130874 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 377/742] 10.222.0.33 () {60 vars in 1141 bytes} [Tue Sep 20 22:11:19 2022] POST /identity/v3/services => generated 240 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:11:20.131712 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5def2497-3fc8-4a9d-932b-f704643b7dfa None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:20.152290 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:20.166270 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af23561e-898f-4f0e-bc7b-e45976104612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:20.166859 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af23561e-898f-4f0e-bc7b-e45976104612 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:20.167215 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af23561e-898f-4f0e-bc7b-e45976104612 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:20.167494 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af23561e-898f-4f0e-bc7b-e45976104612 None admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:20.168174 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af23561e-898f-4f0e-bc7b-e45976104612 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:20.168475 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af23561e-898f-4f0e-bc7b-e45976104612 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:20.169870 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af23561e-898f-4f0e-bc7b-e45976104612 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:20.184309 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 366/743] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 20 22:11:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:20.184309 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af23561e-898f-4f0e-bc7b-e45976104612 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:20.273080 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5def2497-3fc8-4a9d-932b-f704643b7dfa None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:20.319588 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c23bef1-2bb9-45f8-929e-7c5aae6bacb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:20.320143 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c23bef1-2bb9-45f8-929e-7c5aae6bacb8 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:20.320418 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c23bef1-2bb9-45f8-929e-7c5aae6bacb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:20.320685 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c23bef1-2bb9-45f8-929e-7c5aae6bacb8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:20.328649 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c23bef1-2bb9-45f8-929e-7c5aae6bacb8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:20.330188 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c23bef1-2bb9-45f8-929e-7c5aae6bacb8 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:20.339892 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af23561e-898f-4f0e-bc7b-e45976104612 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:20.342087 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-5c23bef1-2bb9-45f8-929e-7c5aae6bacb8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 22:11:20.342087 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:20.342087 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:20.342087 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:20.342087 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:20.342087 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:20.342087 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:20.342087 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:20.342087 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:20.342087 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:20.342087 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:20.342087 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:20.342087 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 20 22:11:20.342087 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 20 22:11:20.342087 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 20 22:11:20.342970 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 20 22:11:20.342970 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:20.342970 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:20.342970 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:20.342970 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:20.342970 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:20.342970 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:20.342970 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:20.342970 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:20.342970 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:20.342970 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:20.342970 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:20.342970 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:20.342970 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:20.342970 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:20.342970 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:20.342970 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:20.344253 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 20 22:11:20.344253 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 20 22:11:20.344253 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 20 22:11:20.344253 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 20 22:11:20.344253 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 20 22:11:20.344253 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 20 22:11:20.344253 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 22:11:20.344253 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:11:20.344253 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 378/744] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Sep 20 22:11:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:20.344253 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c23bef1-2bb9-45f8-929e-7c5aae6bacb8 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:20.367945 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:20.391440 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725c319a-79f7-49fc-807f-eb33461d284b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:20.392056 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725c319a-79f7-49fc-807f-eb33461d284b None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:20.392333 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725c319a-79f7-49fc-807f-eb33461d284b None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:20.392597 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725c319a-79f7-49fc-807f-eb33461d284b None admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:20.393253 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725c319a-79f7-49fc-807f-eb33461d284b None admin] RBAC: Adding query filter params (name=service) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:20.393549 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725c319a-79f7-49fc-807f-eb33461d284b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:20.395409 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725c319a-79f7-49fc-807f-eb33461d284b None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:20.406842 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 367/745] 10.222.0.33 () {56 vars in 1103 bytes} [Tue Sep 20 22:11:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:20.407768 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725c319a-79f7-49fc-807f-eb33461d284b None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:20.466898 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c23bef1-2bb9-45f8-929e-7c5aae6bacb8 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:20.473072 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:20.512923 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ce02ba-cce0-43c3-b626-bc28a835fd12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:20.513554 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce02ba-cce0-43c3-b626-bc28a835fd12 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:20.513828 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce02ba-cce0-43c3-b626-bc28a835fd12 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:20.514094 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce02ba-cce0-43c3-b626-bc28a835fd12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:20.525402 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ce02ba-cce0-43c3-b626-bc28a835fd12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:20.526877 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ce02ba-cce0-43c3-b626-bc28a835fd12 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:20.531741 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725c319a-79f7-49fc-807f-eb33461d284b None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:20.542182 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-55ce02ba-cce0-43c3-b626-bc28a835fd12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:11:20.542182 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:20.542182 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:20.542182 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:20.542182 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:20.542182 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:20.542182 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:20.542182 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:20.542182 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:20.542182 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:20.542182 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:20.542182 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:20.542182 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 22:11:20.542182 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 22:11:20.542182 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 22:11:20.542182 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 22:11:20.543179 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:20.543179 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:20.543179 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:20.543179 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:20.543179 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:20.543179 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:20.543179 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:20.543179 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:20.543179 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:20.543179 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:20.543179 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:20.543179 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:20.543179 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:20.543179 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:20.543179 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:20.543179 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:20.543179 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 22:11:20.544076 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 22:11:20.544076 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:11:20.544076 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:11:20.544076 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 379/746] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 20 22:11:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:20.544298 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ce02ba-cce0-43c3-b626-bc28a835fd12 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:20.571832 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72695b93-904d-48d0-9a40-e0a09b1320f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:20.572789 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72695b93-904d-48d0-9a40-e0a09b1320f4 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:20.573269 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72695b93-904d-48d0-9a40-e0a09b1320f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:20.573739 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72695b93-904d-48d0-9a40-e0a09b1320f4 None admin] PATH_INFO: `/v3/projects` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:20.574654 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72695b93-904d-48d0-9a40-e0a09b1320f4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:20.575312 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72695b93-904d-48d0-9a40-e0a09b1320f4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:20.576932 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72695b93-904d-48d0-9a40-e0a09b1320f4 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:20.589316 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 368/747] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Sep 20 22:11:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:20.590422 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72695b93-904d-48d0-9a40-e0a09b1320f4 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:20.621761 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:20.659622 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ce02ba-cce0-43c3-b626-bc28a835fd12 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:20.695620 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e32a18-18c7-457b-b6bb-1194c3cbd9b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:20.696300 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e32a18-18c7-457b-b6bb-1194c3cbd9b8 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:20.696521 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e32a18-18c7-457b-b6bb-1194c3cbd9b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:20.696789 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e32a18-18c7-457b-b6bb-1194c3cbd9b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:20.699779 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72695b93-904d-48d0-9a40-e0a09b1320f4 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:20.708105 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e32a18-18c7-457b-b6bb-1194c3cbd9b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:20.709847 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e32a18-18c7-457b-b6bb-1194c3cbd9b8 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:20.712669 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:20.727521 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-40e32a18-18c7-457b-b6bb-1194c3cbd9b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:11:20.727521 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:20.727521 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:20.727521 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:20.727521 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:20.727521 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:20.727521 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:20.727521 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:20.727521 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:20.727521 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:20.727521 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:20.727521 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:20.727521 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 22:11:20.727521 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 22:11:20.727521 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 22:11:20.727521 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 22:11:20.728506 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:20.728506 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:20.728506 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:20.728506 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:20.728506 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:20.728506 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:20.728506 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:20.728506 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:20.728506 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:20.728506 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:20.728506 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:20.728506 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:20.728506 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:20.728506 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:20.728506 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:20.728506 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:20.728506 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 22:11:20.729390 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 22:11:20.729390 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:11:20.729390 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:11:20.729390 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 380/748] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 20 22:11:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:20.730017 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e32a18-18c7-457b-b6bb-1194c3cbd9b8 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:20.740118 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e62c2a-9d94-426b-b793-50debeb4efeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:20.741040 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e62c2a-9d94-426b-b793-50debeb4efeb None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:20.741518 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e62c2a-9d94-426b-b793-50debeb4efeb None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:20.741982 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e62c2a-9d94-426b-b793-50debeb4efeb None admin] PATH_INFO: `/v3/domains` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:20.742866 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e62c2a-9d94-426b-b793-50debeb4efeb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:20.743371 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e62c2a-9d94-426b-b793-50debeb4efeb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:20.744924 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e62c2a-9d94-426b-b793-50debeb4efeb None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:20.757432 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 369/749] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 20 22:11:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:20.758449 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e62c2a-9d94-426b-b793-50debeb4efeb None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:20.857566 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e32a18-18c7-457b-b6bb-1194c3cbd9b8 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:20.878481 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e62c2a-9d94-426b-b793-50debeb4efeb None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:20.885803 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:20.906444 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75163632-7af5-4941-95ff-d557c26e810b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:20.907226 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75163632-7af5-4941-95ff-d557c26e810b None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:20.907579 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75163632-7af5-4941-95ff-d557c26e810b None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:20.907948 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75163632-7af5-4941-95ff-d557c26e810b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:20.908988 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75163632-7af5-4941-95ff-d557c26e810b None admin] RBAC: Adding query filter params (role.id=8a829170b29d42d6af589399e51edb0f, scope.project.id=3ce415d02aa9489bae19cd514805fd8c, user.id=257983500d7b430c8f0377b2aa743ae0) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:20.909312 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75163632-7af5-4941-95ff-d557c26e810b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:20.912082 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75163632-7af5-4941-95ff-d557c26e810b None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:20.918827 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496233d7-f739-4c0d-99ec-0cea33c417c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:20.919687 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496233d7-f739-4c0d-99ec-0cea33c417c6 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:20.920167 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496233d7-f739-4c0d-99ec-0cea33c417c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:20.920655 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496233d7-f739-4c0d-99ec-0cea33c417c6 None admin] PATH_INFO: `/v3/domains` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:20.921496 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496233d7-f739-4c0d-99ec-0cea33c417c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:20.921998 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496233d7-f739-4c0d-99ec-0cea33c417c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:20.923631 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496233d7-f739-4c0d-99ec-0cea33c417c6 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:20.925902 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 381/750] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Sep 20 22:11:20 2022] GET /identity/v3/role_assignments?user.id=257983500d7b430c8f0377b2aa743ae0&scope.project.id=3ce415d02aa9489bae19cd514805fd8c&role.id=8a829170b29d42d6af589399e51edb0f => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:20.927638 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75163632-7af5-4941-95ff-d557c26e810b None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:20.939164 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 370/751] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 20 22:11:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:20.948716 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496233d7-f739-4c0d-99ec-0cea33c417c6 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:21.013997 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:21.076064 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75163632-7af5-4941-95ff-d557c26e810b None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:21.120366 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3db7b1-88c1-43fb-9647-54e4a1bfd838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:21.121256 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3db7b1-88c1-43fb-9647-54e4a1bfd838 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:21.121685 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3db7b1-88c1-43fb-9647-54e4a1bfd838 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:21.122106 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3db7b1-88c1-43fb-9647-54e4a1bfd838 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:21.132428 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3db7b1-88c1-43fb-9647-54e4a1bfd838 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:21.134302 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3db7b1-88c1-43fb-9647-54e4a1bfd838 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:21.148154 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-2f3db7b1-88c1-43fb-9647-54e4a1bfd838 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 20 22:11:21.148154 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:21.148154 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:21.148154 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:21.148154 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:21.148154 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:21.148154 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:21.148154 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:21.148154 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:21.148154 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:21.148154 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:21.148154 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:21.148154 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 20 22:11:21.148154 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 20 22:11:21.148154 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 20 22:11:21.148154 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 20 22:11:21.149358 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:21.149358 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:21.149358 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 20 22:11:21.149358 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 22:11:21.149358 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 20 22:11:21.149358 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 22:11:21.149358 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:21.149358 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:21.149358 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:21.149358 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:21.149358 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:21.149358 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:21.149358 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:21.149358 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:21.149358 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:21.149358 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:21.149358 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:21.149358 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:21.150554 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:21.150554 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:21.150554 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 20 22:11:21.150554 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 20 22:11:21.150554 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 20 22:11:21.150554 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 20 22:11:21.150554 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 20 22:11:21.150554 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 20 22:11:21.150554 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 20 22:11:21.150554 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:11:21.156030 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 382/752] 10.222.0.33 () {56 vars in 1093 bytes} [Tue Sep 20 22:11:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:21.163532 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3db7b1-88c1-43fb-9647-54e4a1bfd838 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:21.173963 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496233d7-f739-4c0d-99ec-0cea33c417c6 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:21.222663 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fd2382-1cb8-49d3-8d31-423ac55d7d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:21.223305 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fd2382-1cb8-49d3-8d31-423ac55d7d03 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:21.223585 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fd2382-1cb8-49d3-8d31-423ac55d7d03 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:21.223858 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fd2382-1cb8-49d3-8d31-423ac55d7d03 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:21.240507 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fd2382-1cb8-49d3-8d31-423ac55d7d03 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:21.241964 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fd2382-1cb8-49d3-8d31-423ac55d7d03 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:21.264032 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-e5fd2382-1cb8-49d3-8d31-423ac55d7d03 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 20 22:11:21.264032 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:21.264032 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:21.264032 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:21.264032 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:21.264032 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:21.264032 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:21.264032 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:21.264032 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:21.264032 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:21.264032 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:21.264032 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:21.264032 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 20 22:11:21.264032 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 20 22:11:21.264032 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 20 22:11:21.264032 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 20 22:11:21.265018 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:21.265018 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:21.265018 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 20 22:11:21.265018 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 22:11:21.265018 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 20 22:11:21.265018 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 22:11:21.265018 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:21.265018 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:21.265018 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:21.265018 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:21.265018 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:21.265018 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:21.265018 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:21.265018 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:21.265018 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:21.265018 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:21.265018 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:21.265018 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:21.265939 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:21.265939 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:21.265939 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 20 22:11:21.265939 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 20 22:11:21.265939 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 20 22:11:21.265939 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 20 22:11:21.265939 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 20 22:11:21.265939 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 20 22:11:21.265939 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 20 22:11:21.265939 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:11:21.266486 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:21.273256 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 371/753] 10.222.0.33 () {56 vars in 1117 bytes} [Tue Sep 20 22:11:20 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 20 22:11:21.295048 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fd2382-1cb8-49d3-8d31-423ac55d7d03 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:21.365255 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3db7b1-88c1-43fb-9647-54e4a1bfd838 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:21.433749 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4fed9a-6e1e-4740-8e3a-d5aa47dd44aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:21.435088 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4fed9a-6e1e-4740-8e3a-d5aa47dd44aa None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:21.435569 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4fed9a-6e1e-4740-8e3a-d5aa47dd44aa None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:21.436461 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4fed9a-6e1e-4740-8e3a-d5aa47dd44aa None admin] PATH_INFO: `/v3/users` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:21.437668 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4fed9a-6e1e-4740-8e3a-d5aa47dd44aa None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:21.438187 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4fed9a-6e1e-4740-8e3a-d5aa47dd44aa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:21.440052 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4fed9a-6e1e-4740-8e3a-d5aa47dd44aa None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:21.453685 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:21.475966 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 383/754] 10.222.0.33 () {56 vars in 1133 bytes} [Tue Sep 20 22:11:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:21.480525 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fd2382-1cb8-49d3-8d31-423ac55d7d03 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:21.482450 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4fed9a-6e1e-4740-8e3a-d5aa47dd44aa None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:21.589561 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4fed9a-6e1e-4740-8e3a-d5aa47dd44aa None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:21.600435 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:21.612282 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56982ca8-c678-4181-9401-af4dfa645aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:21.613005 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56982ca8-c678-4181-9401-af4dfa645aaa None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:21.613282 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56982ca8-c678-4181-9401-af4dfa645aaa None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:21.613744 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56982ca8-c678-4181-9401-af4dfa645aaa None admin] PATH_INFO: `/v3/users` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:21.614687 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56982ca8-c678-4181-9401-af4dfa645aaa None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:21.614996 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56982ca8-c678-4181-9401-af4dfa645aaa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:21.616426 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56982ca8-c678-4181-9401-af4dfa645aaa None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:21.630692 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ae6798-b88e-4816-9fb2-bb187cc164b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:21.631327 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ae6798-b88e-4816-9fb2-bb187cc164b9 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:21.631656 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ae6798-b88e-4816-9fb2-bb187cc164b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:21.631926 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ae6798-b88e-4816-9fb2-bb187cc164b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:21.651924 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ae6798-b88e-4816-9fb2-bb187cc164b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:21.655246 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 372/755] 10.222.0.33 () {56 vars in 1149 bytes} [Tue Sep 20 22:11:21 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 22:11:21.655679 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ae6798-b88e-4816-9fb2-bb187cc164b9 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:21.660682 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56982ca8-c678-4181-9401-af4dfa645aaa None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:21.685501 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-82ae6798-b88e-4816-9fb2-bb187cc164b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:11:21.685501 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:21.685501 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:21.685501 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:21.685501 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:21.685501 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:21.685501 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:21.685501 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:21.685501 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:21.685501 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:21.685501 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:21.685501 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:21.685501 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 22:11:21.685501 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 22:11:21.685501 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 22:11:21.685501 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 22:11:21.686607 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:21.686607 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:21.686607 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:21.686607 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:21.686607 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:21.686607 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:21.686607 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:21.686607 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:21.686607 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:21.686607 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:21.686607 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:21.686607 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:21.686607 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:21.686607 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:21.686607 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:21.686607 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:21.686607 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 22:11:21.687519 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 22:11:21.687519 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:11:21.687519 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:11:21.687519 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 384/756] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 20 22:11:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:21.694212 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ae6798-b88e-4816-9fb2-bb187cc164b9 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:21.862256 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56982ca8-c678-4181-9401-af4dfa645aaa None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:21.897909 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ae6798-b88e-4816-9fb2-bb187cc164b9 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:21.957357 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7844ddea-0379-4d03-a2f8-080487c609f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:21.958236 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7844ddea-0379-4d03-a2f8-080487c609f2 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:21.958837 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7844ddea-0379-4d03-a2f8-080487c609f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:21.959302 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7844ddea-0379-4d03-a2f8-080487c609f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:21.988134 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b84d5c5-e639-4972-9fd8-0b064b05adb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:21.989018 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b84d5c5-e639-4972-9fd8-0b064b05adb4 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:21.989469 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b84d5c5-e639-4972-9fd8-0b064b05adb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:21.990484 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b84d5c5-e639-4972-9fd8-0b064b05adb4 None admin] PATH_INFO: `/v3/domains` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:21.992588 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b84d5c5-e639-4972-9fd8-0b064b05adb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:21.993097 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b84d5c5-e639-4972-9fd8-0b064b05adb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:21.994683 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b84d5c5-e639-4972-9fd8-0b064b05adb4 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:22.000490 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:22.026816 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 385/757] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 20 22:11:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:22.030550 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b84d5c5-e639-4972-9fd8-0b064b05adb4 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:22.074877 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:22.085918 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7844ddea-0379-4d03-a2f8-080487c609f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:22.088423 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7844ddea-0379-4d03-a2f8-080487c609f2 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:22.204580 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 373/758] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 20 22:11:21 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 544 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 20 22:11:22.206234 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89de4d75-2ee5-45b0-95f8-dfe807770793 None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:22.206756 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89de4d75-2ee5-45b0-95f8-dfe807770793 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:22.207227 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89de4d75-2ee5-45b0-95f8-dfe807770793 None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:22.209538 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 374/759] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:11:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:11:22.211429 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89de4d75-2ee5-45b0-95f8-dfe807770793 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:22.250605 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b84d5c5-e639-4972-9fd8-0b064b05adb4 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:22.286067 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:22.350057 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89de4d75-2ee5-45b0-95f8-dfe807770793 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:22.351204 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918560b9-4175-4602-ac8e-dfcea4ea25d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:22.353493 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918560b9-4175-4602-ac8e-dfcea4ea25d6 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:22.355643 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918560b9-4175-4602-ac8e-dfcea4ea25d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:22.356132 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918560b9-4175-4602-ac8e-dfcea4ea25d6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:22.371575 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918560b9-4175-4602-ac8e-dfcea4ea25d6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:22.374917 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918560b9-4175-4602-ac8e-dfcea4ea25d6 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:22.399569 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-918560b9-4175-4602-ac8e-dfcea4ea25d6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 22:11:22.399569 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:22.399569 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:22.399569 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:22.399569 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:22.399569 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:22.399569 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:22.399569 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:22.399569 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:22.399569 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:22.399569 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:22.399569 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:22.399569 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 20 22:11:22.399569 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 20 22:11:22.399569 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 20 22:11:22.400554 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 20 22:11:22.400554 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:22.400554 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:22.400554 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:22.400554 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:22.400554 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:22.400554 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:22.400554 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:22.400554 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:22.400554 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:22.400554 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:22.400554 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:22.400554 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:22.400554 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:22.400554 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:22.400554 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:22.400554 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:22.401442 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 20 22:11:22.401442 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 20 22:11:22.401442 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 20 22:11:22.401442 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 20 22:11:22.401442 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 20 22:11:22.401442 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 20 22:11:22.401442 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 22:11:22.401442 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:11:22.412769 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 386/760] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Sep 20 22:11:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 382 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:22.416379 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb208070-e3b6-48c8-bb03-86fff43a35e0 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:22.416974 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb208070-e3b6-48c8-bb03-86fff43a35e0 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:22.418265 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb208070-e3b6-48c8-bb03-86fff43a35e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:22.428678 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e830b2-9943-4fdd-bf1a-b284435b2146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:22.430466 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e830b2-9943-4fdd-bf1a-b284435b2146 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:22.431910 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e830b2-9943-4fdd-bf1a-b284435b2146 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:22.433430 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e830b2-9943-4fdd-bf1a-b284435b2146 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:22.454027 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e830b2-9943-4fdd-bf1a-b284435b2146 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:22.455544 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-eb208070-e3b6-48c8-bb03-86fff43a35e0 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:11:22.456763 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e830b2-9943-4fdd-bf1a-b284435b2146 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:22.459725 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-eb208070-e3b6-48c8-bb03-86fff43a35e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:11:22.477835 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-26e830b2-9943-4fdd-bf1a-b284435b2146 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:11:22.477835 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:22.477835 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:22.477835 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:22.477835 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:22.477835 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:22.477835 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:22.477835 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:22.477835 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:22.477835 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:22.477835 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:22.477835 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:22.477835 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 22:11:22.477835 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 22:11:22.477835 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 22:11:22.477835 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 22:11:22.478923 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:22.478923 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:22.478923 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:22.478923 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:22.478923 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:22.478923 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:22.478923 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:22.478923 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:22.478923 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:22.478923 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:22.478923 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:22.478923 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:22.478923 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:22.478923 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:22.478923 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:22.478923 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:22.478923 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 22:11:22.479813 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 22:11:22.479813 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:11:22.479813 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:11:22.481961 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 375/761] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 20 22:11:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 20 22:11:22.483074 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e830b2-9943-4fdd-bf1a-b284435b2146 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:22.550863 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 387/762] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:11:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 20 22:11:22.551901 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb208070-e3b6-48c8-bb03-86fff43a35e0 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:22.560326 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:22.618282 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e830b2-9943-4fdd-bf1a-b284435b2146 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:22.631104 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:22.664272 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2f23bd-ca3c-42e7-a19e-fa6dcc66f835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:22.665517 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2f23bd-ca3c-42e7-a19e-fa6dcc66f835 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:22.666087 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2f23bd-ca3c-42e7-a19e-fa6dcc66f835 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:22.666645 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2f23bd-ca3c-42e7-a19e-fa6dcc66f835 None admin] PATH_INFO: `/v3/projects` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:22.667730 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2f23bd-ca3c-42e7-a19e-fa6dcc66f835 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:22.668228 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2f23bd-ca3c-42e7-a19e-fa6dcc66f835 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:22.670409 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2f23bd-ca3c-42e7-a19e-fa6dcc66f835 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:22.680512 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb208070-e3b6-48c8-bb03-86fff43a35e0 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:22.684916 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 376/763] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Sep 20 22:11:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:22.686252 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4928f4-c9dd-4ae0-bbc3-1f8b9e135cff None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:22.686692 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4928f4-c9dd-4ae0-bbc3-1f8b9e135cff None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:22.687066 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4928f4-c9dd-4ae0-bbc3-1f8b9e135cff None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:22.688625 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 377/764] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:11:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:11:22.692815 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4928f4-c9dd-4ae0-bbc3-1f8b9e135cff None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:22.724899 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d1db85-5fa3-498f-879c-6274d9770f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:22.726440 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d1db85-5fa3-498f-879c-6274d9770f7b None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:22.726892 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d1db85-5fa3-498f-879c-6274d9770f7b None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:22.727308 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d1db85-5fa3-498f-879c-6274d9770f7b None admin] PATH_INFO: `/v3/domains` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:22.728096 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d1db85-5fa3-498f-879c-6274d9770f7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:22.728542 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d1db85-5fa3-498f-879c-6274d9770f7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:22.730315 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d1db85-5fa3-498f-879c-6274d9770f7b None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:22.746400 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 388/765] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 20 22:11:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:22.747866 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0334f59d-9950-4781-a64f-1eca170e5564 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:22.748281 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0334f59d-9950-4781-a64f-1eca170e5564 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:22.748684 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0334f59d-9950-4781-a64f-1eca170e5564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:22.771979 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-0334f59d-9950-4781-a64f-1eca170e5564 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:11:22.773677 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-0334f59d-9950-4781-a64f-1eca170e5564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:11:22.818594 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4928f4-c9dd-4ae0-bbc3-1f8b9e135cff None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:22.854164 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:22.855410 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e2393b-d540-4bb7-8b44-550c7b3912a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:22.856245 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e2393b-d540-4bb7-8b44-550c7b3912a9 None admin] REQUEST_METHOD: `PUT` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:22.856560 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e2393b-d540-4bb7-8b44-550c7b3912a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:22.856901 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e2393b-d540-4bb7-8b44-550c7b3912a9 None admin] PATH_INFO: `/v3/projects/3ce415d02aa9489bae19cd514805fd8c/users/db7eed561e99452289a662ad326cf919/roles/8a829170b29d42d6af589399e51edb0f` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:22.858820 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e2393b-d540-4bb7-8b44-550c7b3912a9 None admin] RBAC: Authorizing `identity:create_grant(project_id=3ce415d02aa9489bae19cd514805fd8c, user_id=db7eed561e99452289a662ad326cf919, role_id=8a829170b29d42d6af589399e51edb0f)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:22.860259 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e2393b-d540-4bb7-8b44-550c7b3912a9 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:22.864336 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 389/766] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:11:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 20 22:11:22.865653 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0334f59d-9950-4781-a64f-1eca170e5564 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:22.880769 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 378/767] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Sep 20 22:11:22 2022] PUT /identity/v3/projects/3ce415d02aa9489bae19cd514805fd8c/users/db7eed561e99452289a662ad326cf919/roles/8a829170b29d42d6af589399e51edb0f => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 22:11:22.882758 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e2393b-d540-4bb7-8b44-550c7b3912a9 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:22.919521 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:22.990860 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0334f59d-9950-4781-a64f-1eca170e5564 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:23.057266 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e2393b-d540-4bb7-8b44-550c7b3912a9 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:23.081629 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7761e1-40fa-4513-9d96-c34a3b5a881e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:23.084915 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7761e1-40fa-4513-9d96-c34a3b5a881e None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:23.085451 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7761e1-40fa-4513-9d96-c34a3b5a881e None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:23.085958 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7761e1-40fa-4513-9d96-c34a3b5a881e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:23.104570 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7761e1-40fa-4513-9d96-c34a3b5a881e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:23.106024 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7761e1-40fa-4513-9d96-c34a3b5a881e None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:23.121445 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a9a696-e061-429f-84ce-5eb34f956eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:23.122082 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a9a696-e061-429f-84ce-5eb34f956eda None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:23.122358 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a9a696-e061-429f-84ce-5eb34f956eda None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:23.122676 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a9a696-e061-429f-84ce-5eb34f956eda None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:23.123536 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a9a696-e061-429f-84ce-5eb34f956eda None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:23.124979 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a9a696-e061-429f-84ce-5eb34f956eda None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:23.125738 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-9a7761e1-40fa-4513-9d96-c34a3b5a881e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 22:11:23.125738 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:23.125738 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:23.125738 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:23.125738 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:23.125738 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:23.125738 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:23.125738 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:23.125738 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:23.125738 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:23.125738 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:23.125738 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:23.125738 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 20 22:11:23.125738 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 20 22:11:23.125738 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 20 22:11:23.126758 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 20 22:11:23.126758 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:23.126758 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:23.126758 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:23.126758 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:23.126758 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:23.126758 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:23.126758 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:23.126758 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:23.126758 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:23.126758 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:23.126758 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:23.126758 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:23.126758 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:23.126758 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:23.126758 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:23.126758 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:23.127679 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 20 22:11:23.127679 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 20 22:11:23.127679 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 20 22:11:23.127679 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 20 22:11:23.127679 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 20 22:11:23.127679 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 20 22:11:23.127679 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 22:11:23.127679 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:11:23.127679 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 390/768] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Sep 20 22:11:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:23.135262 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-31a9a696-e061-429f-84ce-5eb34f956eda None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 20 22:11:23.135262 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:23.135262 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 20 22:11:23.135262 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 20 22:11:23.135262 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 20 22:11:23.135262 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 20 22:11:23.135262 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 20 22:11:23.135262 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 20 22:11:23.135262 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 20 22:11:23.135262 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:11:23.135262 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 20 22:11:23.135262 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:11:23.135262 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:23.135262 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:23.135262 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:23.135262 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:23.135262 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:23.136250 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:23.136250 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:23.136250 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:23.136250 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:23.136250 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:23.136250 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:23.136250 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 20 22:11:23.136250 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 20 22:11:23.136250 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 20 22:11:23.136250 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 20 22:11:23.136250 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:23.136250 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:23.136250 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:23.136250 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:23.136250 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:23.136250 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:23.137081 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:23.137081 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:23.137081 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:23.137081 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:23.137081 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:23.137081 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:23.137081 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:23.137081 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:23.137081 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:23.137081 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:23.137081 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 20 22:11:23.137081 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 20 22:11:23.137081 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 20 22:11:23.137081 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:11:23.138298 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7761e1-40fa-4513-9d96-c34a3b5a881e None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:23.141254 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 379/769] 10.222.0.33 () {56 vars in 1129 bytes} [Tue Sep 20 22:11:22 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:23.142105 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a9a696-e061-429f-84ce-5eb34f956eda None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:23.243900 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:23.258981 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:23.268768 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a9a696-e061-429f-84ce-5eb34f956eda None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:23.315663 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fea6a8b-2aff-4af1-a42c-4d32478769e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:23.316250 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fea6a8b-2aff-4af1-a42c-4d32478769e0 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:23.316523 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fea6a8b-2aff-4af1-a42c-4d32478769e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:23.316793 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fea6a8b-2aff-4af1-a42c-4d32478769e0 None admin] PATH_INFO: `/v3/services` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:23.317420 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fea6a8b-2aff-4af1-a42c-4d32478769e0 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:23.317921 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fea6a8b-2aff-4af1-a42c-4d32478769e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:23.319238 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fea6a8b-2aff-4af1-a42c-4d32478769e0 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:23.322963 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7761e1-40fa-4513-9d96-c34a3b5a881e None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:23.324266 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 380/770] 10.222.0.33 () {56 vars in 1124 bytes} [Tue Sep 20 22:11:23 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:23.325069 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fea6a8b-2aff-4af1-a42c-4d32478769e0 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:23.364797 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83201ab7-98af-495e-839f-ec1cec56efae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:23.365415 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83201ab7-98af-495e-839f-ec1cec56efae None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:23.365696 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83201ab7-98af-495e-839f-ec1cec56efae None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:23.365968 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83201ab7-98af-495e-839f-ec1cec56efae None admin] PATH_INFO: `/v3/projects` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:23.366701 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83201ab7-98af-495e-839f-ec1cec56efae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:23.367216 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83201ab7-98af-495e-839f-ec1cec56efae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:23.369639 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83201ab7-98af-495e-839f-ec1cec56efae None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:23.384527 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 391/771] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Sep 20 22:11:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:23.385358 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83201ab7-98af-495e-839f-ec1cec56efae None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:23.438865 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fea6a8b-2aff-4af1-a42c-4d32478769e0 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:23.480429 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681d1838-95bb-4374-a70c-f8822d89ca0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:23.481078 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681d1838-95bb-4374-a70c-f8822d89ca0d None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:23.481330 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681d1838-95bb-4374-a70c-f8822d89ca0d None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:23.481603 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681d1838-95bb-4374-a70c-f8822d89ca0d None admin] PATH_INFO: `/v3/services/network` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:23.482186 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681d1838-95bb-4374-a70c-f8822d89ca0d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:23.483586 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681d1838-95bb-4374-a70c-f8822d89ca0d None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:23.492215 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-681d1838-95bb-4374-a70c-f8822d89ca0d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 20 22:11:23.492215 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:23.492215 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 20 22:11:23.492215 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 20 22:11:23.492215 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 20 22:11:23.492215 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 20 22:11:23.492215 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 20 22:11:23.492215 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 20 22:11:23.492215 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 20 22:11:23.492215 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:11:23.492215 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 20 22:11:23.492215 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:11:23.492215 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:23.492215 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:23.492215 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:23.492215 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:23.492215 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:23.493167 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:23.493167 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:23.493167 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:23.493167 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:23.493167 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:23.493167 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:23.493167 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 20 22:11:23.493167 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 20 22:11:23.493167 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 20 22:11:23.493167 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 20 22:11:23.493167 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:23.493167 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:23.493167 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:23.493167 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:23.493167 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:23.493167 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:23.494051 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:23.494051 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:23.494051 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:23.494051 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:23.494051 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:23.494051 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:23.494051 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:23.494051 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:23.494051 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:23.494051 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:23.494051 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 20 22:11:23.494051 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 20 22:11:23.494051 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 20 22:11:23.494051 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:11:23.494051 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 381/772] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Sep 20 22:11:23 2022] GET /identity/v3/services/network => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:23.494892 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7828fc-22d1-4db1-bdbd-5dcf6eecabae None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:23.494892 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7828fc-22d1-4db1-bdbd-5dcf6eecabae None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:23.495024 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7828fc-22d1-4db1-bdbd-5dcf6eecabae None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:23.496321 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 382/773] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:11:23 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:11:23.500487 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83201ab7-98af-495e-839f-ec1cec56efae None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:23.500779 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7828fc-22d1-4db1-bdbd-5dcf6eecabae None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:23.516259 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:23.518389 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:23.539369 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52a1278-bdb1-483b-bfdc-f29085c36ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:23.539990 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52a1278-bdb1-483b-bfdc-f29085c36ad0 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:23.540255 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52a1278-bdb1-483b-bfdc-f29085c36ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:23.540524 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52a1278-bdb1-483b-bfdc-f29085c36ad0 None admin] PATH_INFO: `/v3/services` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:23.541146 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52a1278-bdb1-483b-bfdc-f29085c36ad0 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:23.541453 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52a1278-bdb1-483b-bfdc-f29085c36ad0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:23.542824 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52a1278-bdb1-483b-bfdc-f29085c36ad0 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:23.547681 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 392/774] 10.222.0.33 () {56 vars in 1124 bytes} [Tue Sep 20 22:11:23 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:23.548445 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52a1278-bdb1-483b-bfdc-f29085c36ad0 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:23.619766 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7828fc-22d1-4db1-bdbd-5dcf6eecabae None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:23.652782 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52a1278-bdb1-483b-bfdc-f29085c36ad0 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:23.657438 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636c9a99-dbc2-4920-8f27-c57669a1b43b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:23.658044 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636c9a99-dbc2-4920-8f27-c57669a1b43b None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:23.658323 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636c9a99-dbc2-4920-8f27-c57669a1b43b None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:23.658619 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636c9a99-dbc2-4920-8f27-c57669a1b43b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:23.659343 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636c9a99-dbc2-4920-8f27-c57669a1b43b None admin] RBAC: Adding query filter params (role.id=6d6dcbd3bc16491db00308c3b7d27a63, scope.project.id=3ce415d02aa9489bae19cd514805fd8c, user.id=e916748fdee84c34af034e75a919b986) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:23.659650 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636c9a99-dbc2-4920-8f27-c57669a1b43b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:23.661068 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636c9a99-dbc2-4920-8f27-c57669a1b43b None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:23.666650 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 383/775] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Sep 20 22:11:23 2022] GET /identity/v3/role_assignments?user.id=e916748fdee84c34af034e75a919b986&scope.project.id=3ce415d02aa9489bae19cd514805fd8c&role.id=6d6dcbd3bc16491db00308c3b7d27a63 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:23.676028 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a8b04e-f191-499b-9ee9-a9f78e7f293b None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:23.676376 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a8b04e-f191-499b-9ee9-a9f78e7f293b None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:23.676572 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a8b04e-f191-499b-9ee9-a9f78e7f293b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:23.696478 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-75a8b04e-f191-499b-9ee9-a9f78e7f293b None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:11:23.697730 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-75a8b04e-f191-499b-9ee9-a9f78e7f293b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:11:23.699519 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627b0256-5cc6-4dc5-bf83-d49e2c93c53d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:23.702004 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627b0256-5cc6-4dc5-bf83-d49e2c93c53d None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:23.702624 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627b0256-5cc6-4dc5-bf83-d49e2c93c53d None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:23.703137 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627b0256-5cc6-4dc5-bf83-d49e2c93c53d None admin] PATH_INFO: `/v3/services` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:23.704063 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627b0256-5cc6-4dc5-bf83-d49e2c93c53d None admin] RBAC: Adding query filter params (name=network) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:23.704575 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627b0256-5cc6-4dc5-bf83-d49e2c93c53d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:23.706355 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627b0256-5cc6-4dc5-bf83-d49e2c93c53d None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:23.714944 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 393/776] 10.222.0.33 () {56 vars in 1112 bytes} [Tue Sep 20 22:11:23 2022] GET /identity/v3/services?name=network => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:23.716127 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627b0256-5cc6-4dc5-bf83-d49e2c93c53d None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:23.778155 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:23.788172 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 384/777] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:11:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 20 22:11:23.790008 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a8b04e-f191-499b-9ee9-a9f78e7f293b None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:23.810398 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:23.882457 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627b0256-5cc6-4dc5-bf83-d49e2c93c53d None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:23.927549 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b570b8b2-33e0-4fb1-9897-31bff1356e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:23.927549 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b570b8b2-33e0-4fb1-9897-31bff1356e6f None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:23.927549 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b570b8b2-33e0-4fb1-9897-31bff1356e6f None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:23.927549 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b570b8b2-33e0-4fb1-9897-31bff1356e6f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:23.927956 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b570b8b2-33e0-4fb1-9897-31bff1356e6f None admin] RBAC: Adding query filter params (interface=public, service_id=2d83ae9536d44563a9a1a1fd367cd05d, region_id=RegionOne) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:23.927956 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b570b8b2-33e0-4fb1-9897-31bff1356e6f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:23.933643 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b570b8b2-33e0-4fb1-9897-31bff1356e6f None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:23.948724 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a8b04e-f191-499b-9ee9-a9f78e7f293b None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:23.952252 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 394/778] 10.222.0.33 () {56 vars in 1251 bytes} [Tue Sep 20 22:11:23 2022] GET /identity/v3/endpoints?service_id=2d83ae9536d44563a9a1a1fd367cd05d&interface=public®ion_id=RegionOne => generated 194 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:23.957987 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b570b8b2-33e0-4fb1-9897-31bff1356e6f None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:24.023281 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9993dbb1-5496-482d-b4c0-1d2f87b83707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:24.023893 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9993dbb1-5496-482d-b4c0-1d2f87b83707 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:24.024166 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9993dbb1-5496-482d-b4c0-1d2f87b83707 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:24.024430 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9993dbb1-5496-482d-b4c0-1d2f87b83707 None admin] PATH_INFO: `/v3/services` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:24.026798 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9993dbb1-5496-482d-b4c0-1d2f87b83707 None admin] RBAC: Adding query filter params (type=network) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:24.027099 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9993dbb1-5496-482d-b4c0-1d2f87b83707 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:24.028507 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9993dbb1-5496-482d-b4c0-1d2f87b83707 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:24.044886 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 385/779] 10.222.0.33 () {56 vars in 1112 bytes} [Tue Sep 20 22:11:23 2022] GET /identity/v3/services?type=network => generated 350 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:24.052621 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9993dbb1-5496-482d-b4c0-1d2f87b83707 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:24.110483 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b570b8b2-33e0-4fb1-9897-31bff1356e6f None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:24.118838 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:24.151367 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:24.154016 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07613815-b303-40d5-a7ef-74685756d95b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:24.154787 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07613815-b303-40d5-a7ef-74685756d95b None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:24.155351 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07613815-b303-40d5-a7ef-74685756d95b None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:24.156013 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07613815-b303-40d5-a7ef-74685756d95b None admin] PATH_INFO: `/v3/services` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:24.156634 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07613815-b303-40d5-a7ef-74685756d95b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:24.158792 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07613815-b303-40d5-a7ef-74685756d95b None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:24.174820 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 395/780] 10.222.0.33 () {56 vars in 1087 bytes} [Tue Sep 20 22:11:23 2022] GET /identity/v3/services => generated 772 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 22:11:24.175843 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07613815-b303-40d5-a7ef-74685756d95b None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:24.188977 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9993dbb1-5496-482d-b4c0-1d2f87b83707 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:24.233635 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a264176-1c74-4b50-a497-ef64e33e0148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:24.234265 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a264176-1c74-4b50-a497-ef64e33e0148 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:24.234557 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a264176-1c74-4b50-a497-ef64e33e0148 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:24.234833 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a264176-1c74-4b50-a497-ef64e33e0148 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:24.236212 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a264176-1c74-4b50-a497-ef64e33e0148 None admin] RBAC: Adding query filter params (interface=public, service_id=31bea70a93164d5b850d9571ce5e2d9c, region_id=RegionOne) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:24.236590 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a264176-1c74-4b50-a497-ef64e33e0148 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:24.238307 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a264176-1c74-4b50-a497-ef64e33e0148 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:24.247912 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 386/781] 10.222.0.33 () {56 vars in 1251 bytes} [Tue Sep 20 22:11:24 2022] GET /identity/v3/endpoints?service_id=31bea70a93164d5b850d9571ce5e2d9c&interface=public®ion_id=RegionOne => generated 194 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 22:11:24.253681 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a264176-1c74-4b50-a497-ef64e33e0148 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:24.366040 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07613815-b303-40d5-a7ef-74685756d95b None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:24.403168 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c09e61c-70f0-42de-8155-bdbb0678b679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:24.403932 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c09e61c-70f0-42de-8155-bdbb0678b679 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:24.404136 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c09e61c-70f0-42de-8155-bdbb0678b679 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:24.404408 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c09e61c-70f0-42de-8155-bdbb0678b679 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:24.416899 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c09e61c-70f0-42de-8155-bdbb0678b679 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 22:11:24.453691 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a264176-1c74-4b50-a497-ef64e33e0148 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:24.494379 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e742bd-b509-43d8-b7f4-84edd9ddf40e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:24.495862 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e742bd-b509-43d8-b7f4-84edd9ddf40e None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:24.496344 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e742bd-b509-43d8-b7f4-84edd9ddf40e None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:24.496816 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e742bd-b509-43d8-b7f4-84edd9ddf40e None admin] PATH_INFO: `/v3/services` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:24.497684 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e742bd-b509-43d8-b7f4-84edd9ddf40e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:24.499480 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e742bd-b509-43d8-b7f4-84edd9ddf40e None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:24.500981 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:24.507365 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 387/782] 10.222.0.33 () {56 vars in 1087 bytes} [Tue Sep 20 22:11:24 2022] GET /identity/v3/services => generated 772 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 22:11:24.538443 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-6c09e61c-70f0-42de-8155-bdbb0678b679 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 22:11:24.538443 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:24.538443 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:24.538443 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:24.538443 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:24.538443 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:24.538443 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:24.538443 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:24.538443 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:24.538443 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:24.538443 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:24.538443 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:24.538443 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 22:11:24.538443 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 22:11:24.538443 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 22:11:24.538443 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 22:11:24.539503 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 22:11:24.539503 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 22:11:24.539503 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 22:11:24.539503 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 22:11:24.539503 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:24.539503 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:24.539503 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:24.539503 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:24.539503 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:24.539503 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:24.539503 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:24.539503 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:24.539503 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:24.539503 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:24.539503 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:24.539503 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:24.540343 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:24.540343 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:24.540343 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:24.540343 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:24.540343 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 22:11:24.540343 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 22:11:24.540343 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 22:11:24.540343 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 22:11:24.540343 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 22:11:24.540343 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 22:11:24.540343 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 22:11:24.540343 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:11:24.540343 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 396/783] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Sep 20 22:11:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 364 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:24.546129 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e742bd-b509-43d8-b7f4-84edd9ddf40e None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:24.667034 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e742bd-b509-43d8-b7f4-84edd9ddf40e None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:24.714398 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1721616e-2e50-4e7e-979c-a66995bbadd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:24.715056 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1721616e-2e50-4e7e-979c-a66995bbadd9 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:24.715334 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1721616e-2e50-4e7e-979c-a66995bbadd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:24.715605 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1721616e-2e50-4e7e-979c-a66995bbadd9 None admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:24.716275 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1721616e-2e50-4e7e-979c-a66995bbadd9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:24.716577 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1721616e-2e50-4e7e-979c-a66995bbadd9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:24.717949 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1721616e-2e50-4e7e-979c-a66995bbadd9 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:24.727331 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 388/784] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 20 22:11:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:24.732839 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c09e61c-70f0-42de-8155-bdbb0678b679 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:24.769260 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:24.842027 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c09e61c-70f0-42de-8155-bdbb0678b679 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:24.877989 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88392b48-3a0b-41f4-8ded-e8631151f692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:24.879037 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88392b48-3a0b-41f4-8ded-e8631151f692 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:24.879520 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88392b48-3a0b-41f4-8ded-e8631151f692 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:24.880027 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88392b48-3a0b-41f4-8ded-e8631151f692 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:24.890549 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88392b48-3a0b-41f4-8ded-e8631151f692 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:24.892266 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88392b48-3a0b-41f4-8ded-e8631151f692 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:24.907830 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-88392b48-3a0b-41f4-8ded-e8631151f692 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:11:24.907830 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:24.907830 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:24.907830 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:24.907830 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:24.907830 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:24.907830 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:24.907830 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:24.907830 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:24.907830 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:24.907830 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:24.907830 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:24.907830 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 22:11:24.907830 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 22:11:24.907830 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 22:11:24.907830 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 22:11:24.908792 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:24.908792 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:24.908792 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:24.908792 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:24.908792 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:24.908792 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:24.908792 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:24.908792 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:24.908792 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:24.908792 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:24.908792 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:24.908792 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:24.908792 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:24.908792 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:24.908792 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:24.908792 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:24.908792 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 22:11:24.909705 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 22:11:24.909705 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:11:24.909705 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:11:24.912281 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 397/785] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 20 22:11:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:24.918046 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1721616e-2e50-4e7e-979c-a66995bbadd9 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:24.985767 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:25.034801 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1721616e-2e50-4e7e-979c-a66995bbadd9 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:25.071265 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782b31e8-9d0b-495a-8e8e-7b0c0aa190ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:25.071881 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782b31e8-9d0b-495a-8e8e-7b0c0aa190ac None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:25.072159 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782b31e8-9d0b-495a-8e8e-7b0c0aa190ac None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:25.072426 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782b31e8-9d0b-495a-8e8e-7b0c0aa190ac None admin] PATH_INFO: `/v3/domains` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:25.073066 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782b31e8-9d0b-495a-8e8e-7b0c0aa190ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:25.073365 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782b31e8-9d0b-495a-8e8e-7b0c0aa190ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:25.074736 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782b31e8-9d0b-495a-8e8e-7b0c0aa190ac None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:25.087695 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 389/786] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 20 22:11:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:25.093012 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88392b48-3a0b-41f4-8ded-e8631151f692 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:25.213038 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:25.227391 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d7f4f-4064-42c3-bc15-0f67d6e8822b None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:25.227665 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d7f4f-4064-42c3-bc15-0f67d6e8822b None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:25.227934 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d7f4f-4064-42c3-bc15-0f67d6e8822b None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:25.229424 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 390/787] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:11:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:11:25.234721 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68351fb3-1aea-4936-ac67-21765cb1209d None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:25.235230 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68351fb3-1aea-4936-ac67-21765cb1209d None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:25.235536 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88392b48-3a0b-41f4-8ded-e8631151f692 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:25.235921 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68351fb3-1aea-4936-ac67-21765cb1209d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:25.255603 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-68351fb3-1aea-4936-ac67-21765cb1209d None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:11:25.257148 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-68351fb3-1aea-4936-ac67-21765cb1209d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:11:25.272817 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63790f26-0a4c-4fea-a997-e2de4b700157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:25.273445 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63790f26-0a4c-4fea-a997-e2de4b700157 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:25.273724 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63790f26-0a4c-4fea-a997-e2de4b700157 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:25.273995 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63790f26-0a4c-4fea-a997-e2de4b700157 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:25.281377 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63790f26-0a4c-4fea-a997-e2de4b700157 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:25.283008 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63790f26-0a4c-4fea-a997-e2de4b700157 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:25.295301 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-63790f26-0a4c-4fea-a997-e2de4b700157 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 20 22:11:25.295301 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:25.295301 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:25.295301 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:25.295301 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:25.295301 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:25.295301 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:25.295301 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:25.295301 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:25.295301 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:25.295301 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:25.295301 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:25.295301 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 20 22:11:25.295301 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 20 22:11:25.295301 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 20 22:11:25.295301 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 20 22:11:25.296269 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:25.296269 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:25.296269 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 20 22:11:25.296269 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 22:11:25.296269 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 20 22:11:25.296269 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 22:11:25.296269 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:25.296269 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:25.296269 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:25.296269 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:25.296269 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:25.296269 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:25.296269 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:25.296269 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:25.296269 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:25.296269 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:25.296269 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:25.296269 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:25.297603 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:25.297603 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:25.297603 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 20 22:11:25.297603 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 20 22:11:25.297603 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 20 22:11:25.297603 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 20 22:11:25.297603 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 20 22:11:25.297603 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 20 22:11:25.297603 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 20 22:11:25.297603 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:11:25.297603 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 398/788] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Sep 20 22:11:25 2022] GET /identity/v3/users/swift => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:25.304062 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63790f26-0a4c-4fea-a997-e2de4b700157 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:25.382627 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 391/789] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:11:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 20 22:11:25.447330 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63790f26-0a4c-4fea-a997-e2de4b700157 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:25.481332 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34af94d1-c2e0-4eab-b576-29815b9784d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:25.481858 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34af94d1-c2e0-4eab-b576-29815b9784d1 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:25.482140 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34af94d1-c2e0-4eab-b576-29815b9784d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:25.482414 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34af94d1-c2e0-4eab-b576-29815b9784d1 None admin] PATH_INFO: `/v3/users` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:25.483179 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34af94d1-c2e0-4eab-b576-29815b9784d1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:25.483483 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34af94d1-c2e0-4eab-b576-29815b9784d1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:25.484900 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34af94d1-c2e0-4eab-b576-29815b9784d1 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:25.499700 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:25.506846 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 399/790] 10.222.0.33 () {56 vars in 1135 bytes} [Tue Sep 20 22:11:25 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 22:11:25.509854 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68351fb3-1aea-4936-ac67-21765cb1209d None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:25.585313 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:25.647619 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68351fb3-1aea-4936-ac67-21765cb1209d None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:25.673022 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34af94d1-c2e0-4eab-b576-29815b9784d1 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:25.687303 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52301969-eff6-4565-b391-e59586ed2b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:25.688246 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52301969-eff6-4565-b391-e59586ed2b37 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:25.688727 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52301969-eff6-4565-b391-e59586ed2b37 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:25.689217 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52301969-eff6-4565-b391-e59586ed2b37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:25.700034 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52301969-eff6-4565-b391-e59586ed2b37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:25.701754 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52301969-eff6-4565-b391-e59586ed2b37 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:25.717145 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-52301969-eff6-4565-b391-e59586ed2b37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:11:25.717145 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:25.717145 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:25.717145 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:25.717145 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:25.717145 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:25.717145 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:25.717145 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:25.717145 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:25.717145 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:25.717145 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:25.717145 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:25.717145 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 22:11:25.717145 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 22:11:25.717145 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 22:11:25.717145 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 22:11:25.718119 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:25.718119 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:25.718119 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:25.718119 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:25.718119 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:25.718119 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:25.718119 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:25.718119 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:25.718119 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:25.718119 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:25.718119 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:25.718119 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:25.718119 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:25.718119 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:25.718119 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:25.718119 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:25.718119 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 22:11:25.719027 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 22:11:25.719027 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:11:25.719027 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:11:25.721247 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 392/791] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 20 22:11:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:25.738477 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52301969-eff6-4565-b391-e59586ed2b37 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:25.803812 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34af94d1-c2e0-4eab-b576-29815b9784d1 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:25.839907 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f48909-cf26-45cc-85cc-79ab2f9cb3e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:25.840537 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f48909-cf26-45cc-85cc-79ab2f9cb3e7 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:25.840813 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f48909-cf26-45cc-85cc-79ab2f9cb3e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:25.841087 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f48909-cf26-45cc-85cc-79ab2f9cb3e7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:25.866524 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f48909-cf26-45cc-85cc-79ab2f9cb3e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 22:11:25.871864 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-75f48909-cf26-45cc-85cc-79ab2f9cb3e7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 22:11:25.871864 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:25.871864 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:25.871864 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:25.871864 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:25.871864 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:25.871864 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:25.871864 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:25.871864 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:25.871864 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:25.871864 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:25.871864 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:25.871864 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 22:11:25.871864 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 22:11:25.871864 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 22:11:25.871864 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 22:11:25.872780 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 22:11:25.872780 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 22:11:25.872780 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 22:11:25.872780 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 22:11:25.872780 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:25.872780 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:25.872780 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:25.872780 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:25.872780 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:25.872780 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:25.872780 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:25.872780 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:25.872780 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:25.872780 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:25.872780 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:25.872780 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:25.873611 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:25.873611 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:25.873611 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:25.873611 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:25.873611 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 22:11:25.873611 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 22:11:25.873611 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 22:11:25.873611 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 22:11:25.873611 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 22:11:25.873611 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 22:11:25.873611 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 22:11:25.873611 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:11:25.879739 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 400/792] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Sep 20 22:11:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:25.885536 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f48909-cf26-45cc-85cc-79ab2f9cb3e7 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:25.940663 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52301969-eff6-4565-b391-e59586ed2b37 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:25.946409 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:25.978934 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:26.015053 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f48909-cf26-45cc-85cc-79ab2f9cb3e7 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:26.043294 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590f4782-92b8-4ff1-b7dd-c11b33e4c2fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:26.043933 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590f4782-92b8-4ff1-b7dd-c11b33e4c2fa None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:26.044219 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590f4782-92b8-4ff1-b7dd-c11b33e4c2fa None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:26.044491 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590f4782-92b8-4ff1-b7dd-c11b33e4c2fa None admin] PATH_INFO: `/v3/domains` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:26.045166 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590f4782-92b8-4ff1-b7dd-c11b33e4c2fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:26.045471 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590f4782-92b8-4ff1-b7dd-c11b33e4c2fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:26.046950 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590f4782-92b8-4ff1-b7dd-c11b33e4c2fa None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:26.051304 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b866b8b3-b9ef-4ef4-903b-0404711df1e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:26.052744 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b866b8b3-b9ef-4ef4-903b-0404711df1e3 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:26.053203 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b866b8b3-b9ef-4ef4-903b-0404711df1e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:26.053632 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b866b8b3-b9ef-4ef4-903b-0404711df1e3 None admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:26.054835 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b866b8b3-b9ef-4ef4-903b-0404711df1e3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:26.055412 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b866b8b3-b9ef-4ef4-903b-0404711df1e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:26.057148 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b866b8b3-b9ef-4ef4-903b-0404711df1e3 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:26.068632 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 401/793] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 20 22:11:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 22:11:26.072643 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 393/794] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 20 22:11:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 22:11:26.077613 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b866b8b3-b9ef-4ef4-903b-0404711df1e3 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:26.083061 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590f4782-92b8-4ff1-b7dd-c11b33e4c2fa None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:26.240020 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590f4782-92b8-4ff1-b7dd-c11b33e4c2fa None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:26.241047 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b866b8b3-b9ef-4ef4-903b-0404711df1e3 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:26.269430 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:26.277508 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0198d4dc-c100-40f0-9893-0464534e9cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:26.278673 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0198d4dc-c100-40f0-9893-0464534e9cb4 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:26.279138 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0198d4dc-c100-40f0-9893-0464534e9cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:26.279833 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0198d4dc-c100-40f0-9893-0464534e9cb4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:26.285426 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9974ac89-2c06-44a4-81e7-09dcb33aa939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:26.286131 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9974ac89-2c06-44a4-81e7-09dcb33aa939 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:26.287113 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9974ac89-2c06-44a4-81e7-09dcb33aa939 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:26.287457 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9974ac89-2c06-44a4-81e7-09dcb33aa939 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:26.289495 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0198d4dc-c100-40f0-9893-0464534e9cb4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:26.291240 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0198d4dc-c100-40f0-9893-0464534e9cb4 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:26.304249 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-0198d4dc-c100-40f0-9893-0464534e9cb4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 22:11:26.304249 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:26.304249 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:26.304249 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:26.304249 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:26.304249 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:26.304249 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:26.304249 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:26.304249 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:26.304249 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:26.304249 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:26.304249 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:26.304249 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 20 22:11:26.304249 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 20 22:11:26.304249 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 20 22:11:26.305410 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 20 22:11:26.305410 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:26.305410 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:26.305410 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:26.305410 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:26.305410 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:26.305410 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:26.305410 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:26.305410 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:26.305410 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:26.305410 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:26.305410 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:26.305410 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:26.305410 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:26.305410 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:26.305410 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:26.305410 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:26.306282 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 20 22:11:26.306282 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 20 22:11:26.306282 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 20 22:11:26.306282 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 20 22:11:26.306282 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 20 22:11:26.306282 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 20 22:11:26.306282 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 22:11:26.306282 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:11:26.314786 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 394/795] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Sep 20 22:11:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:26.314786 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb79e717-cc68-496c-84be-5a044f00cffe None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:26.314786 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb79e717-cc68-496c-84be-5a044f00cffe None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:26.314786 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb79e717-cc68-496c-84be-5a044f00cffe None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:26.314786 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 395/796] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:11:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:11:26.314786 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb79e717-cc68-496c-84be-5a044f00cffe None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:26.316221 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9974ac89-2c06-44a4-81e7-09dcb33aa939 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:26.317771 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9974ac89-2c06-44a4-81e7-09dcb33aa939 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:26.337678 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-9974ac89-2c06-44a4-81e7-09dcb33aa939 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:11:26.337678 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:26.337678 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:26.337678 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:26.337678 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:26.337678 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:26.337678 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:26.337678 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:26.337678 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:26.337678 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:26.337678 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:26.337678 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:26.337678 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 22:11:26.337678 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 22:11:26.337678 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 22:11:26.337678 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 22:11:26.338667 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:26.338667 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:26.338667 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:26.338667 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:26.338667 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:26.338667 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:26.338667 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:26.338667 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:26.338667 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:26.338667 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:26.338667 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:26.338667 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:26.338667 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:26.338667 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:26.338667 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:26.338667 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:26.338667 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 22:11:26.339580 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 22:11:26.339580 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:11:26.339580 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:11:26.341423 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 402/797] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 20 22:11:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:26.342818 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a646ca-d21c-4914-85f5-8b060af26e3c None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:26.343103 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a646ca-d21c-4914-85f5-8b060af26e3c None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:26.343375 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a646ca-d21c-4914-85f5-8b060af26e3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:26.362858 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:26.365075 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-08a646ca-d21c-4914-85f5-8b060af26e3c None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:11:26.366381 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-08a646ca-d21c-4914-85f5-8b060af26e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:11:26.434276 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 403/798] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:11:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 20 22:11:26.435259 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a646ca-d21c-4914-85f5-8b060af26e3c None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:26.464391 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb79e717-cc68-496c-84be-5a044f00cffe None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:26.526376 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc40f320-255d-40cd-b237-77d482b2e692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:26.527010 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc40f320-255d-40cd-b237-77d482b2e692 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:26.527299 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc40f320-255d-40cd-b237-77d482b2e692 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:26.527756 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc40f320-255d-40cd-b237-77d482b2e692 None admin] PATH_INFO: `/v3/projects` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:26.528603 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc40f320-255d-40cd-b237-77d482b2e692 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:26.529052 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc40f320-255d-40cd-b237-77d482b2e692 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:26.530863 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc40f320-255d-40cd-b237-77d482b2e692 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:26.535923 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a646ca-d21c-4914-85f5-8b060af26e3c None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:26.543786 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:26.562521 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 396/799] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Sep 20 22:11:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:26.569323 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc40f320-255d-40cd-b237-77d482b2e692 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:26.572102 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358c65f0-107b-4ea0-9f69-32155227d549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:26.572713 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358c65f0-107b-4ea0-9f69-32155227d549 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:26.572988 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358c65f0-107b-4ea0-9f69-32155227d549 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:26.573253 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358c65f0-107b-4ea0-9f69-32155227d549 None admin] PATH_INFO: `/v3/domains` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:26.573888 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358c65f0-107b-4ea0-9f69-32155227d549 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:26.574187 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358c65f0-107b-4ea0-9f69-32155227d549 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:26.575599 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358c65f0-107b-4ea0-9f69-32155227d549 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:26.587943 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 404/800] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 20 22:11:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:26.593247 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358c65f0-107b-4ea0-9f69-32155227d549 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:26.671188 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:26.706186 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc40f320-255d-40cd-b237-77d482b2e692 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:26.748145 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9140ddfb-e9a6-4237-a126-64f825e26d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:26.749242 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9140ddfb-e9a6-4237-a126-64f825e26d66 None admin] REQUEST_METHOD: `PUT` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:26.749729 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9140ddfb-e9a6-4237-a126-64f825e26d66 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:26.750218 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9140ddfb-e9a6-4237-a126-64f825e26d66 None admin] PATH_INFO: `/v3/projects/3ce415d02aa9489bae19cd514805fd8c/users/257983500d7b430c8f0377b2aa743ae0/roles/8a829170b29d42d6af589399e51edb0f` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:26.752504 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9140ddfb-e9a6-4237-a126-64f825e26d66 None admin] RBAC: Authorizing `identity:create_grant(project_id=3ce415d02aa9489bae19cd514805fd8c, user_id=257983500d7b430c8f0377b2aa743ae0, role_id=8a829170b29d42d6af589399e51edb0f)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:26.754133 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9140ddfb-e9a6-4237-a126-64f825e26d66 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:26.779691 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 397/801] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Sep 20 22:11:26 2022] PUT /identity/v3/projects/3ce415d02aa9489bae19cd514805fd8c/users/257983500d7b430c8f0377b2aa743ae0/roles/8a829170b29d42d6af589399e51edb0f => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 22:11:26.832399 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358c65f0-107b-4ea0-9f69-32155227d549 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:26.843166 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9140ddfb-e9a6-4237-a126-64f825e26d66 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:26.901507 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f035fa-5293-4dcb-8276-4f9994d8b3b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:26.904700 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f035fa-5293-4dcb-8276-4f9994d8b3b5 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:26.906154 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f035fa-5293-4dcb-8276-4f9994d8b3b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:26.906685 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f035fa-5293-4dcb-8276-4f9994d8b3b5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:26.925529 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f035fa-5293-4dcb-8276-4f9994d8b3b5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:26.928508 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f035fa-5293-4dcb-8276-4f9994d8b3b5 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:26.957330 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-a3f035fa-5293-4dcb-8276-4f9994d8b3b5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 20 22:11:26.957330 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:26.957330 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:26.957330 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:26.957330 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:26.957330 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:26.957330 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:26.957330 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:26.957330 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:26.957330 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:26.957330 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:26.957330 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:26.957330 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 20 22:11:26.957330 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 20 22:11:26.957330 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 20 22:11:26.957330 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 20 22:11:26.958949 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:26.958949 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:26.958949 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 20 22:11:26.958949 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 22:11:26.958949 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 20 22:11:26.958949 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 22:11:26.958949 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:26.958949 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:26.958949 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:26.958949 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:26.958949 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:26.958949 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:26.958949 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:26.958949 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:26.958949 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:26.958949 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:26.958949 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:26.958949 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:26.959923 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:26.959923 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:26.959923 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 20 22:11:26.959923 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 20 22:11:26.959923 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 20 22:11:26.959923 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 20 22:11:26.959923 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 20 22:11:26.959923 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 20 22:11:26.959923 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 20 22:11:26.959923 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:11:26.963586 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 405/802] 10.222.0.33 () {56 vars in 1093 bytes} [Tue Sep 20 22:11:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 371 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 20 22:11:26.969673 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f035fa-5293-4dcb-8276-4f9994d8b3b5 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:27.013310 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:27.026474 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9140ddfb-e9a6-4237-a126-64f825e26d66 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:27.107923 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6bc7f5-f0ba-4f7c-a15a-26ae174c614b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:27.108583 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6bc7f5-f0ba-4f7c-a15a-26ae174c614b None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:27.108870 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6bc7f5-f0ba-4f7c-a15a-26ae174c614b None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:27.109128 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6bc7f5-f0ba-4f7c-a15a-26ae174c614b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:27.118128 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f035fa-5293-4dcb-8276-4f9994d8b3b5 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:27.143522 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6bc7f5-f0ba-4f7c-a15a-26ae174c614b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 22:11:27.149255 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-bd6bc7f5-f0ba-4f7c-a15a-26ae174c614b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 20 22:11:27.149255 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:27.149255 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:27.149255 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:27.149255 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:27.149255 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:27.149255 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:27.149255 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:27.149255 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:27.149255 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:27.149255 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:27.149255 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:27.149255 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 22:11:27.149255 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 22:11:27.149255 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 22:11:27.149255 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 22:11:27.150179 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 22:11:27.150179 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 22:11:27.150179 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 22:11:27.150179 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 22:11:27.150179 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:27.150179 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:27.150179 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:27.150179 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:27.150179 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:27.150179 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:27.150179 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:27.150179 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:27.150179 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:27.150179 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:27.150179 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:27.150179 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:27.151059 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:27.151059 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:27.151059 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:27.151059 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:27.151059 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 22:11:27.151059 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 22:11:27.151059 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 22:11:27.151059 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 22:11:27.151059 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 22:11:27.151059 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 22:11:27.151059 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 20 22:11:27.151059 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:11:27.154951 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 398/803] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Sep 20 22:11:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:27.157505 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6bc7f5-f0ba-4f7c-a15a-26ae174c614b None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:27.160425 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806a1a6f-d35d-4595-ba71-d021d9e35506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:27.162002 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:27.163674 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806a1a6f-d35d-4595-ba71-d021d9e35506 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:27.166549 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806a1a6f-d35d-4595-ba71-d021d9e35506 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:27.166549 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806a1a6f-d35d-4595-ba71-d021d9e35506 None admin] PATH_INFO: `/v3/users` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:27.166549 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806a1a6f-d35d-4595-ba71-d021d9e35506 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:27.166549 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806a1a6f-d35d-4595-ba71-d021d9e35506 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:27.167427 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806a1a6f-d35d-4595-ba71-d021d9e35506 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:27.187997 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 406/804] 10.222.0.33 () {56 vars in 1133 bytes} [Tue Sep 20 22:11:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:27.196860 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806a1a6f-d35d-4595-ba71-d021d9e35506 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:27.303664 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:27.319161 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6bc7f5-f0ba-4f7c-a15a-26ae174c614b None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:27.323202 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806a1a6f-d35d-4595-ba71-d021d9e35506 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:27.358271 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f1cda2-d053-4b6e-b8ab-900e86fdd8c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:27.358482 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a85e801-09ad-4559-965b-16faa2a61c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:27.358828 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a85e801-09ad-4559-965b-16faa2a61c36 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:27.359105 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a85e801-09ad-4559-965b-16faa2a61c36 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:27.359375 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a85e801-09ad-4559-965b-16faa2a61c36 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:27.360039 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f1cda2-d053-4b6e-b8ab-900e86fdd8c7 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:27.360534 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f1cda2-d053-4b6e-b8ab-900e86fdd8c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:27.361019 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f1cda2-d053-4b6e-b8ab-900e86fdd8c7 None admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:27.361994 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f1cda2-d053-4b6e-b8ab-900e86fdd8c7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:27.362527 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f1cda2-d053-4b6e-b8ab-900e86fdd8c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:27.364309 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f1cda2-d053-4b6e-b8ab-900e86fdd8c7 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:27.373820 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 399/805] 10.222.0.33 () {56 vars in 1103 bytes} [Tue Sep 20 22:11:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:27.375631 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c945baa0-6bb1-4e5f-8c8a-855c97ff094a None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:27.376126 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c945baa0-6bb1-4e5f-8c8a-855c97ff094a None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:27.376620 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c945baa0-6bb1-4e5f-8c8a-855c97ff094a None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:27.378418 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 400/806] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:11:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:11:27.383717 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c945baa0-6bb1-4e5f-8c8a-855c97ff094a None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:27.436628 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a85e801-09ad-4559-965b-16faa2a61c36 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:27.438074 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a85e801-09ad-4559-965b-16faa2a61c36 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:27.465124 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:27.510350 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c945baa0-6bb1-4e5f-8c8a-855c97ff094a None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:27.522570 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:27.543844 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 407/807] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 20 22:11:27 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 20 22:11:27.545757 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f97e4-e4f5-4e04-b825-89743c6fcbea None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:27.546043 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f97e4-e4f5-4e04-b825-89743c6fcbea None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:27.546321 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f97e4-e4f5-4e04-b825-89743c6fcbea None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:27.550544 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 408/808] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:11:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:11:27.550544 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86ae40e-8208-4ca3-b0f7-b32d1ceaeab6 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:27.550544 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86ae40e-8208-4ca3-b0f7-b32d1ceaeab6 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:27.550544 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86ae40e-8208-4ca3-b0f7-b32d1ceaeab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:27.554235 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429c2efb-be02-42a7-ac60-2e0bb336edb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:27.555225 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429c2efb-be02-42a7-ac60-2e0bb336edb1 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:27.555574 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429c2efb-be02-42a7-ac60-2e0bb336edb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:27.555915 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429c2efb-be02-42a7-ac60-2e0bb336edb1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:27.566982 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429c2efb-be02-42a7-ac60-2e0bb336edb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:27.569036 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429c2efb-be02-42a7-ac60-2e0bb336edb1 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:27.569140 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-d86ae40e-8208-4ca3-b0f7-b32d1ceaeab6 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:11:27.570324 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-d86ae40e-8208-4ca3-b0f7-b32d1ceaeab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:11:27.584731 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-429c2efb-be02-42a7-ac60-2e0bb336edb1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:11:27.584731 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:27.584731 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:27.584731 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:27.584731 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:27.584731 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:27.584731 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:27.584731 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:27.584731 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:27.584731 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:27.584731 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:27.584731 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:27.584731 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 22:11:27.584731 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 22:11:27.584731 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 22:11:27.584731 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 22:11:27.585887 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:27.585887 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:27.585887 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:27.585887 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:27.585887 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:27.585887 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:27.585887 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:27.585887 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:27.585887 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:27.585887 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:27.585887 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:27.585887 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:27.585887 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:27.585887 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:27.585887 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:27.585887 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:27.585887 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 22:11:27.587183 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 22:11:27.587183 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:11:27.587183 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:11:27.587183 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 401/809] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 20 22:11:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:27.587183 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429c2efb-be02-42a7-ac60-2e0bb336edb1 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:27.654623 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 409/810] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:11:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 20 22:11:27.654623 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80663a32-29ec-464f-b125-cf9133513776 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:27.654623 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80663a32-29ec-464f-b125-cf9133513776 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:27.654623 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80663a32-29ec-464f-b125-cf9133513776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:27.666678 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-80663a32-29ec-464f-b125-cf9133513776 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:11:27.668459 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-80663a32-29ec-464f-b125-cf9133513776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:11:27.717847 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429c2efb-be02-42a7-ac60-2e0bb336edb1 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:27.739932 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:27.758657 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 410/811] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:11:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 20 22:11:27.759529 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80663a32-29ec-464f-b125-cf9133513776 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:27.784881 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aff8e3-5e30-4330-8f72-b5de1733061d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:27.785544 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aff8e3-5e30-4330-8f72-b5de1733061d None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:27.785832 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aff8e3-5e30-4330-8f72-b5de1733061d None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:27.786098 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aff8e3-5e30-4330-8f72-b5de1733061d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:27.809461 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aff8e3-5e30-4330-8f72-b5de1733061d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:27.810949 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aff8e3-5e30-4330-8f72-b5de1733061d None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:27.837112 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-37aff8e3-5e30-4330-8f72-b5de1733061d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:11:27.837112 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:27.837112 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:27.837112 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:27.837112 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:27.837112 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:27.837112 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:27.837112 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:27.837112 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:27.837112 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:27.837112 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:27.837112 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:27.837112 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 22:11:27.837112 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 22:11:27.837112 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 22:11:27.837112 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 22:11:27.838084 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:27.838084 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:27.838084 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:27.838084 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:27.838084 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:27.838084 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:27.838084 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:27.838084 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:27.838084 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:27.838084 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:27.838084 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:27.838084 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:27.838084 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:27.838084 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:27.838084 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:27.838084 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:27.838084 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 22:11:27.839020 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 22:11:27.839020 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:11:27.839020 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:11:27.840609 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 402/812] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 20 22:11:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:27.842888 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:27.845909 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aff8e3-5e30-4330-8f72-b5de1733061d None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:27.949569 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80663a32-29ec-464f-b125-cf9133513776 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:27.988705 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cca309b-1658-412b-9985-94957ec2d005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:27.989862 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca309b-1658-412b-9985-94957ec2d005 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:27.990153 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca309b-1658-412b-9985-94957ec2d005 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:27.990422 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca309b-1658-412b-9985-94957ec2d005 None admin] PATH_INFO: `/v3/domains` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:27.991105 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cca309b-1658-412b-9985-94957ec2d005 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:27.991402 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cca309b-1658-412b-9985-94957ec2d005 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:27.992351 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aff8e3-5e30-4330-8f72-b5de1733061d None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:27.992818 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cca309b-1658-412b-9985-94957ec2d005 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:28.007823 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 411/813] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 20 22:11:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:28.008835 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cca309b-1658-412b-9985-94957ec2d005 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:28.035850 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e4428d-9f80-49cc-a110-dd2469999445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:28.037612 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e4428d-9f80-49cc-a110-dd2469999445 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:28.038554 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e4428d-9f80-49cc-a110-dd2469999445 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:28.039189 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e4428d-9f80-49cc-a110-dd2469999445 None admin] PATH_INFO: `/v3/domains` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:28.040146 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e4428d-9f80-49cc-a110-dd2469999445 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:28.040849 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e4428d-9f80-49cc-a110-dd2469999445 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:28.043189 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e4428d-9f80-49cc-a110-dd2469999445 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:28.064911 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 403/814] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 20 22:11:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:28.064911 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e4428d-9f80-49cc-a110-dd2469999445 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:28.096994 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:28.133704 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cca309b-1658-412b-9985-94957ec2d005 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:28.135257 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:28.172244 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e4428d-9f80-49cc-a110-dd2469999445 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:28.181522 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabe35df-6c9a-43b0-ad3f-143955dbbed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:28.182150 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabe35df-6c9a-43b0-ad3f-143955dbbed3 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:28.182898 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabe35df-6c9a-43b0-ad3f-143955dbbed3 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:28.183178 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabe35df-6c9a-43b0-ad3f-143955dbbed3 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:28.183755 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabe35df-6c9a-43b0-ad3f-143955dbbed3 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:28.185802 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabe35df-6c9a-43b0-ad3f-143955dbbed3 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:28.198201 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-aabe35df-6c9a-43b0-ad3f-143955dbbed3 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 20 22:11:28.198201 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:28.198201 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 20 22:11:28.198201 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 20 22:11:28.198201 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 20 22:11:28.198201 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 20 22:11:28.198201 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 20 22:11:28.198201 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 20 22:11:28.198201 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 20 22:11:28.198201 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:11:28.198201 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 20 22:11:28.198201 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:11:28.198201 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:28.198201 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:28.198201 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:28.198201 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:28.198201 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:28.199239 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:28.199239 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:28.199239 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:28.199239 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:28.199239 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:28.199239 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:28.199239 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 20 22:11:28.199239 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 20 22:11:28.199239 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 20 22:11:28.199239 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 20 22:11:28.199239 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:28.199239 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:28.199239 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:28.199239 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:28.199239 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:28.199239 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:28.200107 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:28.200107 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:28.200107 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:28.200107 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:28.200107 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:28.200107 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:28.200107 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:28.200107 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:28.200107 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:28.200107 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:28.200107 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 20 22:11:28.200107 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 20 22:11:28.200107 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 20 22:11:28.200107 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:11:28.200107 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 412/815] 10.222.0.33 () {56 vars in 1129 bytes} [Tue Sep 20 22:11:28 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:28.201002 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabe35df-6c9a-43b0-ad3f-143955dbbed3 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:28.212760 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3fb866-39e1-44ba-aac0-bf416e9dc8f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:28.213232 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3fb866-39e1-44ba-aac0-bf416e9dc8f8 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:28.213510 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3fb866-39e1-44ba-aac0-bf416e9dc8f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:28.213887 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3fb866-39e1-44ba-aac0-bf416e9dc8f8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:28.221014 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3fb866-39e1-44ba-aac0-bf416e9dc8f8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:28.222447 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3fb866-39e1-44ba-aac0-bf416e9dc8f8 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:28.234743 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-5c3fb866-39e1-44ba-aac0-bf416e9dc8f8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 20 22:11:28.234743 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:28.234743 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:28.234743 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:28.234743 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:28.234743 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:28.234743 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:28.234743 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:28.234743 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:28.234743 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:28.234743 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:28.234743 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:28.234743 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 20 22:11:28.234743 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 20 22:11:28.234743 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 20 22:11:28.234743 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 20 22:11:28.235655 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:28.235655 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:28.235655 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 20 22:11:28.235655 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 22:11:28.235655 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 20 22:11:28.235655 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 22:11:28.235655 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:28.235655 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:28.235655 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:28.235655 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:28.235655 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:28.235655 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:28.235655 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:28.235655 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:28.235655 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:28.235655 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:28.235655 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:28.235655 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:28.236617 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:28.236617 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:28.236617 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 20 22:11:28.236617 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 20 22:11:28.236617 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 20 22:11:28.236617 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 20 22:11:28.236617 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 20 22:11:28.236617 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 20 22:11:28.236617 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 20 22:11:28.236617 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:11:28.236617 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 404/816] 10.222.0.33 () {56 vars in 1117 bytes} [Tue Sep 20 22:11:28 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:28.236617 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3fb866-39e1-44ba-aac0-bf416e9dc8f8 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:28.315245 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabe35df-6c9a-43b0-ad3f-143955dbbed3 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:28.333917 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:28.346886 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3fb866-39e1-44ba-aac0-bf416e9dc8f8 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:28.350609 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f6d0f7-70ea-4526-9adf-eb3906e5c3d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:28.351234 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f6d0f7-70ea-4526-9adf-eb3906e5c3d5 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:28.351512 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f6d0f7-70ea-4526-9adf-eb3906e5c3d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:28.351784 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f6d0f7-70ea-4526-9adf-eb3906e5c3d5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:28.358633 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f6d0f7-70ea-4526-9adf-eb3906e5c3d5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:28.360067 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f6d0f7-70ea-4526-9adf-eb3906e5c3d5 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:28.371172 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-94f6d0f7-70ea-4526-9adf-eb3906e5c3d5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 22:11:28.371172 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:28.371172 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:28.371172 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:28.371172 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:28.371172 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:28.371172 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:28.371172 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:28.371172 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:28.371172 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:28.371172 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:28.371172 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:28.371172 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 20 22:11:28.371172 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 20 22:11:28.371172 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 20 22:11:28.372022 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 20 22:11:28.372022 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:28.372022 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:28.372022 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:28.372022 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:28.372022 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:28.372022 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:28.372022 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:28.372022 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:28.372022 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:28.372022 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:28.372022 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:28.372022 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:28.372022 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:28.372022 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:28.372022 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:28.372022 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:28.372921 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 20 22:11:28.372921 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 20 22:11:28.372921 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 20 22:11:28.372921 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 20 22:11:28.372921 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 20 22:11:28.372921 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 20 22:11:28.372921 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 22:11:28.372921 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:11:28.372921 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 413/817] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Sep 20 22:11:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:28.373400 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f6d0f7-70ea-4526-9adf-eb3906e5c3d5 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:28.387171 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5b832b-a2e4-45ab-bd75-77bb61f90086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:28.387812 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5b832b-a2e4-45ab-bd75-77bb61f90086 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:28.388085 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5b832b-a2e4-45ab-bd75-77bb61f90086 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:28.388356 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5b832b-a2e4-45ab-bd75-77bb61f90086 None admin] PATH_INFO: `/v3/services/network` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:28.388941 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5b832b-a2e4-45ab-bd75-77bb61f90086 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:28.390305 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5b832b-a2e4-45ab-bd75-77bb61f90086 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:28.399653 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-7d5b832b-a2e4-45ab-bd75-77bb61f90086 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 20 22:11:28.399653 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:28.399653 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 20 22:11:28.399653 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 20 22:11:28.399653 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 20 22:11:28.399653 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 20 22:11:28.399653 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 20 22:11:28.399653 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 20 22:11:28.399653 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 20 22:11:28.399653 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:11:28.399653 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 20 22:11:28.399653 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:11:28.399653 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:28.399653 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:28.399653 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:28.399653 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:28.399653 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:28.400715 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:28.400715 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:28.400715 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:28.400715 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:28.400715 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:28.400715 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:28.400715 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 20 22:11:28.400715 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 20 22:11:28.400715 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 20 22:11:28.400715 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 20 22:11:28.400715 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:28.400715 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:28.400715 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:28.400715 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:28.400715 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:28.400715 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:28.401549 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:28.401549 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:28.401549 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:28.401549 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:28.401549 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:28.401549 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:28.401549 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:28.401549 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:28.401549 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:28.401549 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:28.401549 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 20 22:11:28.401549 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 20 22:11:28.401549 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 20 22:11:28.401549 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:11:28.401549 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 405/818] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Sep 20 22:11:28 2022] GET /identity/v3/services/network => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:28.402325 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5b832b-a2e4-45ab-bd75-77bb61f90086 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:28.409575 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:28.490084 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f6d0f7-70ea-4526-9adf-eb3906e5c3d5 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:28.507262 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5b832b-a2e4-45ab-bd75-77bb61f90086 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:28.524885 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a71c679-0d9f-4152-85f3-3d72c1de355a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:28.525490 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a71c679-0d9f-4152-85f3-3d72c1de355a None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:28.525766 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a71c679-0d9f-4152-85f3-3d72c1de355a None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:28.526037 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a71c679-0d9f-4152-85f3-3d72c1de355a None admin] PATH_INFO: `/v3/services` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:28.526698 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a71c679-0d9f-4152-85f3-3d72c1de355a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:28.527006 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a71c679-0d9f-4152-85f3-3d72c1de355a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:28.528350 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a71c679-0d9f-4152-85f3-3d72c1de355a None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:28.532670 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 414/819] 10.222.0.33 () {56 vars in 1124 bytes} [Tue Sep 20 22:11:28 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:28.533450 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a71c679-0d9f-4152-85f3-3d72c1de355a None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:28.550804 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a8fd9a-8587-480f-b621-ae55690e684d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:28.551491 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a8fd9a-8587-480f-b621-ae55690e684d None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:28.551827 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a8fd9a-8587-480f-b621-ae55690e684d None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:28.552099 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a8fd9a-8587-480f-b621-ae55690e684d None admin] PATH_INFO: `/v3/users` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:28.552816 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a8fd9a-8587-480f-b621-ae55690e684d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:28.553238 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a8fd9a-8587-480f-b621-ae55690e684d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:28.555045 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a8fd9a-8587-480f-b621-ae55690e684d None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:28.572697 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 406/820] 10.222.0.33 () {56 vars in 1149 bytes} [Tue Sep 20 22:11:28 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:28.573508 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a8fd9a-8587-480f-b621-ae55690e684d None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:28.589616 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:28.631716 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:28.641721 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a71c679-0d9f-4152-85f3-3d72c1de355a None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:28.677658 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b88c4d-2e57-41e4-9c28-0b672749756a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:28.678178 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b88c4d-2e57-41e4-9c28-0b672749756a None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:28.678453 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b88c4d-2e57-41e4-9c28-0b672749756a None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:28.678772 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b88c4d-2e57-41e4-9c28-0b672749756a None admin] PATH_INFO: `/v3/projects` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:28.679727 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b88c4d-2e57-41e4-9c28-0b672749756a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:28.680030 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b88c4d-2e57-41e4-9c28-0b672749756a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:28.681442 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b88c4d-2e57-41e4-9c28-0b672749756a None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:28.698979 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 415/821] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Sep 20 22:11:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:28.698979 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b88c4d-2e57-41e4-9c28-0b672749756a None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:28.699252 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a8fd9a-8587-480f-b621-ae55690e684d None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:28.731625 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ed9b05-1d7f-4f38-95d2-7d2a126bc23f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:28.732230 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed9b05-1d7f-4f38-95d2-7d2a126bc23f None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:28.732508 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed9b05-1d7f-4f38-95d2-7d2a126bc23f None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:28.732778 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed9b05-1d7f-4f38-95d2-7d2a126bc23f None admin] PATH_INFO: `/v3/services` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:28.733403 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ed9b05-1d7f-4f38-95d2-7d2a126bc23f None admin] RBAC: Adding query filter params (name=network) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:28.733703 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ed9b05-1d7f-4f38-95d2-7d2a126bc23f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:28.735109 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ed9b05-1d7f-4f38-95d2-7d2a126bc23f None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:28.739986 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 407/822] 10.222.0.33 () {56 vars in 1112 bytes} [Tue Sep 20 22:11:28 2022] GET /identity/v3/services?name=network => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:28.743389 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ed9b05-1d7f-4f38-95d2-7d2a126bc23f None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:28.807779 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b88c4d-2e57-41e4-9c28-0b672749756a None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:28.838925 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:28.845450 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a434d9-6ef1-4423-9d8f-eb4bccf85ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:28.846048 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a434d9-6ef1-4423-9d8f-eb4bccf85ea3 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:28.846363 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a434d9-6ef1-4423-9d8f-eb4bccf85ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:28.846611 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a434d9-6ef1-4423-9d8f-eb4bccf85ea3 None admin] PATH_INFO: `/v3/services` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:28.847233 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a434d9-6ef1-4423-9d8f-eb4bccf85ea3 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:28.847525 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a434d9-6ef1-4423-9d8f-eb4bccf85ea3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:28.848925 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a434d9-6ef1-4423-9d8f-eb4bccf85ea3 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:28.854212 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 416/823] 10.222.0.33 () {56 vars in 1124 bytes} [Tue Sep 20 22:11:28 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:28.855520 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a434d9-6ef1-4423-9d8f-eb4bccf85ea3 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:28.865517 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ed9b05-1d7f-4f38-95d2-7d2a126bc23f None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:28.873458 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:28.905284 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbec9004-65c1-4508-83b6-bdfadcf439e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:28.905916 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbec9004-65c1-4508-83b6-bdfadcf439e0 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:28.906200 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbec9004-65c1-4508-83b6-bdfadcf439e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:28.906471 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbec9004-65c1-4508-83b6-bdfadcf439e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:28.917576 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbec9004-65c1-4508-83b6-bdfadcf439e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:28.919068 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbec9004-65c1-4508-83b6-bdfadcf439e0 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:28.934126 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-dbec9004-65c1-4508-83b6-bdfadcf439e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:11:28.934126 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:28.934126 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:28.934126 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:28.934126 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:28.934126 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:28.934126 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:28.934126 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:28.934126 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:28.934126 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:28.934126 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:28.934126 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:28.934126 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 22:11:28.934126 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 22:11:28.934126 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 22:11:28.934126 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 22:11:28.935126 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:28.935126 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:28.935126 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:28.935126 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:28.935126 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:28.935126 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:28.935126 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:28.935126 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:28.935126 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:28.935126 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:28.935126 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:28.935126 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:28.935126 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:28.935126 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:28.935126 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:28.935126 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:28.935126 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 22:11:28.936026 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 22:11:28.936026 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:11:28.936026 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:11:28.936026 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 408/824] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 20 22:11:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:28.936026 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbec9004-65c1-4508-83b6-bdfadcf439e0 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:28.970953 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a434d9-6ef1-4423-9d8f-eb4bccf85ea3 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:29.007911 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cc2872-842b-4f02-a1cb-889f02730756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:29.008436 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cc2872-842b-4f02-a1cb-889f02730756 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:29.008731 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cc2872-842b-4f02-a1cb-889f02730756 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:29.008984 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cc2872-842b-4f02-a1cb-889f02730756 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:29.009704 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cc2872-842b-4f02-a1cb-889f02730756 None admin] RBAC: Adding query filter params (role.id=8a829170b29d42d6af589399e51edb0f, scope.project.id=3ce415d02aa9489bae19cd514805fd8c, user.id=db7eed561e99452289a662ad326cf919) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:29.010007 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cc2872-842b-4f02-a1cb-889f02730756 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:29.011442 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cc2872-842b-4f02-a1cb-889f02730756 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:29.017272 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 417/825] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Sep 20 22:11:28 2022] GET /identity/v3/role_assignments?user.id=db7eed561e99452289a662ad326cf919&scope.project.id=3ce415d02aa9489bae19cd514805fd8c&role.id=8a829170b29d42d6af589399e51edb0f => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:29.018033 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cc2872-842b-4f02-a1cb-889f02730756 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:29.078453 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbec9004-65c1-4508-83b6-bdfadcf439e0 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:29.108451 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:29.118466 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27181286-b950-4b38-b42e-6f82c700150a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:29.119111 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27181286-b950-4b38-b42e-6f82c700150a None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:29.119385 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27181286-b950-4b38-b42e-6f82c700150a None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:29.119654 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27181286-b950-4b38-b42e-6f82c700150a None admin] PATH_INFO: `/v3/services` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:29.120286 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27181286-b950-4b38-b42e-6f82c700150a None admin] RBAC: Adding query filter params (type=network) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:29.120594 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27181286-b950-4b38-b42e-6f82c700150a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:29.121987 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27181286-b950-4b38-b42e-6f82c700150a None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:29.125614 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:29.132025 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 409/826] 10.222.0.33 () {56 vars in 1112 bytes} [Tue Sep 20 22:11:28 2022] GET /identity/v3/services?type=network => generated 350 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:29.132025 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27181286-b950-4b38-b42e-6f82c700150a None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:29.154886 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cc2872-842b-4f02-a1cb-889f02730756 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:29.196493 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c3f9d8-4784-4228-8486-4770d777f575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:29.197109 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c3f9d8-4784-4228-8486-4770d777f575 None admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:29.197388 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c3f9d8-4784-4228-8486-4770d777f575 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:29.197658 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c3f9d8-4784-4228-8486-4770d777f575 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:29.198336 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c3f9d8-4784-4228-8486-4770d777f575 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:29.199757 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c3f9d8-4784-4228-8486-4770d777f575 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:29.226042 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 418/827] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 20 22:11:29 2022] POST /identity/v3/endpoints => generated 346 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:11:29.227186 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a6423f-a668-41d5-a188-40af6d4acf0f None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:29.227476 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a6423f-a668-41d5-a188-40af6d4acf0f None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:29.228070 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a6423f-a668-41d5-a188-40af6d4acf0f None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:29.229137 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 419/828] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:11:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:11:29.229667 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a6423f-a668-41d5-a188-40af6d4acf0f None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:29.248763 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27181286-b950-4b38-b42e-6f82c700150a None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:29.320774 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b78806-00ec-48b8-9d80-ee068231940f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:29.322589 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b78806-00ec-48b8-9d80-ee068231940f None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:29.323283 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b78806-00ec-48b8-9d80-ee068231940f None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:29.323842 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b78806-00ec-48b8-9d80-ee068231940f None admin] PATH_INFO: `/v3/domains` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:29.325107 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b78806-00ec-48b8-9d80-ee068231940f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:29.326180 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b78806-00ec-48b8-9d80-ee068231940f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:29.328288 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b78806-00ec-48b8-9d80-ee068231940f None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:29.346978 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 410/829] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 20 22:11:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:29.350098 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0540497b-fe79-4d66-866a-39245af63ce5 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:29.350881 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0540497b-fe79-4d66-866a-39245af63ce5 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:29.351377 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0540497b-fe79-4d66-866a-39245af63ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:29.372514 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a6423f-a668-41d5-a188-40af6d4acf0f None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:29.377801 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-0540497b-fe79-4d66-866a-39245af63ce5 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:11:29.379474 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-0540497b-fe79-4d66-866a-39245af63ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:11:29.421039 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d6c235-74bc-4672-8c06-f788dcf4fe07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:29.421650 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d6c235-74bc-4672-8c06-f788dcf4fe07 None admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:29.422093 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d6c235-74bc-4672-8c06-f788dcf4fe07 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:29.422371 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d6c235-74bc-4672-8c06-f788dcf4fe07 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:29.423399 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d6c235-74bc-4672-8c06-f788dcf4fe07 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:29.425056 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d6c235-74bc-4672-8c06-f788dcf4fe07 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:29.431417 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:29.440693 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:29.454834 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 420/830] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 20 22:11:29 2022] POST /identity/v3/endpoints => generated 337 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:11:29.456054 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d6c235-74bc-4672-8c06-f788dcf4fe07 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:29.485409 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 411/831] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:11:29 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 20 22:11:29.581552 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d6c235-74bc-4672-8c06-f788dcf4fe07 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:29.618349 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4922923f-cacb-4da5-b8e9-1efdffe15371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:29.619027 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4922923f-cacb-4da5-b8e9-1efdffe15371 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:29.619307 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4922923f-cacb-4da5-b8e9-1efdffe15371 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:29.619579 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4922923f-cacb-4da5-b8e9-1efdffe15371 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:29.626989 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4922923f-cacb-4da5-b8e9-1efdffe15371 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:29.628449 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4922923f-cacb-4da5-b8e9-1efdffe15371 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:29.641268 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-4922923f-cacb-4da5-b8e9-1efdffe15371 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 22:11:29.641268 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:29.641268 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:29.641268 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:29.641268 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:29.641268 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:29.641268 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:29.641268 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:29.641268 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:29.641268 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:29.641268 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:29.641268 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:29.641268 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 20 22:11:29.641268 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 20 22:11:29.641268 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 20 22:11:29.642667 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 20 22:11:29.642667 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:29.642667 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:29.642667 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:29.642667 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:29.642667 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:29.642667 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:29.642667 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:29.642667 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:29.642667 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:29.642667 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:29.642667 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:29.642667 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:29.642667 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:29.642667 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:29.642667 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:29.642667 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:29.643582 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 20 22:11:29.643582 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 20 22:11:29.643582 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 20 22:11:29.643582 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 20 22:11:29.643582 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 20 22:11:29.643582 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 20 22:11:29.643582 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 22:11:29.643582 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:11:29.643582 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 421/832] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Sep 20 22:11:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:29.648940 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0540497b-fe79-4d66-866a-39245af63ce5 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:29.779544 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0540497b-fe79-4d66-866a-39245af63ce5 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:29.802324 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4922923f-cacb-4da5-b8e9-1efdffe15371 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:29.820828 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bc8beb-c062-4144-b8fc-480fd847014a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:29.821928 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc8beb-c062-4144-b8fc-480fd847014a None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:29.822214 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc8beb-c062-4144-b8fc-480fd847014a None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:29.822489 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc8beb-c062-4144-b8fc-480fd847014a None admin] PATH_INFO: `/v3/projects` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:29.823228 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bc8beb-c062-4144-b8fc-480fd847014a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:29.823970 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bc8beb-c062-4144-b8fc-480fd847014a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:29.825584 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bc8beb-c062-4144-b8fc-480fd847014a None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:29.842490 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 412/833] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Sep 20 22:11:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:29.850822 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bc8beb-c062-4144-b8fc-480fd847014a None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:29.881449 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:29.897057 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:29.954999 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4922923f-cacb-4da5-b8e9-1efdffe15371 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:29.988822 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bc8beb-c062-4144-b8fc-480fd847014a None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:30.004309 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f58e61d-3eef-4fb8-a8c0-3f7403a42b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:30.005039 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f58e61d-3eef-4fb8-a8c0-3f7403a42b2e None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:30.005317 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f58e61d-3eef-4fb8-a8c0-3f7403a42b2e None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:30.005919 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f58e61d-3eef-4fb8-a8c0-3f7403a42b2e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:30.022823 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f58e61d-3eef-4fb8-a8c0-3f7403a42b2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 22:11:30.029044 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-0f58e61d-3eef-4fb8-a8c0-3f7403a42b2e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 22:11:30.029044 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:30.029044 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:30.029044 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:30.029044 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:30.029044 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:30.029044 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:30.029044 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:30.029044 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:30.029044 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:30.029044 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:30.029044 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:30.029044 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 22:11:30.029044 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 22:11:30.029044 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 22:11:30.029044 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 22:11:30.030041 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 22:11:30.030041 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 22:11:30.030041 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 22:11:30.030041 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 22:11:30.030041 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:30.030041 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:30.030041 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:30.030041 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:30.030041 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:30.030041 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:30.030041 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:30.030041 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:30.030041 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:30.030041 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:30.030041 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:30.030041 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:30.031209 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:30.031209 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:30.031209 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:30.031209 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:30.031209 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 22:11:30.031209 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 22:11:30.031209 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 22:11:30.031209 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 22:11:30.031209 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 22:11:30.031209 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 22:11:30.031209 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 22:11:30.031209 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:11:30.034253 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 422/834] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Sep 20 22:11:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 20 22:11:30.041621 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98648b0-daa2-4c5e-a2ea-283b9edd3a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:30.042289 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98648b0-daa2-4c5e-a2ea-283b9edd3a47 None admin] REQUEST_METHOD: `PUT` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:30.042596 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98648b0-daa2-4c5e-a2ea-283b9edd3a47 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:30.042858 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f58e61d-3eef-4fb8-a8c0-3f7403a42b2e None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:30.042980 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98648b0-daa2-4c5e-a2ea-283b9edd3a47 None admin] PATH_INFO: `/v3/projects/3ce415d02aa9489bae19cd514805fd8c/users/e916748fdee84c34af034e75a919b986/roles/6d6dcbd3bc16491db00308c3b7d27a63` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:30.058743 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98648b0-daa2-4c5e-a2ea-283b9edd3a47 None admin] RBAC: Authorizing `identity:create_grant(project_id=3ce415d02aa9489bae19cd514805fd8c, user_id=e916748fdee84c34af034e75a919b986, role_id=6d6dcbd3bc16491db00308c3b7d27a63)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:30.060232 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98648b0-daa2-4c5e-a2ea-283b9edd3a47 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:30.076175 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 413/835] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Sep 20 22:11:29 2022] PUT /identity/v3/projects/3ce415d02aa9489bae19cd514805fd8c/users/e916748fdee84c34af034e75a919b986/roles/6d6dcbd3bc16491db00308c3b7d27a63 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 22:11:30.167532 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f58e61d-3eef-4fb8-a8c0-3f7403a42b2e None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:30.180184 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:30.211520 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71882b9-01a6-47fb-b1c8-4fae2e19f846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:30.212449 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71882b9-01a6-47fb-b1c8-4fae2e19f846 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:30.212905 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71882b9-01a6-47fb-b1c8-4fae2e19f846 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:30.213345 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71882b9-01a6-47fb-b1c8-4fae2e19f846 None admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:30.214221 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71882b9-01a6-47fb-b1c8-4fae2e19f846 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:30.214723 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71882b9-01a6-47fb-b1c8-4fae2e19f846 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:30.216294 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71882b9-01a6-47fb-b1c8-4fae2e19f846 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:30.230734 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 423/836] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 20 22:11:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 22:11:30.232953 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98648b0-daa2-4c5e-a2ea-283b9edd3a47 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:30.336706 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:30.358592 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98648b0-daa2-4c5e-a2ea-283b9edd3a47 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:30.394311 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c46546-2327-4b2b-b72b-8a48cb6ce64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:30.396858 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c46546-2327-4b2b-b72b-8a48cb6ce64a None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:30.396858 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c46546-2327-4b2b-b72b-8a48cb6ce64a None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:30.397058 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c46546-2327-4b2b-b72b-8a48cb6ce64a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:30.407711 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c46546-2327-4b2b-b72b-8a48cb6ce64a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:30.409164 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c46546-2327-4b2b-b72b-8a48cb6ce64a None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:30.424108 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-87c46546-2327-4b2b-b72b-8a48cb6ce64a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:11:30.424108 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:30.424108 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:30.424108 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:30.424108 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:30.424108 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:30.424108 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:30.424108 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:30.424108 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:30.424108 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:30.424108 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:30.424108 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:30.424108 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 22:11:30.424108 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 22:11:30.424108 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 22:11:30.424108 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 22:11:30.425062 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:30.425062 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:30.425062 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:30.425062 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:30.425062 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:30.425062 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:30.425062 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:30.425062 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:30.425062 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:30.425062 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:30.425062 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:30.425062 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:30.425062 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:30.425062 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:30.425062 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:30.425062 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:30.425062 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 22:11:30.425942 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 22:11:30.425942 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:11:30.425942 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:11:30.425942 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 414/837] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 20 22:11:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:30.431259 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71882b9-01a6-47fb-b1c8-4fae2e19f846 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:30.535646 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71882b9-01a6-47fb-b1c8-4fae2e19f846 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:30.575374 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af8f11e-fb6a-4146-a83e-d74ba4dc0224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:30.575982 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af8f11e-fb6a-4146-a83e-d74ba4dc0224 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:30.576257 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af8f11e-fb6a-4146-a83e-d74ba4dc0224 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:30.576523 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af8f11e-fb6a-4146-a83e-d74ba4dc0224 None admin] PATH_INFO: `/v3/domains` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:30.577160 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af8f11e-fb6a-4146-a83e-d74ba4dc0224 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:30.577457 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af8f11e-fb6a-4146-a83e-d74ba4dc0224 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:30.578827 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af8f11e-fb6a-4146-a83e-d74ba4dc0224 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:30.591286 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 424/838] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 20 22:11:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:30.596449 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c46546-2327-4b2b-b72b-8a48cb6ce64a None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:30.704945 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c46546-2327-4b2b-b72b-8a48cb6ce64a None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:30.738686 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883ae5d3-c8a4-456c-b006-99f9a8cc2914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:30.739854 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883ae5d3-c8a4-456c-b006-99f9a8cc2914 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:30.740131 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883ae5d3-c8a4-456c-b006-99f9a8cc2914 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:30.740399 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883ae5d3-c8a4-456c-b006-99f9a8cc2914 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:30.742296 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:30.749055 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883ae5d3-c8a4-456c-b006-99f9a8cc2914 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:30.750565 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883ae5d3-c8a4-456c-b006-99f9a8cc2914 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:30.762685 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-883ae5d3-c8a4-456c-b006-99f9a8cc2914 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 20 22:11:30.762685 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:30.762685 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:30.762685 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:30.762685 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:30.762685 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:30.762685 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:30.762685 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:30.762685 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:30.762685 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:30.762685 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:30.762685 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:30.762685 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 20 22:11:30.762685 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 20 22:11:30.762685 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 20 22:11:30.762685 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 20 22:11:30.763618 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:30.763618 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:30.763618 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 20 22:11:30.763618 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 22:11:30.763618 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 20 22:11:30.763618 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 22:11:30.763618 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:30.763618 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:30.763618 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:30.763618 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:30.763618 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:30.763618 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:30.763618 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:30.763618 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:30.763618 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:30.763618 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:30.763618 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:30.763618 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:30.764561 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:30.764561 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:30.764561 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 20 22:11:30.764561 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 20 22:11:30.764561 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 20 22:11:30.764561 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 20 22:11:30.764561 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 20 22:11:30.764561 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 20 22:11:30.764561 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 20 22:11:30.764561 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:11:30.764561 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 415/839] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Sep 20 22:11:30 2022] GET /identity/v3/users/swift => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:30.769695 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af8f11e-fb6a-4146-a83e-d74ba4dc0224 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:30.809603 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:30.888331 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af8f11e-fb6a-4146-a83e-d74ba4dc0224 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:30.924947 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c06706-ea1f-4696-bfb5-d663b5878e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:30.925552 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c06706-ea1f-4696-bfb5-d663b5878e3e None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:30.925845 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c06706-ea1f-4696-bfb5-d663b5878e3e None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:30.926105 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c06706-ea1f-4696-bfb5-d663b5878e3e None admin] PATH_INFO: `/v3/users` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:30.926890 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c06706-ea1f-4696-bfb5-d663b5878e3e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:30.927187 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c06706-ea1f-4696-bfb5-d663b5878e3e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:30.928664 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c06706-ea1f-4696-bfb5-d663b5878e3e None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:30.948147 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 425/840] 10.222.0.33 () {56 vars in 1135 bytes} [Tue Sep 20 22:11:30 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 22:11:30.953574 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883ae5d3-c8a4-456c-b006-99f9a8cc2914 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:31.056911 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883ae5d3-c8a4-456c-b006-99f9a8cc2914 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:31.094258 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8716dc4b-0dfc-4ab7-b5c0-7302edb96b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:31.094894 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8716dc4b-0dfc-4ab7-b5c0-7302edb96b34 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:31.095171 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8716dc4b-0dfc-4ab7-b5c0-7302edb96b34 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:31.095436 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8716dc4b-0dfc-4ab7-b5c0-7302edb96b34 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:31.157347 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:31.164929 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8716dc4b-0dfc-4ab7-b5c0-7302edb96b34 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:31.166761 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8716dc4b-0dfc-4ab7-b5c0-7302edb96b34 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:31.267652 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 416/841] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 20 22:11:30 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 20 22:11:31.274227 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c06706-ea1f-4696-bfb5-d663b5878e3e None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:31.392164 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:31.405485 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c06706-ea1f-4696-bfb5-d663b5878e3e None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:31.445760 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b74dc8-9715-474f-a58f-f472c679a088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:31.446402 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b74dc8-9715-474f-a58f-f472c679a088 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:31.446709 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b74dc8-9715-474f-a58f-f472c679a088 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:31.446979 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b74dc8-9715-474f-a58f-f472c679a088 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:31.457997 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b74dc8-9715-474f-a58f-f472c679a088 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:31.459480 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b74dc8-9715-474f-a58f-f472c679a088 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:31.474891 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-c8b74dc8-9715-474f-a58f-f472c679a088 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:11:31.474891 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:31.474891 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:31.474891 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:31.474891 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:31.474891 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:31.474891 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:31.474891 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:31.474891 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:31.474891 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:31.474891 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:31.474891 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:31.474891 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 22:11:31.474891 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 22:11:31.474891 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 22:11:31.474891 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 22:11:31.475889 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:31.475889 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:31.475889 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:31.475889 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:31.475889 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:31.475889 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:31.475889 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:31.475889 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:31.475889 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:31.475889 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:31.475889 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:31.475889 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:31.475889 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:31.475889 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:31.475889 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:31.475889 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:31.475889 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 22:11:31.476803 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 22:11:31.476803 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:11:31.476803 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:11:31.476803 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 426/842] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 20 22:11:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 20 22:11:31.481881 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8716dc4b-0dfc-4ab7-b5c0-7302edb96b34 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:31.520370 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1ae6b4-77a8-481d-8a0d-e206d9749a89 None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:31.520703 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1ae6b4-77a8-481d-8a0d-e206d9749a89 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:31.520899 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1ae6b4-77a8-481d-8a0d-e206d9749a89 None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:31.522365 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 427/843] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:11:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 20 22:11:31.527562 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a7fcfb-759c-4690-ba6d-80cc2d0b4953 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:31.527842 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a7fcfb-759c-4690-ba6d-80cc2d0b4953 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:31.528111 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a7fcfb-759c-4690-ba6d-80cc2d0b4953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:31.550704 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-c7a7fcfb-759c-4690-ba6d-80cc2d0b4953 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:11:31.552584 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-c7a7fcfb-759c-4690-ba6d-80cc2d0b4953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:11:31.599481 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:31.606833 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8716dc4b-0dfc-4ab7-b5c0-7302edb96b34 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:31.642877 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 428/844] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:11:31 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 20 22:11:31.645754 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc153ad-88a8-47f5-80fc-9eb4ce30c6f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:31.646368 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc153ad-88a8-47f5-80fc-9eb4ce30c6f6 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:31.646697 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc153ad-88a8-47f5-80fc-9eb4ce30c6f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:31.646973 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc153ad-88a8-47f5-80fc-9eb4ce30c6f6 None admin] PATH_INFO: `/v3/domains` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:31.647619 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc153ad-88a8-47f5-80fc-9eb4ce30c6f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:31.647921 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc153ad-88a8-47f5-80fc-9eb4ce30c6f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:31.649282 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc153ad-88a8-47f5-80fc-9eb4ce30c6f6 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:31.661590 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 417/845] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 20 22:11:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:31.667213 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a7fcfb-759c-4690-ba6d-80cc2d0b4953 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:31.748764 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:31.779572 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a7fcfb-759c-4690-ba6d-80cc2d0b4953 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:31.795868 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193fb0f7-5c8d-4a82-ba3f-4c7c6d133848 None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:31.796345 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193fb0f7-5c8d-4a82-ba3f-4c7c6d133848 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:31.796421 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193fb0f7-5c8d-4a82-ba3f-4c7c6d133848 None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:31.797935 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 418/846] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:11:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:11:31.803969 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481aa0bd-ae21-449e-89a2-c3c3499ff189 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:31.804819 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481aa0bd-ae21-449e-89a2-c3c3499ff189 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:31.805320 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481aa0bd-ae21-449e-89a2-c3c3499ff189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:31.816836 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eeda85-1082-485f-bc1f-4105096d36e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:31.817550 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eeda85-1082-485f-bc1f-4105096d36e5 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:31.817832 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eeda85-1082-485f-bc1f-4105096d36e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:31.818120 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eeda85-1082-485f-bc1f-4105096d36e5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:31.825146 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eeda85-1082-485f-bc1f-4105096d36e5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:31.826090 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-481aa0bd-ae21-449e-89a2-c3c3499ff189 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:11:31.826617 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eeda85-1082-485f-bc1f-4105096d36e5 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:31.827776 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-481aa0bd-ae21-449e-89a2-c3c3499ff189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:11:31.838486 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-14eeda85-1082-485f-bc1f-4105096d36e5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 22:11:31.838486 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:31.838486 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:31.838486 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:31.838486 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:31.838486 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:31.838486 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:31.838486 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:31.838486 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:31.838486 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:31.838486 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:31.838486 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:31.838486 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 20 22:11:31.838486 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 20 22:11:31.838486 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 20 22:11:31.839416 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 20 22:11:31.839416 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:31.839416 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:31.839416 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:31.839416 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:31.839416 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:31.839416 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:31.839416 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:31.839416 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:31.839416 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:31.839416 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:31.839416 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:31.839416 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:31.839416 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:31.839416 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:31.839416 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:31.839416 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:31.840639 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 20 22:11:31.840639 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 20 22:11:31.840639 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 20 22:11:31.840639 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 20 22:11:31.840639 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 20 22:11:31.840639 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 20 22:11:31.840639 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 22:11:31.840639 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:11:31.840639 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 429/847] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Sep 20 22:11:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:31.847860 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eeda85-1082-485f-bc1f-4105096d36e5 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:31.914621 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 419/848] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:11:31 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 20 22:11:31.946933 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481aa0bd-ae21-449e-89a2-c3c3499ff189 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:31.973333 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eeda85-1082-485f-bc1f-4105096d36e5 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:32.006869 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:32.014614 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d084c67b-294d-4661-a7c5-02b9146a0dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:32.015580 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d084c67b-294d-4661-a7c5-02b9146a0dcf None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:32.016071 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d084c67b-294d-4661-a7c5-02b9146a0dcf None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:32.016547 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d084c67b-294d-4661-a7c5-02b9146a0dcf None admin] PATH_INFO: `/v3/projects` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:32.018036 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d084c67b-294d-4661-a7c5-02b9146a0dcf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:32.018742 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d084c67b-294d-4661-a7c5-02b9146a0dcf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:32.021264 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d084c67b-294d-4661-a7c5-02b9146a0dcf None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:32.045494 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 430/849] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Sep 20 22:11:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:32.048022 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d084c67b-294d-4661-a7c5-02b9146a0dcf None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:32.056958 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:32.074268 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481aa0bd-ae21-449e-89a2-c3c3499ff189 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:32.109947 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e01d4a-92f1-4637-a0d9-8fdde9a84628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:32.110627 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e01d4a-92f1-4637-a0d9-8fdde9a84628 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:32.110909 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e01d4a-92f1-4637-a0d9-8fdde9a84628 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:32.111186 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e01d4a-92f1-4637-a0d9-8fdde9a84628 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:32.112098 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e01d4a-92f1-4637-a0d9-8fdde9a84628 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:32.113125 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e01d4a-92f1-4637-a0d9-8fdde9a84628 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:32.122402 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-a4e01d4a-92f1-4637-a0d9-8fdde9a84628 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 20 22:11:32.122402 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:32.122402 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 20 22:11:32.122402 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 20 22:11:32.122402 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 20 22:11:32.122402 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 20 22:11:32.122402 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 20 22:11:32.122402 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 20 22:11:32.122402 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 20 22:11:32.122402 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:11:32.122402 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 20 22:11:32.122402 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:11:32.122402 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:32.122402 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:32.122402 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:32.122402 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:32.123384 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:32.123384 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:32.123384 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:32.123384 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:32.123384 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:32.123384 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:32.123384 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:32.123384 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 20 22:11:32.123384 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 20 22:11:32.123384 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 20 22:11:32.123384 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 20 22:11:32.123384 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:32.123384 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:32.123384 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:32.123384 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:32.123384 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:32.123384 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:32.124263 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:32.124263 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:32.124263 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:32.124263 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:32.124263 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:32.124263 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:32.124263 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:32.124263 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:32.124263 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:32.124263 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:32.124263 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 20 22:11:32.124263 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 20 22:11:32.124263 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 20 22:11:32.124263 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:11:32.128372 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 420/850] 10.222.0.33 () {56 vars in 1132 bytes} [Tue Sep 20 22:11:31 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:32.129204 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e01d4a-92f1-4637-a0d9-8fdde9a84628 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:32.185943 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d084c67b-294d-4661-a7c5-02b9146a0dcf None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:32.224242 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1eb3a1-8ffe-4157-89ad-425aeba92eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:32.224841 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1eb3a1-8ffe-4157-89ad-425aeba92eac None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:32.225117 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1eb3a1-8ffe-4157-89ad-425aeba92eac None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:32.225381 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1eb3a1-8ffe-4157-89ad-425aeba92eac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:32.226213 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1eb3a1-8ffe-4157-89ad-425aeba92eac None admin] RBAC: Adding query filter params (role.id=8a829170b29d42d6af589399e51edb0f, scope.project.id=3ce415d02aa9489bae19cd514805fd8c, user.id=257983500d7b430c8f0377b2aa743ae0) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:32.226533 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1eb3a1-8ffe-4157-89ad-425aeba92eac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:32.228067 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1eb3a1-8ffe-4157-89ad-425aeba92eac None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:32.232447 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e01d4a-92f1-4637-a0d9-8fdde9a84628 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:32.242696 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 431/851] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Sep 20 22:11:32 2022] GET /identity/v3/role_assignments?user.id=257983500d7b430c8f0377b2aa743ae0&scope.project.id=3ce415d02aa9489bae19cd514805fd8c&role.id=8a829170b29d42d6af589399e51edb0f => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:32.242696 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1eb3a1-8ffe-4157-89ad-425aeba92eac None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:32.283686 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7326d85-78e7-409e-88c8-5310c165db7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:32.285493 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7326d85-78e7-409e-88c8-5310c165db7f None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:32.285775 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7326d85-78e7-409e-88c8-5310c165db7f None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:32.286732 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7326d85-78e7-409e-88c8-5310c165db7f None admin] PATH_INFO: `/v3/services` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:32.287426 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7326d85-78e7-409e-88c8-5310c165db7f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:32.287732 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7326d85-78e7-409e-88c8-5310c165db7f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:32.289287 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7326d85-78e7-409e-88c8-5310c165db7f None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:32.296348 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 421/852] 10.222.0.33 () {56 vars in 1126 bytes} [Tue Sep 20 22:11:32 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:32.302881 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7326d85-78e7-409e-88c8-5310c165db7f None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:32.319920 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:32.326916 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:32.389381 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1eb3a1-8ffe-4157-89ad-425aeba92eac None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:32.432009 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7229204a-f597-4f16-8908-2e01f59a56d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:32.433000 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7229204a-f597-4f16-8908-2e01f59a56d2 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:32.433113 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7326d85-78e7-409e-88c8-5310c165db7f None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:32.433204 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7229204a-f597-4f16-8908-2e01f59a56d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:32.433204 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7229204a-f597-4f16-8908-2e01f59a56d2 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:32.433508 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7229204a-f597-4f16-8908-2e01f59a56d2 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:32.436284 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7229204a-f597-4f16-8908-2e01f59a56d2 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:32.445648 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-7229204a-f597-4f16-8908-2e01f59a56d2 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 20 22:11:32.445648 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:32.445648 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 20 22:11:32.445648 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 20 22:11:32.445648 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 20 22:11:32.445648 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 20 22:11:32.445648 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 20 22:11:32.445648 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 20 22:11:32.445648 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 20 22:11:32.445648 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:11:32.445648 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 20 22:11:32.445648 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:11:32.445648 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:32.445648 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:32.445648 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:32.445648 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:32.445648 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:32.446847 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:32.446847 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:32.446847 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:32.446847 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:32.446847 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:32.446847 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:32.446847 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 20 22:11:32.446847 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 20 22:11:32.446847 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 20 22:11:32.446847 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 20 22:11:32.446847 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:32.446847 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:32.446847 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:32.446847 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:32.446847 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:32.446847 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:32.447757 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:32.447757 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:32.447757 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:32.447757 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:32.447757 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:32.447757 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:32.447757 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:32.447757 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:32.447757 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:32.447757 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:32.447757 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 20 22:11:32.447757 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 20 22:11:32.447757 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 20 22:11:32.447757 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:11:32.449798 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 432/853] 10.222.0.33 () {56 vars in 1114 bytes} [Tue Sep 20 22:11:32 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:32.451290 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7148c705-3f06-441b-beec-2607115d280f None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:32.451698 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7148c705-3f06-441b-beec-2607115d280f None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:32.452107 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7148c705-3f06-441b-beec-2607115d280f None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:32.453452 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 433/854] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:11:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:11:32.455582 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7148c705-3f06-441b-beec-2607115d280f None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:32.477529 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eb6ff5-3074-4415-97ee-59b67cc7eba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:32.478146 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eb6ff5-3074-4415-97ee-59b67cc7eba9 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:32.478424 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eb6ff5-3074-4415-97ee-59b67cc7eba9 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:32.478756 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eb6ff5-3074-4415-97ee-59b67cc7eba9 None admin] PATH_INFO: `/v3/services` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:32.479396 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eb6ff5-3074-4415-97ee-59b67cc7eba9 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:32.479698 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eb6ff5-3074-4415-97ee-59b67cc7eba9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:32.481071 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eb6ff5-3074-4415-97ee-59b67cc7eba9 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:32.488952 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 422/855] 10.222.0.33 () {56 vars in 1126 bytes} [Tue Sep 20 22:11:32 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:32.490902 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf18c9b-e966-455b-ae3e-478d54491883 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:32.491758 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf18c9b-e966-455b-ae3e-478d54491883 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:32.492304 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf18c9b-e966-455b-ae3e-478d54491883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:32.516963 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-baf18c9b-e966-455b-ae3e-478d54491883 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:11:32.518373 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-baf18c9b-e966-455b-ae3e-478d54491883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:11:32.584322 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7148c705-3f06-441b-beec-2607115d280f None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:32.606895 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:32.614533 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 423/856] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:11:32 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 20 22:11:32.629631 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a514dc4e-b48b-43dc-b23b-67af9a38412d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:32.630863 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a514dc4e-b48b-43dc-b23b-67af9a38412d None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:32.631198 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a514dc4e-b48b-43dc-b23b-67af9a38412d None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:32.631477 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a514dc4e-b48b-43dc-b23b-67af9a38412d None admin] PATH_INFO: `/v3/services` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:32.632131 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a514dc4e-b48b-43dc-b23b-67af9a38412d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:32.632493 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a514dc4e-b48b-43dc-b23b-67af9a38412d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:32.634006 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a514dc4e-b48b-43dc-b23b-67af9a38412d None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:32.639896 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 434/857] 10.222.0.33 () {56 vars in 1114 bytes} [Tue Sep 20 22:11:32 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:32.645326 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf18c9b-e966-455b-ae3e-478d54491883 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:32.666921 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:32.757787 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf18c9b-e966-455b-ae3e-478d54491883 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:32.794852 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4c4d88-49fa-4cc8-87ec-300004de1bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:32.795527 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4c4d88-49fa-4cc8-87ec-300004de1bf4 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:32.795816 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4c4d88-49fa-4cc8-87ec-300004de1bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:32.796093 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4c4d88-49fa-4cc8-87ec-300004de1bf4 None admin] PATH_INFO: `/v3/services` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:32.796730 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4c4d88-49fa-4cc8-87ec-300004de1bf4 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:32.797037 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4c4d88-49fa-4cc8-87ec-300004de1bf4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:32.798484 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4c4d88-49fa-4cc8-87ec-300004de1bf4 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:32.804050 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 424/858] 10.222.0.33 () {56 vars in 1114 bytes} [Tue Sep 20 22:11:32 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:32.897690 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a514dc4e-b48b-43dc-b23b-67af9a38412d None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:33.009167 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a514dc4e-b48b-43dc-b23b-67af9a38412d None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:33.044510 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c009448-ea6b-44ef-b8bc-57e15f333881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:33.045154 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c009448-ea6b-44ef-b8bc-57e15f333881 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:33.045438 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c009448-ea6b-44ef-b8bc-57e15f333881 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:33.045709 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c009448-ea6b-44ef-b8bc-57e15f333881 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:33.057938 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c009448-ea6b-44ef-b8bc-57e15f333881 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 22:11:33.063601 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-2c009448-ea6b-44ef-b8bc-57e15f333881 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 20 22:11:33.063601 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:33.063601 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:33.063601 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:33.063601 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:33.063601 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:33.063601 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:33.063601 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:33.063601 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:33.063601 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:33.063601 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:33.063601 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:33.063601 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 22:11:33.063601 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 22:11:33.063601 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 22:11:33.063601 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 22:11:33.064538 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 22:11:33.064538 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 22:11:33.064538 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 22:11:33.064538 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 22:11:33.064538 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:33.064538 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:33.064538 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:33.064538 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:33.064538 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:33.064538 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:33.064538 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:33.064538 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:33.064538 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:33.064538 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:33.064538 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:33.064538 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:33.065371 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:33.065371 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:33.065371 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:33.065371 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:33.065371 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 22:11:33.065371 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 22:11:33.065371 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 22:11:33.065371 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 22:11:33.065371 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 22:11:33.065371 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 22:11:33.065371 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 20 22:11:33.065371 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:11:33.065371 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 435/859] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Sep 20 22:11:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:33.077241 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4c4d88-49fa-4cc8-87ec-300004de1bf4 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:33.150262 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:33.189869 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4c4d88-49fa-4cc8-87ec-300004de1bf4 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:33.228914 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738e3742-d209-4faf-8ace-4c878ff43add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:33.229534 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738e3742-d209-4faf-8ace-4c878ff43add None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:33.229818 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738e3742-d209-4faf-8ace-4c878ff43add None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:33.230145 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738e3742-d209-4faf-8ace-4c878ff43add None admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:33.230848 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738e3742-d209-4faf-8ace-4c878ff43add None admin] RBAC: Adding query filter params (name=service) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:33.231155 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738e3742-d209-4faf-8ace-4c878ff43add None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:33.232531 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738e3742-d209-4faf-8ace-4c878ff43add None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:33.241616 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 425/860] 10.222.0.33 () {56 vars in 1103 bytes} [Tue Sep 20 22:11:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:33.247348 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c009448-ea6b-44ef-b8bc-57e15f333881 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:33.294496 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:33.354014 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c009448-ea6b-44ef-b8bc-57e15f333881 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:33.388391 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7a1a40-e219-4822-8ad1-28d23d75c59e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:33.389240 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7a1a40-e219-4822-8ad1-28d23d75c59e None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:33.389665 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7a1a40-e219-4822-8ad1-28d23d75c59e None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:33.390079 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7a1a40-e219-4822-8ad1-28d23d75c59e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:33.402406 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7a1a40-e219-4822-8ad1-28d23d75c59e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:33.404044 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7a1a40-e219-4822-8ad1-28d23d75c59e None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:33.418453 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-3e7a1a40-e219-4822-8ad1-28d23d75c59e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:11:33.418453 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:33.418453 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:33.418453 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:33.418453 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:33.418453 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:33.418453 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:33.418453 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:33.418453 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:33.418453 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:33.418453 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:33.418453 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:33.418453 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 22:11:33.418453 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 22:11:33.418453 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 22:11:33.418453 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 22:11:33.419624 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:33.419624 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:33.419624 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:33.419624 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:33.419624 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:33.419624 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:33.419624 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:33.419624 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:33.419624 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:33.419624 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:33.419624 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:33.419624 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:33.419624 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:33.419624 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:33.419624 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:33.419624 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:33.419624 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 22:11:33.420719 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 22:11:33.420719 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:11:33.420719 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:11:33.422495 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 436/861] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 20 22:11:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:33.430556 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738e3742-d209-4faf-8ace-4c878ff43add None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:33.537507 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738e3742-d209-4faf-8ace-4c878ff43add None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:33.570336 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:33.574652 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d85207-f8b0-4bfe-a5f4-06d556fae7d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:33.575623 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d85207-f8b0-4bfe-a5f4-06d556fae7d3 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:33.576080 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d85207-f8b0-4bfe-a5f4-06d556fae7d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:33.576447 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d85207-f8b0-4bfe-a5f4-06d556fae7d3 None admin] PATH_INFO: `/v3/domains` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:33.577108 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d85207-f8b0-4bfe-a5f4-06d556fae7d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:33.577417 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d85207-f8b0-4bfe-a5f4-06d556fae7d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:33.578826 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d85207-f8b0-4bfe-a5f4-06d556fae7d3 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:33.593008 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 426/862] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 20 22:11:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:33.598311 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7a1a40-e219-4822-8ad1-28d23d75c59e None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:33.695945 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:33.703214 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7a1a40-e219-4822-8ad1-28d23d75c59e None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:33.738538 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402f6804-7dd6-420c-a08e-5eb244976d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:33.739267 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f6804-7dd6-420c-a08e-5eb244976d3a None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:33.739545 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f6804-7dd6-420c-a08e-5eb244976d3a None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:33.739818 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f6804-7dd6-420c-a08e-5eb244976d3a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:33.747576 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402f6804-7dd6-420c-a08e-5eb244976d3a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:33.749223 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402f6804-7dd6-420c-a08e-5eb244976d3a None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:33.760666 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-402f6804-7dd6-420c-a08e-5eb244976d3a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 20 22:11:33.760666 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:33.760666 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:33.760666 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:33.760666 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:33.760666 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:33.760666 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:33.760666 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:33.760666 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:33.760666 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:33.760666 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:33.760666 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:33.760666 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 20 22:11:33.760666 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 20 22:11:33.760666 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 20 22:11:33.760666 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 20 22:11:33.761587 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:33.761587 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:33.761587 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 20 22:11:33.761587 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 22:11:33.761587 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 20 22:11:33.761587 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 22:11:33.761587 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:33.761587 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:33.761587 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:33.761587 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:33.761587 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:33.761587 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:33.761587 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:33.761587 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:33.761587 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:33.761587 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:33.761587 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:33.761587 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:33.762555 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:33.762555 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:33.762555 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 20 22:11:33.762555 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 20 22:11:33.762555 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 20 22:11:33.762555 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 20 22:11:33.762555 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 20 22:11:33.762555 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 20 22:11:33.762555 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 20 22:11:33.762555 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:11:33.764955 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 437/863] 10.222.0.33 () {56 vars in 1117 bytes} [Tue Sep 20 22:11:33 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:33.771001 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d85207-f8b0-4bfe-a5f4-06d556fae7d3 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:33.876139 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d85207-f8b0-4bfe-a5f4-06d556fae7d3 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:33.921751 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48046218-6177-4bac-871f-4421da123bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:33.922366 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48046218-6177-4bac-871f-4421da123bed None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:33.922676 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48046218-6177-4bac-871f-4421da123bed None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:33.922947 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48046218-6177-4bac-871f-4421da123bed None admin] PATH_INFO: `/v3/users` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:33.923672 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48046218-6177-4bac-871f-4421da123bed None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:33.923977 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48046218-6177-4bac-871f-4421da123bed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:33.925485 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48046218-6177-4bac-871f-4421da123bed None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:33.944193 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 427/864] 10.222.0.33 () {56 vars in 1149 bytes} [Tue Sep 20 22:11:33 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:33.949671 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402f6804-7dd6-420c-a08e-5eb244976d3a None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:34.054166 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402f6804-7dd6-420c-a08e-5eb244976d3a None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:34.089872 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17082366-49d2-463f-81a6-6c731d329f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:34.090881 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17082366-49d2-463f-81a6-6c731d329f4f None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:34.091363 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17082366-49d2-463f-81a6-6c731d329f4f None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:34.091851 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17082366-49d2-463f-81a6-6c731d329f4f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:34.118266 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:34.163425 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17082366-49d2-463f-81a6-6c731d329f4f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:34.164800 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17082366-49d2-463f-81a6-6c731d329f4f None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:34.271608 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 438/865] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 20 22:11:33 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 20 22:11:34.277095 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48046218-6177-4bac-871f-4421da123bed None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:34.332866 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:34.386430 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48046218-6177-4bac-871f-4421da123bed None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:34.429536 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbdfc18-6e74-45ac-836d-825273b641c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:34.430117 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbdfc18-6e74-45ac-836d-825273b641c7 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:34.430399 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbdfc18-6e74-45ac-836d-825273b641c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:34.430711 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbdfc18-6e74-45ac-836d-825273b641c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:34.442041 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbdfc18-6e74-45ac-836d-825273b641c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:34.444136 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbdfc18-6e74-45ac-836d-825273b641c7 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:34.459639 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-fbbdfc18-6e74-45ac-836d-825273b641c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:11:34.459639 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:34.459639 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:34.459639 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:34.459639 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:34.459639 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:34.459639 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:34.459639 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:34.459639 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:34.459639 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:34.459639 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:34.459639 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:34.459639 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 22:11:34.459639 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 22:11:34.459639 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 22:11:34.459639 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 22:11:34.460612 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:34.460612 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:34.460612 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:34.460612 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:34.460612 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:34.460612 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:34.460612 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:34.460612 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:34.460612 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:34.460612 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:34.460612 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:34.460612 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:34.460612 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:34.460612 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:34.460612 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:34.460612 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:34.460612 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 22:11:34.461513 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 22:11:34.461513 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:11:34.461513 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:11:34.461513 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 428/866] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 20 22:11:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:34.467505 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17082366-49d2-463f-81a6-6c731d329f4f None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:34.528592 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:34.535506 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20863e27-1cc3-4c2e-a3a9-e4de21a9e468 None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:34.536067 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20863e27-1cc3-4c2e-a3a9-e4de21a9e468 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:34.536560 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20863e27-1cc3-4c2e-a3a9-e4de21a9e468 None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:34.538462 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 429/867] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:11:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:11:34.544100 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fced300f-6943-4182-adc7-855ad543d381 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:34.544658 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fced300f-6943-4182-adc7-855ad543d381 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:34.545243 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fced300f-6943-4182-adc7-855ad543d381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:34.569184 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-fced300f-6943-4182-adc7-855ad543d381 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:11:34.570708 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-fced300f-6943-4182-adc7-855ad543d381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:11:34.592794 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17082366-49d2-463f-81a6-6c731d329f4f None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:34.637216 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce00c46-50f5-4331-b04a-0810748bb3f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:34.637865 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce00c46-50f5-4331-b04a-0810748bb3f6 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:34.638420 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce00c46-50f5-4331-b04a-0810748bb3f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:34.638728 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce00c46-50f5-4331-b04a-0810748bb3f6 None admin] PATH_INFO: `/v3/domains` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:34.639630 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce00c46-50f5-4331-b04a-0810748bb3f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:34.639944 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce00c46-50f5-4331-b04a-0810748bb3f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:34.642040 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce00c46-50f5-4331-b04a-0810748bb3f6 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:34.652482 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 430/868] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:11:34 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 20 22:11:34.656004 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 439/869] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 20 22:11:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:34.661879 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fced300f-6943-4182-adc7-855ad543d381 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:34.695249 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:34.771774 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fced300f-6943-4182-adc7-855ad543d381 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:34.808706 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed101bd9-3fb8-4ac6-b9b3-5a36ccda451e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:34.809355 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed101bd9-3fb8-4ac6-b9b3-5a36ccda451e None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:34.809636 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed101bd9-3fb8-4ac6-b9b3-5a36ccda451e None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:34.809908 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed101bd9-3fb8-4ac6-b9b3-5a36ccda451e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:34.816946 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed101bd9-3fb8-4ac6-b9b3-5a36ccda451e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:34.818553 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed101bd9-3fb8-4ac6-b9b3-5a36ccda451e None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:34.830279 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-ed101bd9-3fb8-4ac6-b9b3-5a36ccda451e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 22:11:34.830279 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:34.830279 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:34.830279 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:34.830279 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:34.830279 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:34.830279 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:34.830279 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:34.830279 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:34.830279 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:34.830279 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:34.830279 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:34.830279 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 20 22:11:34.830279 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 20 22:11:34.830279 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 20 22:11:34.831246 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 20 22:11:34.831246 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:34.831246 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:34.831246 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:34.831246 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:34.831246 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:34.831246 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:34.831246 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:34.831246 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:34.831246 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:34.831246 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:34.831246 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:34.831246 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:34.831246 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:34.831246 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:34.831246 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:34.831246 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:34.832141 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 20 22:11:34.832141 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 20 22:11:34.832141 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 20 22:11:34.832141 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 20 22:11:34.832141 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 20 22:11:34.832141 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 20 22:11:34.832141 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 22:11:34.832141 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:11:34.832141 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 431/870] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Sep 20 22:11:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 20 22:11:34.839590 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce00c46-50f5-4331-b04a-0810748bb3f6 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:34.853991 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d8e1d8-e25a-4da4-98ee-c864e8782c2e None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:34.854281 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d8e1d8-e25a-4da4-98ee-c864e8782c2e None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:34.854611 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d8e1d8-e25a-4da4-98ee-c864e8782c2e None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:34.856263 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 432/871] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:11:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:11:34.861174 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5980ddfe-4f31-4286-a92a-9faa65fc0254 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:34.861717 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5980ddfe-4f31-4286-a92a-9faa65fc0254 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:34.862000 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5980ddfe-4f31-4286-a92a-9faa65fc0254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:34.882897 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-5980ddfe-4f31-4286-a92a-9faa65fc0254 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:11:34.884202 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-5980ddfe-4f31-4286-a92a-9faa65fc0254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:11:34.955499 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce00c46-50f5-4331-b04a-0810748bb3f6 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:34.960885 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 433/872] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:11:34 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 20 22:11:34.961737 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5980ddfe-4f31-4286-a92a-9faa65fc0254 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:34.978819 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:34.989815 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:35.005322 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b5542a-4bbb-4501-9c9c-01a22f1cc1eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:35.006200 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b5542a-4bbb-4501-9c9c-01a22f1cc1eb None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:35.006687 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b5542a-4bbb-4501-9c9c-01a22f1cc1eb None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:35.008419 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b5542a-4bbb-4501-9c9c-01a22f1cc1eb None admin] PATH_INFO: `/v3/projects` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:35.009814 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b5542a-4bbb-4501-9c9c-01a22f1cc1eb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:35.010296 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b5542a-4bbb-4501-9c9c-01a22f1cc1eb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:35.012367 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b5542a-4bbb-4501-9c9c-01a22f1cc1eb None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:35.029513 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 440/873] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Sep 20 22:11:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:35.034887 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b5542a-4bbb-4501-9c9c-01a22f1cc1eb None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:35.092840 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5980ddfe-4f31-4286-a92a-9faa65fc0254 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:35.141156 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189269d5-702e-41e4-af88-287e4ca6b893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:35.141809 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189269d5-702e-41e4-af88-287e4ca6b893 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:35.142092 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189269d5-702e-41e4-af88-287e4ca6b893 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:35.142537 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189269d5-702e-41e4-af88-287e4ca6b893 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:35.143283 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189269d5-702e-41e4-af88-287e4ca6b893 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:35.144856 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189269d5-702e-41e4-af88-287e4ca6b893 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:35.156731 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-189269d5-702e-41e4-af88-287e4ca6b893 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 20 22:11:35.156731 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:35.156731 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 20 22:11:35.156731 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 20 22:11:35.156731 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 20 22:11:35.156731 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 20 22:11:35.156731 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 20 22:11:35.156731 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 20 22:11:35.156731 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 20 22:11:35.156731 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:11:35.156731 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 20 22:11:35.156731 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:11:35.156731 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:35.156731 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:35.156731 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:35.156731 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:35.156731 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:35.157756 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:35.157756 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:35.157756 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:35.157756 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:35.157756 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:35.157756 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:35.157756 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 20 22:11:35.157756 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 20 22:11:35.157756 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 20 22:11:35.157756 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 20 22:11:35.157756 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:35.157756 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:35.157756 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:35.157756 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:35.157756 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:35.157756 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:35.158640 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:35.158640 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:35.158640 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:35.158640 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:35.158640 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:35.158640 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:35.158640 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:35.158640 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:35.158640 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:35.158640 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:35.158640 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 20 22:11:35.158640 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 20 22:11:35.158640 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 20 22:11:35.158640 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:11:35.162946 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 434/874] 10.222.0.33 () {56 vars in 1126 bytes} [Tue Sep 20 22:11:34 2022] GET /identity/v3/services/object-store => generated 93 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:35.164166 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189269d5-702e-41e4-af88-287e4ca6b893 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:35.167122 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b5542a-4bbb-4501-9c9c-01a22f1cc1eb None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:35.205109 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafedb04-3759-49d0-b25d-6b1877172094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:35.206079 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafedb04-3759-49d0-b25d-6b1877172094 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:35.206616 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafedb04-3759-49d0-b25d-6b1877172094 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:35.207088 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafedb04-3759-49d0-b25d-6b1877172094 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:35.208183 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafedb04-3759-49d0-b25d-6b1877172094 None admin] RBAC: Adding query filter params (role.id=6d6dcbd3bc16491db00308c3b7d27a63, scope.project.id=3ce415d02aa9489bae19cd514805fd8c, user.id=e916748fdee84c34af034e75a919b986) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:35.208680 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafedb04-3759-49d0-b25d-6b1877172094 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:35.210394 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafedb04-3759-49d0-b25d-6b1877172094 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:35.216843 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 441/875] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Sep 20 22:11:35 2022] GET /identity/v3/role_assignments?user.id=e916748fdee84c34af034e75a919b986&scope.project.id=3ce415d02aa9489bae19cd514805fd8c&role.id=6d6dcbd3bc16491db00308c3b7d27a63 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 22:11:35.218194 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c225c1-f6e2-4135-9ad9-cd29b97d6ff3 None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:35.218696 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c225c1-f6e2-4135-9ad9-cd29b97d6ff3 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:35.219143 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c225c1-f6e2-4135-9ad9-cd29b97d6ff3 None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:35.220884 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 442/876] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:11:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:11:35.226550 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe120b03-8fc1-4ab8-b958-33366d0424df None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:35.226896 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe120b03-8fc1-4ab8-b958-33366d0424df None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:35.227177 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe120b03-8fc1-4ab8-b958-33366d0424df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:35.248884 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-fe120b03-8fc1-4ab8-b958-33366d0424df None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:11:35.250285 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-fe120b03-8fc1-4ab8-b958-33366d0424df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:11:35.268037 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:35.285563 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189269d5-702e-41e4-af88-287e4ca6b893 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:35.293318 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:35.323970 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba57a26-706a-4c5f-bdf4-5d6b0fa52e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:35.324617 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba57a26-706a-4c5f-bdf4-5d6b0fa52e4c None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:35.324896 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba57a26-706a-4c5f-bdf4-5d6b0fa52e4c None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:35.325163 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba57a26-706a-4c5f-bdf4-5d6b0fa52e4c None admin] PATH_INFO: `/v3/services` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:35.325802 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba57a26-706a-4c5f-bdf4-5d6b0fa52e4c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:35.326103 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba57a26-706a-4c5f-bdf4-5d6b0fa52e4c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:35.327530 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba57a26-706a-4c5f-bdf4-5d6b0fa52e4c None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:35.332754 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 435/877] 10.222.0.33 () {56 vars in 1122 bytes} [Tue Sep 20 22:11:35 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:35.333581 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba57a26-706a-4c5f-bdf4-5d6b0fa52e4c None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:35.347721 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 443/878] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:11:35 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 20 22:11:35.349506 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe120b03-8fc1-4ab8-b958-33366d0424df None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:35.453583 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba57a26-706a-4c5f-bdf4-5d6b0fa52e4c None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:35.480508 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe120b03-8fc1-4ab8-b958-33366d0424df None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:35.497347 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73acf4e-7a2e-4b49-89c5-3fc4fb03c884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:35.498758 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73acf4e-7a2e-4b49-89c5-3fc4fb03c884 None admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:35.499277 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73acf4e-7a2e-4b49-89c5-3fc4fb03c884 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:35.499831 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73acf4e-7a2e-4b49-89c5-3fc4fb03c884 None admin] PATH_INFO: `/v3/services` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:35.500506 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73acf4e-7a2e-4b49-89c5-3fc4fb03c884 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:35.502357 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73acf4e-7a2e-4b49-89c5-3fc4fb03c884 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:35.519126 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 436/879] 10.222.0.33 () {60 vars in 1141 bytes} [Tue Sep 20 22:11:35 2022] POST /identity/v3/services => generated 269 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:11:35.529618 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ce8b7e-71f3-437e-a3b5-fe3e05b296bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:35.530345 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce8b7e-71f3-437e-a3b5-fe3e05b296bd None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:35.530672 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce8b7e-71f3-437e-a3b5-fe3e05b296bd None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:35.530940 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce8b7e-71f3-437e-a3b5-fe3e05b296bd None admin] PATH_INFO: `/v3/services` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:35.531582 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ce8b7e-71f3-437e-a3b5-fe3e05b296bd None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:35.531936 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ce8b7e-71f3-437e-a3b5-fe3e05b296bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:35.533402 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ce8b7e-71f3-437e-a3b5-fe3e05b296bd None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:35.542552 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 444/880] 10.222.0.33 () {56 vars in 1122 bytes} [Tue Sep 20 22:11:35 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:35.632599 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73acf4e-7a2e-4b49-89c5-3fc4fb03c884 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:35.648402 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:35.758947 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73acf4e-7a2e-4b49-89c5-3fc4fb03c884 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:35.796101 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9a348e-4cb7-4306-ad1e-6ade557ddb4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:35.796718 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9a348e-4cb7-4306-ad1e-6ade557ddb4e None admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:35.796999 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9a348e-4cb7-4306-ad1e-6ade557ddb4e None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:35.797274 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9a348e-4cb7-4306-ad1e-6ade557ddb4e None admin] PATH_INFO: `/v3/services` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:35.797939 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9a348e-4cb7-4306-ad1e-6ade557ddb4e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:35.800001 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9a348e-4cb7-4306-ad1e-6ade557ddb4e None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:35.819044 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 437/881] 10.222.0.33 () {60 vars in 1141 bytes} [Tue Sep 20 22:11:35 2022] POST /identity/v3/services => generated 251 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:11:37.554935 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2fdb33-b9d8-4f05-9214-9a562093aaa0 None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:37.555447 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2fdb33-b9d8-4f05-9214-9a562093aaa0 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:37.555447 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2fdb33-b9d8-4f05-9214-9a562093aaa0 None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:37.557035 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 445/882] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:11:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:11:37.562582 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c00a750-67e5-41a2-a82b-fde88d18537a None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:37.563442 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c00a750-67e5-41a2-a82b-fde88d18537a None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:37.563933 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c00a750-67e5-41a2-a82b-fde88d18537a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:37.583126 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-9c00a750-67e5-41a2-a82b-fde88d18537a None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:11:37.584635 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-9c00a750-67e5-41a2-a82b-fde88d18537a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:11:37.654576 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:37.670610 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 438/883] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:11:37 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 20 22:11:37.742181 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a231ed9f-11b7-4dff-9473-716a1b029c61 None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:37.742535 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a231ed9f-11b7-4dff-9473-716a1b029c61 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:37.742751 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a231ed9f-11b7-4dff-9473-716a1b029c61 None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:37.744628 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 446/884] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:11:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:11:37.752696 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7124d0-30d7-4210-92cb-35ca49fc5786 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:37.753339 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7124d0-30d7-4210-92cb-35ca49fc5786 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:37.753819 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7124d0-30d7-4210-92cb-35ca49fc5786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:37.774540 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-0b7124d0-30d7-4210-92cb-35ca49fc5786 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:11:37.776162 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-0b7124d0-30d7-4210-92cb-35ca49fc5786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:11:37.850616 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 439/885] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:11:37 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 20 22:11:37.882020 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf5382e-3be6-435e-90b5-41d8cc2ec928 None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:37.882767 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf5382e-3be6-435e-90b5-41d8cc2ec928 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:37.883531 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf5382e-3be6-435e-90b5-41d8cc2ec928 None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:37.885352 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 447/886] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:11:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:11:37.891871 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa9d314-cf9f-4709-acf8-4474a4c48831 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:37.892375 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa9d314-cf9f-4709-acf8-4474a4c48831 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:37.892914 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa9d314-cf9f-4709-acf8-4474a4c48831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:37.911912 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-6aa9d314-cf9f-4709-acf8-4474a4c48831 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:11:37.913451 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-6aa9d314-cf9f-4709-acf8-4474a4c48831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:11:37.939149 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf5382e-3be6-435e-90b5-41d8cc2ec928 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:37.972509 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:38.002631 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 440/887] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:11:37 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 20 22:11:38.050023 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf5382e-3be6-435e-90b5-41d8cc2ec928 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:38.054987 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a39c70-9778-404a-829e-bc39c71f31a6 None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:38.055527 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a39c70-9778-404a-829e-bc39c71f31a6 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:38.056021 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a39c70-9778-404a-829e-bc39c71f31a6 None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:38.057901 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 441/888] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:11:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 20 22:11:38.062992 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a14d4e-47f8-4561-8065-69299f718ca3 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:38.063513 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a14d4e-47f8-4561-8065-69299f718ca3 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:38.063999 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a14d4e-47f8-4561-8065-69299f718ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:38.083859 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-a1a14d4e-47f8-4561-8065-69299f718ca3 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:11:38.085348 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-a1a14d4e-47f8-4561-8065-69299f718ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:11:38.085846 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2040638c-065a-4581-8ab2-d859932f46cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:38.086478 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2040638c-065a-4581-8ab2-d859932f46cf None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:38.086790 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2040638c-065a-4581-8ab2-d859932f46cf None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:38.087061 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2040638c-065a-4581-8ab2-d859932f46cf None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:38.100024 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2040638c-065a-4581-8ab2-d859932f46cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 22:11:38.105149 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-2040638c-065a-4581-8ab2-d859932f46cf None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 20 22:11:38.105149 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:38.105149 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:38.105149 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:38.105149 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:38.105149 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:38.105149 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:38.105149 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:38.105149 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:38.105149 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:38.105149 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:38.105149 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:38.105149 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 22:11:38.105149 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 22:11:38.105149 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 22:11:38.105149 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 22:11:38.106319 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 22:11:38.106319 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 22:11:38.106319 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 22:11:38.106319 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 22:11:38.106319 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:38.106319 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:38.106319 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:38.106319 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:38.106319 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:38.106319 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:38.106319 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:38.106319 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:38.106319 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:38.106319 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:38.106319 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:38.106319 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:38.107431 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:38.107431 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:38.107431 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:38.107431 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:38.107431 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 22:11:38.107431 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 22:11:38.107431 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 22:11:38.107431 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 22:11:38.107431 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 22:11:38.107431 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 22:11:38.107431 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 20 22:11:38.107431 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:11:38.110121 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 448/889] 10.222.0.33 () {56 vars in 1120 bytes} [Tue Sep 20 22:11:37 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 20 22:11:38.115508 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2040638c-065a-4581-8ab2-d859932f46cf None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:38.145927 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:38.166761 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 442/890] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:11:38 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 20 22:11:38.166761 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a14d4e-47f8-4561-8065-69299f718ca3 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:38.229215 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:38.241307 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2040638c-065a-4581-8ab2-d859932f46cf None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:38.275232 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a14d4e-47f8-4561-8065-69299f718ca3 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:38.284025 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86d625b-6106-40bd-be32-50ab29883000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:38.284706 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86d625b-6106-40bd-be32-50ab29883000 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:38.285016 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86d625b-6106-40bd-be32-50ab29883000 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:38.286270 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86d625b-6106-40bd-be32-50ab29883000 None admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:38.286976 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86d625b-6106-40bd-be32-50ab29883000 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:38.287283 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86d625b-6106-40bd-be32-50ab29883000 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:38.289005 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86d625b-6106-40bd-be32-50ab29883000 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:38.302745 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 449/891] 10.222.0.33 () {56 vars in 1115 bytes} [Tue Sep 20 22:11:38 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 22:11:38.303382 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86d625b-6106-40bd-be32-50ab29883000 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:38.316014 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a540d1c-b971-4342-a57b-72bd3d6edc81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:38.316633 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a540d1c-b971-4342-a57b-72bd3d6edc81 None admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:38.316930 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a540d1c-b971-4342-a57b-72bd3d6edc81 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:38.317215 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a540d1c-b971-4342-a57b-72bd3d6edc81 None admin] PATH_INFO: `/v3/services` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:38.317970 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a540d1c-b971-4342-a57b-72bd3d6edc81 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:38.319360 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a540d1c-b971-4342-a57b-72bd3d6edc81 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:38.334379 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 443/892] 10.222.0.33 () {60 vars in 1141 bytes} [Tue Sep 20 22:11:38 2022] POST /identity/v3/services => generated 241 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:11:38.335387 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a540d1c-b971-4342-a57b-72bd3d6edc81 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:38.389317 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:38.436348 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86d625b-6106-40bd-be32-50ab29883000 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:38.466005 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a540d1c-b971-4342-a57b-72bd3d6edc81 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:38.477540 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a447728-3f73-4689-9f82-007ea0860c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:38.478185 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a447728-3f73-4689-9f82-007ea0860c78 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:38.478702 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a447728-3f73-4689-9f82-007ea0860c78 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:38.478832 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a447728-3f73-4689-9f82-007ea0860c78 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:38.479436 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a447728-3f73-4689-9f82-007ea0860c78 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:38.480719 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a447728-3f73-4689-9f82-007ea0860c78 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:38.490374 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-7a447728-3f73-4689-9f82-007ea0860c78 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 20 22:11:38.490374 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:38.490374 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 20 22:11:38.490374 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 20 22:11:38.490374 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 20 22:11:38.490374 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 20 22:11:38.490374 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 20 22:11:38.490374 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 20 22:11:38.490374 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 20 22:11:38.490374 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:11:38.490374 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 20 22:11:38.490374 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:11:38.490374 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:38.490374 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:38.490374 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:38.490374 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:38.491472 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:38.491472 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:38.491472 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:38.491472 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:38.491472 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:38.491472 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:38.491472 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:38.491472 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 20 22:11:38.491472 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 20 22:11:38.491472 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 20 22:11:38.491472 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 20 22:11:38.491472 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:38.491472 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:38.491472 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:38.491472 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:38.491472 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:38.491472 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:38.492340 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:38.492340 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:38.492340 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:38.492340 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:38.492340 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:38.492340 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:38.492340 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:38.492340 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:38.492340 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:38.492340 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:38.492340 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 20 22:11:38.492340 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 20 22:11:38.492340 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 20 22:11:38.492340 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:11:38.492340 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 450/893] 10.222.0.33 () {56 vars in 1132 bytes} [Tue Sep 20 22:11:38 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:38.493130 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a447728-3f73-4689-9f82-007ea0860c78 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:38.512974 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:38.513646 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb86c957-ccfd-4586-aca9-4a6fe67a0cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:38.514372 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb86c957-ccfd-4586-aca9-4a6fe67a0cc6 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:38.514758 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb86c957-ccfd-4586-aca9-4a6fe67a0cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:38.515098 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb86c957-ccfd-4586-aca9-4a6fe67a0cc6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:38.526773 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb86c957-ccfd-4586-aca9-4a6fe67a0cc6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:38.528243 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb86c957-ccfd-4586-aca9-4a6fe67a0cc6 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:38.543523 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-eb86c957-ccfd-4586-aca9-4a6fe67a0cc6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:11:38.543523 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:38.543523 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:38.543523 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:38.543523 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:38.543523 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:38.543523 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:38.543523 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:38.543523 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:38.543523 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:38.543523 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:38.543523 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:38.543523 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 22:11:38.543523 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 22:11:38.543523 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 22:11:38.543523 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 22:11:38.544502 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:38.544502 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:38.544502 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:38.544502 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:38.544502 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:38.544502 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:38.544502 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:38.544502 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:38.544502 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:38.544502 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:38.544502 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:38.544502 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:38.544502 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:38.544502 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:38.544502 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:38.544502 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:38.544502 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 22:11:38.546157 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 22:11:38.546157 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:11:38.546157 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:11:38.546157 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 444/894] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 20 22:11:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:38.546157 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb86c957-ccfd-4586-aca9-4a6fe67a0cc6 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:38.613248 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a447728-3f73-4689-9f82-007ea0860c78 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:38.647745 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:38.653369 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425bfd29-9e10-4dd8-9074-45b1859c3cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:38.654001 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425bfd29-9e10-4dd8-9074-45b1859c3cec None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:38.654276 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425bfd29-9e10-4dd8-9074-45b1859c3cec None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:38.654568 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425bfd29-9e10-4dd8-9074-45b1859c3cec None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:38.655149 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425bfd29-9e10-4dd8-9074-45b1859c3cec None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:38.655409 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb86c957-ccfd-4586-aca9-4a6fe67a0cc6 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:38.656496 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425bfd29-9e10-4dd8-9074-45b1859c3cec None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:38.665556 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-425bfd29-9e10-4dd8-9074-45b1859c3cec None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 20 22:11:38.665556 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:38.665556 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 20 22:11:38.665556 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 20 22:11:38.665556 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 20 22:11:38.665556 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 20 22:11:38.665556 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 20 22:11:38.665556 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 20 22:11:38.665556 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 20 22:11:38.665556 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:11:38.665556 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 20 22:11:38.665556 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:11:38.665556 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:38.665556 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:38.665556 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:38.665556 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:38.665556 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:38.666584 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:38.666584 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:38.666584 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:38.666584 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:38.666584 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:38.666584 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:38.666584 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 20 22:11:38.666584 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 20 22:11:38.666584 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 20 22:11:38.666584 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 20 22:11:38.666584 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:38.666584 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:38.666584 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:38.666584 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:38.666584 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:38.666584 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:38.667433 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:38.667433 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:38.667433 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:38.667433 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:38.667433 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:38.667433 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:38.667433 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:38.667433 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:38.667433 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:38.667433 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:38.667433 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 20 22:11:38.667433 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 20 22:11:38.667433 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 20 22:11:38.667433 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:11:38.667433 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 451/895] 10.222.0.33 () {56 vars in 1114 bytes} [Tue Sep 20 22:11:38 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:38.668228 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425bfd29-9e10-4dd8-9074-45b1859c3cec None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:38.696822 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aa2c09-9ea7-4c02-b5f4-0d49833c826a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:38.697849 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aa2c09-9ea7-4c02-b5f4-0d49833c826a None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:38.698127 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aa2c09-9ea7-4c02-b5f4-0d49833c826a None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:38.698454 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aa2c09-9ea7-4c02-b5f4-0d49833c826a None admin] PATH_INFO: `/v3/services` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:38.699119 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aa2c09-9ea7-4c02-b5f4-0d49833c826a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:38.699445 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aa2c09-9ea7-4c02-b5f4-0d49833c826a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:38.700803 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aa2c09-9ea7-4c02-b5f4-0d49833c826a None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:38.705587 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 445/896] 10.222.0.33 () {56 vars in 1126 bytes} [Tue Sep 20 22:11:38 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:38.706408 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aa2c09-9ea7-4c02-b5f4-0d49833c826a None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:38.763070 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:38.785747 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425bfd29-9e10-4dd8-9074-45b1859c3cec None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:38.816465 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aa2c09-9ea7-4c02-b5f4-0d49833c826a None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:38.825384 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7130ecef-b333-45fb-9340-6dfc0e3ab3a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:38.825994 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7130ecef-b333-45fb-9340-6dfc0e3ab3a8 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:38.826277 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7130ecef-b333-45fb-9340-6dfc0e3ab3a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:38.826586 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7130ecef-b333-45fb-9340-6dfc0e3ab3a8 None admin] PATH_INFO: `/v3/domains` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:38.827601 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7130ecef-b333-45fb-9340-6dfc0e3ab3a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:38.827911 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7130ecef-b333-45fb-9340-6dfc0e3ab3a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:38.829637 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7130ecef-b333-45fb-9340-6dfc0e3ab3a8 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:38.842725 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 452/897] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 20 22:11:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:38.843547 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7130ecef-b333-45fb-9340-6dfc0e3ab3a8 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:38.860513 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12f8f9e-5966-487a-89f2-97822daff6e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:38.861646 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12f8f9e-5966-487a-89f2-97822daff6e7 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:38.862468 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12f8f9e-5966-487a-89f2-97822daff6e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:38.862947 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12f8f9e-5966-487a-89f2-97822daff6e7 None admin] PATH_INFO: `/v3/services` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:38.864335 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12f8f9e-5966-487a-89f2-97822daff6e7 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:38.864813 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12f8f9e-5966-487a-89f2-97822daff6e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:38.867169 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12f8f9e-5966-487a-89f2-97822daff6e7 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:38.874050 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 446/898] 10.222.0.33 () {56 vars in 1114 bytes} [Tue Sep 20 22:11:38 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:38.875704 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12f8f9e-5966-487a-89f2-97822daff6e7 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:38.909753 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:38.954610 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7130ecef-b333-45fb-9340-6dfc0e3ab3a8 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:38.990401 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2890fa-e645-4286-9edc-32e2c2dfe9f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:38.991092 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2890fa-e645-4286-9edc-32e2c2dfe9f5 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:38.991274 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12f8f9e-5966-487a-89f2-97822daff6e7 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:38.991382 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2890fa-e645-4286-9edc-32e2c2dfe9f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:38.991630 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2890fa-e645-4286-9edc-32e2c2dfe9f5 None admin] PATH_INFO: `/v3/services` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:38.992308 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2890fa-e645-4286-9edc-32e2c2dfe9f5 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:38.992713 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2890fa-e645-4286-9edc-32e2c2dfe9f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:38.993972 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2890fa-e645-4286-9edc-32e2c2dfe9f5 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:38.998948 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 453/899] 10.222.0.33 () {56 vars in 1126 bytes} [Tue Sep 20 22:11:38 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:39.005052 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2890fa-e645-4286-9edc-32e2c2dfe9f5 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:39.009351 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:39.026141 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2390e4f1-ba64-4722-bee9-448c1451f172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:39.026807 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2390e4f1-ba64-4722-bee9-448c1451f172 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:39.027083 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2390e4f1-ba64-4722-bee9-448c1451f172 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:39.027349 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2390e4f1-ba64-4722-bee9-448c1451f172 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:39.035114 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2390e4f1-ba64-4722-bee9-448c1451f172 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:39.036587 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2390e4f1-ba64-4722-bee9-448c1451f172 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:39.048201 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-2390e4f1-ba64-4722-bee9-448c1451f172 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 20 22:11:39.048201 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:39.048201 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:39.048201 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:39.048201 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:39.048201 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:39.048201 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:39.048201 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:39.048201 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:39.048201 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:39.048201 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:39.048201 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:39.048201 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 20 22:11:39.048201 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 20 22:11:39.048201 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 20 22:11:39.048201 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 20 22:11:39.049191 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:39.049191 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:39.049191 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 20 22:11:39.049191 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 22:11:39.049191 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 20 22:11:39.049191 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 22:11:39.049191 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:39.049191 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:39.049191 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:39.049191 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:39.049191 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:39.049191 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:39.049191 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:39.049191 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:39.049191 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:39.049191 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:39.049191 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:39.049191 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:39.050141 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:39.050141 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:39.050141 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 20 22:11:39.050141 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 20 22:11:39.050141 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 20 22:11:39.050141 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 20 22:11:39.050141 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 20 22:11:39.050141 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 20 22:11:39.050141 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 20 22:11:39.050141 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:11:39.050141 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 447/900] 10.222.0.33 () {56 vars in 1117 bytes} [Tue Sep 20 22:11:38 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:39.050141 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2390e4f1-ba64-4722-bee9-448c1451f172 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:39.123506 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2890fa-e645-4286-9edc-32e2c2dfe9f5 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:39.139507 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:39.157992 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039ad2f2-4a10-4f1b-9d00-9616964aca35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:39.158625 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039ad2f2-4a10-4f1b-9d00-9616964aca35 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:39.158899 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039ad2f2-4a10-4f1b-9d00-9616964aca35 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:39.159166 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039ad2f2-4a10-4f1b-9d00-9616964aca35 None admin] PATH_INFO: `/v3/services` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:39.159839 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039ad2f2-4a10-4f1b-9d00-9616964aca35 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:39.160080 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039ad2f2-4a10-4f1b-9d00-9616964aca35 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:39.161911 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2390e4f1-ba64-4722-bee9-448c1451f172 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:39.162032 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039ad2f2-4a10-4f1b-9d00-9616964aca35 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:39.166712 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 454/901] 10.222.0.33 () {56 vars in 1114 bytes} [Tue Sep 20 22:11:39 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:39.167478 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039ad2f2-4a10-4f1b-9d00-9616964aca35 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:39.200886 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d688337-ee7e-4b9b-8c11-cc4057c807bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:39.201842 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d688337-ee7e-4b9b-8c11-cc4057c807bc None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:39.202339 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d688337-ee7e-4b9b-8c11-cc4057c807bc None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:39.202804 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d688337-ee7e-4b9b-8c11-cc4057c807bc None admin] PATH_INFO: `/v3/endpoints` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:39.203646 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d688337-ee7e-4b9b-8c11-cc4057c807bc None admin] RBAC: Adding query filter params (interface=public, service_id=3baa156029a3458797a9d332bc0526fa, region_id=RegionOne) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:39.204101 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d688337-ee7e-4b9b-8c11-cc4057c807bc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:39.205611 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d688337-ee7e-4b9b-8c11-cc4057c807bc None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:39.212752 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 448/902] 10.222.0.33 () {56 vars in 1251 bytes} [Tue Sep 20 22:11:39 2022] GET /identity/v3/endpoints?service_id=3baa156029a3458797a9d332bc0526fa&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:39.213906 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d688337-ee7e-4b9b-8c11-cc4057c807bc None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:39.245804 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:39.281725 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039ad2f2-4a10-4f1b-9d00-9616964aca35 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:39.321721 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c8a6ea-dc40-40a4-ab8b-057ffdfa0c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:39.322326 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c8a6ea-dc40-40a4-ab8b-057ffdfa0c35 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:39.322628 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c8a6ea-dc40-40a4-ab8b-057ffdfa0c35 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:39.322898 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c8a6ea-dc40-40a4-ab8b-057ffdfa0c35 None admin] PATH_INFO: `/v3/users` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:39.323611 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c8a6ea-dc40-40a4-ab8b-057ffdfa0c35 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:39.323909 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c8a6ea-dc40-40a4-ab8b-057ffdfa0c35 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:39.325791 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c8a6ea-dc40-40a4-ab8b-057ffdfa0c35 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:39.331610 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d688337-ee7e-4b9b-8c11-cc4057c807bc None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:39.344281 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 455/903] 10.222.0.33 () {56 vars in 1149 bytes} [Tue Sep 20 22:11:39 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:39.345088 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c8a6ea-dc40-40a4-ab8b-057ffdfa0c35 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:39.372657 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fbdd97-dd9c-4970-b85b-0e74e220126e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:39.373590 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fbdd97-dd9c-4970-b85b-0e74e220126e None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:39.374068 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fbdd97-dd9c-4970-b85b-0e74e220126e None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:39.374545 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fbdd97-dd9c-4970-b85b-0e74e220126e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:39.375657 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fbdd97-dd9c-4970-b85b-0e74e220126e None admin] RBAC: Adding query filter params (interface=public, service_id=2338ee2508a94251afd0a6ed740a14b8, region_id=RegionOne) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:39.375972 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fbdd97-dd9c-4970-b85b-0e74e220126e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:39.377334 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fbdd97-dd9c-4970-b85b-0e74e220126e None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:39.387373 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 449/904] 10.222.0.33 () {56 vars in 1251 bytes} [Tue Sep 20 22:11:39 2022] GET /identity/v3/endpoints?service_id=2338ee2508a94251afd0a6ed740a14b8&interface=public®ion_id=RegionOne => generated 194 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:39.387373 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fbdd97-dd9c-4970-b85b-0e74e220126e None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:39.400401 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:39.449866 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c8a6ea-dc40-40a4-ab8b-057ffdfa0c35 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:39.475883 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:39.485346 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd622e7-ef0a-457a-9e4c-0802cc23eafa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:39.485946 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd622e7-ef0a-457a-9e4c-0802cc23eafa None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:39.486223 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd622e7-ef0a-457a-9e4c-0802cc23eafa None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:39.486492 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd622e7-ef0a-457a-9e4c-0802cc23eafa None admin] PATH_INFO: `/v3/services` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:39.487149 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd622e7-ef0a-457a-9e4c-0802cc23eafa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:39.488463 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd622e7-ef0a-457a-9e4c-0802cc23eafa None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:39.493214 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fbdd97-dd9c-4970-b85b-0e74e220126e None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:39.502881 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 456/905] 10.222.0.33 () {56 vars in 1087 bytes} [Tue Sep 20 22:11:39 2022] GET /identity/v3/services => generated 1497 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:11:39.502881 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd622e7-ef0a-457a-9e4c-0802cc23eafa None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:39.548793 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c8dfc9-71f1-4ea1-9629-397a34fcbf68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:39.549514 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c8dfc9-71f1-4ea1-9629-397a34fcbf68 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:39.549862 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c8dfc9-71f1-4ea1-9629-397a34fcbf68 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:39.550201 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c8dfc9-71f1-4ea1-9629-397a34fcbf68 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:39.640171 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c8dfc9-71f1-4ea1-9629-397a34fcbf68 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:39.640449 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd622e7-ef0a-457a-9e4c-0802cc23eafa None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:39.641806 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c8dfc9-71f1-4ea1-9629-397a34fcbf68 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:39.658528 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:39.683711 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc30ea4-d767-4a3b-98b7-65be6af4c5b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:39.684312 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc30ea4-d767-4a3b-98b7-65be6af4c5b6 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:39.684595 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc30ea4-d767-4a3b-98b7-65be6af4c5b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:39.684867 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc30ea4-d767-4a3b-98b7-65be6af4c5b6 None admin] PATH_INFO: `/v3/services` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:39.685474 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc30ea4-d767-4a3b-98b7-65be6af4c5b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:39.686929 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc30ea4-d767-4a3b-98b7-65be6af4c5b6 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:39.695017 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 457/906] 10.222.0.33 () {56 vars in 1087 bytes} [Tue Sep 20 22:11:39 2022] GET /identity/v3/services => generated 1497 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:11:39.768790 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 450/907] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 20 22:11:39 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 20 22:11:39.779030 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc30ea4-d767-4a3b-98b7-65be6af4c5b6 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:39.845439 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:39.893794 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc30ea4-d767-4a3b-98b7-65be6af4c5b6 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:39.929383 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aa9029-5a57-4adc-9d16-93bb8aa7e74d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:39.930028 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aa9029-5a57-4adc-9d16-93bb8aa7e74d None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:39.930300 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aa9029-5a57-4adc-9d16-93bb8aa7e74d None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:39.930594 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aa9029-5a57-4adc-9d16-93bb8aa7e74d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:39.941600 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aa9029-5a57-4adc-9d16-93bb8aa7e74d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:39.943765 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aa9029-5a57-4adc-9d16-93bb8aa7e74d None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:39.960027 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-00aa9029-5a57-4adc-9d16-93bb8aa7e74d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:11:39.960027 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:39.960027 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:39.960027 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:39.960027 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:39.960027 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:39.960027 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:39.960027 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:39.960027 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:39.960027 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:39.960027 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:39.960027 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:39.960027 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 22:11:39.960027 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 22:11:39.960027 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 22:11:39.960027 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 22:11:39.961016 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:39.961016 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:39.961016 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:39.961016 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:39.961016 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:39.961016 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:39.961016 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:39.961016 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:39.961016 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:39.961016 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:39.961016 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:39.961016 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:39.961016 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:39.961016 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:39.961016 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:39.961016 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:39.961016 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 22:11:39.961906 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 22:11:39.961906 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:11:39.961906 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:11:39.961906 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 458/908] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 20 22:11:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:39.968102 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c8dfc9-71f1-4ea1-9629-397a34fcbf68 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:40.071546 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c8dfc9-71f1-4ea1-9629-397a34fcbf68 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:40.083978 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:40.108173 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cde4099-6477-47e3-9b78-88218b56c8ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:40.108785 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cde4099-6477-47e3-9b78-88218b56c8ea None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:40.109062 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cde4099-6477-47e3-9b78-88218b56c8ea None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:40.109330 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cde4099-6477-47e3-9b78-88218b56c8ea None admin] PATH_INFO: `/v3/domains` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:40.109970 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cde4099-6477-47e3-9b78-88218b56c8ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:40.110270 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cde4099-6477-47e3-9b78-88218b56c8ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:40.111660 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cde4099-6477-47e3-9b78-88218b56c8ea None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:40.123948 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 451/909] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 20 22:11:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:40.129979 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aa9029-5a57-4adc-9d16-93bb8aa7e74d None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:40.236882 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aa9029-5a57-4adc-9d16-93bb8aa7e74d None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:40.244405 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:40.274372 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598a1bea-2cfb-45b0-8c5f-55e943bb1082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:40.275412 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598a1bea-2cfb-45b0-8c5f-55e943bb1082 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:40.275910 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598a1bea-2cfb-45b0-8c5f-55e943bb1082 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:40.276368 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598a1bea-2cfb-45b0-8c5f-55e943bb1082 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:40.283583 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598a1bea-2cfb-45b0-8c5f-55e943bb1082 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:40.285266 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598a1bea-2cfb-45b0-8c5f-55e943bb1082 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:40.297586 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-598a1bea-2cfb-45b0-8c5f-55e943bb1082 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 22:11:40.297586 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:40.297586 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:40.297586 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:40.297586 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:40.297586 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:40.297586 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:40.297586 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:40.297586 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:40.297586 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:40.297586 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:40.297586 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:40.297586 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 20 22:11:40.297586 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 20 22:11:40.297586 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 20 22:11:40.298564 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 20 22:11:40.298564 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:40.298564 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:40.298564 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:40.298564 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:40.298564 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:40.298564 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:40.298564 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:40.298564 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:40.298564 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:40.298564 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:40.298564 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:40.298564 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:40.298564 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:40.298564 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:40.298564 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:40.298564 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:40.299535 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 20 22:11:40.299535 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 20 22:11:40.299535 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 20 22:11:40.299535 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 20 22:11:40.299535 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 20 22:11:40.299535 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 20 22:11:40.299535 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 22:11:40.299535 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:11:40.302451 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 459/910] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Sep 20 22:11:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:40.311602 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cde4099-6477-47e3-9b78-88218b56c8ea None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:40.421221 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cde4099-6477-47e3-9b78-88218b56c8ea None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:40.461084 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5fdb44-46f2-48a3-83b8-a9274d8a0711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:40.461715 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5fdb44-46f2-48a3-83b8-a9274d8a0711 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:40.461995 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5fdb44-46f2-48a3-83b8-a9274d8a0711 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:40.462270 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5fdb44-46f2-48a3-83b8-a9274d8a0711 None admin] PATH_INFO: `/v3/projects` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:40.463015 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5fdb44-46f2-48a3-83b8-a9274d8a0711 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:40.463322 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5fdb44-46f2-48a3-83b8-a9274d8a0711 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:40.464779 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5fdb44-46f2-48a3-83b8-a9274d8a0711 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:40.479445 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 452/911] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Sep 20 22:11:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:40.485395 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598a1bea-2cfb-45b0-8c5f-55e943bb1082 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:40.557479 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cace135a-01bd-4da3-add4-792a841dc1ff None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:40.557832 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cace135a-01bd-4da3-add4-792a841dc1ff None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:40.558023 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cace135a-01bd-4da3-add4-792a841dc1ff None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:40.559509 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 453/912] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:11:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 20 22:11:40.564890 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e573655-8c86-4eaf-b0ea-5bc703412c84 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:40.565408 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e573655-8c86-4eaf-b0ea-5bc703412c84 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:40.565900 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e573655-8c86-4eaf-b0ea-5bc703412c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:40.585510 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-9e573655-8c86-4eaf-b0ea-5bc703412c84 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:11:40.587237 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-9e573655-8c86-4eaf-b0ea-5bc703412c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:11:40.592911 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598a1bea-2cfb-45b0-8c5f-55e943bb1082 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:40.616822 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:40.631233 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa529626-01b4-4f59-80f0-1d9de1604f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:40.632920 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa529626-01b4-4f59-80f0-1d9de1604f0e None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:40.633204 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa529626-01b4-4f59-80f0-1d9de1604f0e None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:40.633480 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa529626-01b4-4f59-80f0-1d9de1604f0e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:40.634303 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa529626-01b4-4f59-80f0-1d9de1604f0e None admin] RBAC: Adding query filter params (role.id=9fd7d9b8b5224290acc6e44595c9000b, scope.project.id=3ce415d02aa9489bae19cd514805fd8c, user.id=e916748fdee84c34af034e75a919b986) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:40.634639 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa529626-01b4-4f59-80f0-1d9de1604f0e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:40.636118 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa529626-01b4-4f59-80f0-1d9de1604f0e None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:40.644397 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 460/913] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Sep 20 22:11:40 2022] GET /identity/v3/role_assignments?user.id=e916748fdee84c34af034e75a919b986&scope.project.id=3ce415d02aa9489bae19cd514805fd8c&role.id=9fd7d9b8b5224290acc6e44595c9000b => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:40.673775 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 454/914] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:11:40 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 20 22:11:40.953661 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa529626-01b4-4f59-80f0-1d9de1604f0e None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:40.985758 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:41.059862 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa529626-01b4-4f59-80f0-1d9de1604f0e None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:41.098713 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890741ff-247d-47c8-b75f-210d7e77a323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:41.099339 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890741ff-247d-47c8-b75f-210d7e77a323 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:41.099615 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890741ff-247d-47c8-b75f-210d7e77a323 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:41.099879 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890741ff-247d-47c8-b75f-210d7e77a323 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:41.100449 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890741ff-247d-47c8-b75f-210d7e77a323 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:41.101806 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890741ff-247d-47c8-b75f-210d7e77a323 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:41.110411 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-890741ff-247d-47c8-b75f-210d7e77a323 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 20 22:11:41.110411 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:41.110411 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 20 22:11:41.110411 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 20 22:11:41.110411 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 20 22:11:41.110411 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 20 22:11:41.110411 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 20 22:11:41.110411 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 20 22:11:41.110411 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 20 22:11:41.110411 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:11:41.110411 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 20 22:11:41.110411 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:11:41.110411 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:41.110411 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:41.110411 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:41.110411 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:41.110411 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:41.111424 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:41.111424 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:41.111424 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:41.111424 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:41.111424 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:41.111424 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:41.111424 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 20 22:11:41.111424 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 20 22:11:41.111424 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 20 22:11:41.111424 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 20 22:11:41.111424 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:41.111424 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:41.111424 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:41.111424 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:41.111424 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:41.111424 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:41.112245 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:41.112245 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:41.112245 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:41.112245 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:41.112245 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:41.112245 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:41.112245 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:41.112245 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:41.112245 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:41.112245 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:41.112245 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 20 22:11:41.112245 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 20 22:11:41.112245 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 20 22:11:41.112245 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:11:41.112245 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 461/915] 10.222.0.33 () {56 vars in 1126 bytes} [Tue Sep 20 22:11:40 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:41.120204 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e573655-8c86-4eaf-b0ea-5bc703412c84 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:41.224586 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e573655-8c86-4eaf-b0ea-5bc703412c84 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:41.260607 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01545add-7263-47de-ab98-30e6d568b0e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:41.261215 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01545add-7263-47de-ab98-30e6d568b0e4 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:41.261491 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01545add-7263-47de-ab98-30e6d568b0e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:41.261764 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01545add-7263-47de-ab98-30e6d568b0e4 None admin] PATH_INFO: `/v3/services` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:41.262385 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01545add-7263-47de-ab98-30e6d568b0e4 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:41.262707 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01545add-7263-47de-ab98-30e6d568b0e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:41.264060 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01545add-7263-47de-ab98-30e6d568b0e4 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:41.269045 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 455/916] 10.222.0.33 () {56 vars in 1122 bytes} [Tue Sep 20 22:11:41 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:41.275563 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890741ff-247d-47c8-b75f-210d7e77a323 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:41.385349 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:41.393826 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890741ff-247d-47c8-b75f-210d7e77a323 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:41.430716 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1638733-a7be-41b6-ac17-1c441b027429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:41.431740 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1638733-a7be-41b6-ac17-1c441b027429 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:41.432219 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1638733-a7be-41b6-ac17-1c441b027429 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:41.432695 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1638733-a7be-41b6-ac17-1c441b027429 None admin] PATH_INFO: `/v3/services` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:41.433517 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1638733-a7be-41b6-ac17-1c441b027429 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:41.434038 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1638733-a7be-41b6-ac17-1c441b027429 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:41.435626 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1638733-a7be-41b6-ac17-1c441b027429 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:41.441405 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 462/917] 10.222.0.33 () {56 vars in 1122 bytes} [Tue Sep 20 22:11:41 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:41.447581 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01545add-7263-47de-ab98-30e6d568b0e4 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:41.476621 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:41.555669 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01545add-7263-47de-ab98-30e6d568b0e4 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:41.594824 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b8fe7a-fbbf-4829-8fb6-57c85c89f9a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:41.595436 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b8fe7a-fbbf-4829-8fb6-57c85c89f9a8 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:41.595711 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b8fe7a-fbbf-4829-8fb6-57c85c89f9a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:41.595980 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b8fe7a-fbbf-4829-8fb6-57c85c89f9a8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:41.596673 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b8fe7a-fbbf-4829-8fb6-57c85c89f9a8 None admin] RBAC: Adding query filter params (interface=public, service_id=b6c846dd569948c3ab097d329d3ef727, region_id=RegionOne) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:41.596976 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b8fe7a-fbbf-4829-8fb6-57c85c89f9a8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:41.598874 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b8fe7a-fbbf-4829-8fb6-57c85c89f9a8 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:41.604643 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 456/918] 10.222.0.33 () {56 vars in 1251 bytes} [Tue Sep 20 22:11:41 2022] GET /identity/v3/endpoints?service_id=b6c846dd569948c3ab097d329d3ef727&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:41.610561 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1638733-a7be-41b6-ac17-1c441b027429 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:41.724252 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1638733-a7be-41b6-ac17-1c441b027429 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:41.761459 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda6efbf-9051-442a-b461-1501042c4ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:41.761982 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda6efbf-9051-442a-b461-1501042c4ef6 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:41.762258 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda6efbf-9051-442a-b461-1501042c4ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:41.762542 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda6efbf-9051-442a-b461-1501042c4ef6 None admin] PATH_INFO: `/v3/services` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:41.763150 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda6efbf-9051-442a-b461-1501042c4ef6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:41.764501 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda6efbf-9051-442a-b461-1501042c4ef6 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:41.771393 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 463/919] 10.222.0.33 () {56 vars in 1087 bytes} [Tue Sep 20 22:11:41 2022] GET /identity/v3/services => generated 1497 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:11:41.830182 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4083f8-fff4-4945-bc57-0d58781a3387 None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:41.830735 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4083f8-fff4-4945-bc57-0d58781a3387 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:41.830735 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4083f8-fff4-4945-bc57-0d58781a3387 None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:41.832522 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 457/920] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:11:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:11:41.838578 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc126f9d-4951-451f-b746-ba90582af5bb None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:41.838887 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc126f9d-4951-451f-b746-ba90582af5bb None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:41.839136 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc126f9d-4951-451f-b746-ba90582af5bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:41.858953 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-bc126f9d-4951-451f-b746-ba90582af5bb None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:11:41.860162 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-bc126f9d-4951-451f-b746-ba90582af5bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:11:41.881662 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:41.936903 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5d8393-ae81-4658-8411-e3bd8c7afc09 None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:41.937269 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5d8393-ae81-4658-8411-e3bd8c7afc09 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:41.937449 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5d8393-ae81-4658-8411-e3bd8c7afc09 None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:41.938440 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 464/921] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:11:41 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 20 22:11:41.940334 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 458/922] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:11:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:11:41.945561 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef853326-542d-4ad0-93da-b6a85beb09cb None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:41.945849 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef853326-542d-4ad0-93da-b6a85beb09cb None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:41.946125 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef853326-542d-4ad0-93da-b6a85beb09cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:41.965191 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-ef853326-542d-4ad0-93da-b6a85beb09cb None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:11:41.966642 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-ef853326-542d-4ad0-93da-b6a85beb09cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:11:42.036778 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 465/923] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:11:41 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 20 22:11:42.214957 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5d8393-ae81-4658-8411-e3bd8c7afc09 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:42.305648 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef853326-542d-4ad0-93da-b6a85beb09cb None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:42.310878 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:42.326635 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5d8393-ae81-4658-8411-e3bd8c7afc09 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:42.373614 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c755af91-dde4-476e-9b17-aa7819c9ebaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:42.375155 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c755af91-dde4-476e-9b17-aa7819c9ebaf None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:42.375600 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c755af91-dde4-476e-9b17-aa7819c9ebaf None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:42.376030 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c755af91-dde4-476e-9b17-aa7819c9ebaf None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:42.377004 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c755af91-dde4-476e-9b17-aa7819c9ebaf None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:42.379203 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c755af91-dde4-476e-9b17-aa7819c9ebaf None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:42.391561 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-c755af91-dde4-476e-9b17-aa7819c9ebaf None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 20 22:11:42.391561 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:42.391561 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 20 22:11:42.391561 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 20 22:11:42.391561 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 20 22:11:42.391561 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 20 22:11:42.391561 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 20 22:11:42.391561 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 20 22:11:42.391561 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 20 22:11:42.391561 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:11:42.391561 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 20 22:11:42.391561 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:11:42.391561 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:42.391561 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:42.391561 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:42.391561 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:42.392695 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:42.392695 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:42.392695 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:42.392695 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:42.392695 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:42.392695 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:42.392695 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:42.392695 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 20 22:11:42.392695 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 20 22:11:42.392695 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 20 22:11:42.392695 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 20 22:11:42.392695 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:42.392695 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:42.392695 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:42.392695 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:42.392695 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:42.392695 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:42.393853 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:42.393853 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:42.393853 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:42.393853 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:42.393853 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:42.393853 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:42.393853 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:42.393853 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:42.393853 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:42.393853 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:42.393853 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 20 22:11:42.393853 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 20 22:11:42.393853 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 20 22:11:42.393853 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:11:42.397211 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 459/924] 10.222.0.33 () {56 vars in 1132 bytes} [Tue Sep 20 22:11:42 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:42.402521 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c755af91-dde4-476e-9b17-aa7819c9ebaf None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:42.404069 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:42.433317 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef853326-542d-4ad0-93da-b6a85beb09cb None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:42.481248 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7693d760-22b8-4e84-b169-b764128778d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:42.482204 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7693d760-22b8-4e84-b169-b764128778d8 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:42.482658 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7693d760-22b8-4e84-b169-b764128778d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:42.483067 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7693d760-22b8-4e84-b169-b764128778d8 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:42.483815 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7693d760-22b8-4e84-b169-b764128778d8 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:42.485910 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7693d760-22b8-4e84-b169-b764128778d8 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:42.499711 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-7693d760-22b8-4e84-b169-b764128778d8 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 20 22:11:42.499711 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:42.499711 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 20 22:11:42.499711 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 20 22:11:42.499711 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 20 22:11:42.499711 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 20 22:11:42.499711 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 20 22:11:42.499711 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 20 22:11:42.499711 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 20 22:11:42.499711 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:11:42.499711 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 20 22:11:42.499711 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:11:42.499711 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:42.499711 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:42.499711 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:42.499711 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:42.499711 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:42.500925 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:42.500925 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:42.500925 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:42.500925 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:42.500925 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:42.500925 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:42.500925 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 20 22:11:42.500925 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 20 22:11:42.500925 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 20 22:11:42.500925 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 20 22:11:42.500925 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:42.500925 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:42.500925 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:42.500925 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:42.500925 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:42.500925 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:42.501936 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:42.501936 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:42.501936 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:42.501936 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:42.501936 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:42.501936 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:42.501936 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:42.501936 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:42.501936 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:42.501936 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:42.501936 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 20 22:11:42.501936 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 20 22:11:42.501936 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 20 22:11:42.501936 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:11:42.504708 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 466/925] 10.222.0.33 () {56 vars in 1114 bytes} [Tue Sep 20 22:11:42 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 20 22:11:42.510888 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7693d760-22b8-4e84-b169-b764128778d8 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:42.519206 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c755af91-dde4-476e-9b17-aa7819c9ebaf None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:42.566644 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd8ad72-55f8-488a-9450-db1d1f8e46cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:42.567759 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd8ad72-55f8-488a-9450-db1d1f8e46cb None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:42.568185 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd8ad72-55f8-488a-9450-db1d1f8e46cb None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:42.568983 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd8ad72-55f8-488a-9450-db1d1f8e46cb None admin] PATH_INFO: `/v3/services` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:42.569776 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd8ad72-55f8-488a-9450-db1d1f8e46cb None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:42.570222 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd8ad72-55f8-488a-9450-db1d1f8e46cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:42.572443 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd8ad72-55f8-488a-9450-db1d1f8e46cb None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:42.580108 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 460/926] 10.222.0.33 () {56 vars in 1126 bytes} [Tue Sep 20 22:11:42 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 22:11:42.587305 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd8ad72-55f8-488a-9450-db1d1f8e46cb None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:42.607272 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:42.644771 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7693d760-22b8-4e84-b169-b764128778d8 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:42.692693 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d708277-66af-4a49-ab90-5c147cd51fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:42.693856 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d708277-66af-4a49-ab90-5c147cd51fed None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:42.694318 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d708277-66af-4a49-ab90-5c147cd51fed None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:42.694801 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d708277-66af-4a49-ab90-5c147cd51fed None admin] PATH_INFO: `/v3/services` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:42.695316 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd8ad72-55f8-488a-9450-db1d1f8e46cb None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:42.695793 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d708277-66af-4a49-ab90-5c147cd51fed None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:42.696283 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d708277-66af-4a49-ab90-5c147cd51fed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:42.699023 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d708277-66af-4a49-ab90-5c147cd51fed None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:42.708801 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 467/927] 10.222.0.33 () {56 vars in 1114 bytes} [Tue Sep 20 22:11:42 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:42.714441 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d708277-66af-4a49-ab90-5c147cd51fed None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:42.728993 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:42.743565 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d8919b-b340-4d75-9237-ca367f600e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:42.744977 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d8919b-b340-4d75-9237-ca367f600e67 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:42.745433 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d8919b-b340-4d75-9237-ca367f600e67 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:42.745892 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d8919b-b340-4d75-9237-ca367f600e67 None admin] PATH_INFO: `/v3/services` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:42.746852 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d8919b-b340-4d75-9237-ca367f600e67 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:42.747575 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d8919b-b340-4d75-9237-ca367f600e67 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:42.749512 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d8919b-b340-4d75-9237-ca367f600e67 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:42.760728 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 461/928] 10.222.0.33 () {56 vars in 1126 bytes} [Tue Sep 20 22:11:42 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 22:11:42.761707 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d8919b-b340-4d75-9237-ca367f600e67 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:42.823839 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d708277-66af-4a49-ab90-5c147cd51fed None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:42.863029 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16475be-5796-4c4f-961f-41407137a729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:42.863732 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16475be-5796-4c4f-961f-41407137a729 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:42.864008 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16475be-5796-4c4f-961f-41407137a729 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:42.864277 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16475be-5796-4c4f-961f-41407137a729 None admin] PATH_INFO: `/v3/services` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:42.864919 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16475be-5796-4c4f-961f-41407137a729 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:42.865276 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16475be-5796-4c4f-961f-41407137a729 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:42.866758 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16475be-5796-4c4f-961f-41407137a729 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:42.876046 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:42.877769 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 468/929] 10.222.0.33 () {56 vars in 1114 bytes} [Tue Sep 20 22:11:42 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 22:11:42.879333 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16475be-5796-4c4f-961f-41407137a729 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:42.904834 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d8919b-b340-4d75-9237-ca367f600e67 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:42.943443 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710171a8-1ef5-4ab5-8ae2-52cf040bce33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:42.944097 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710171a8-1ef5-4ab5-8ae2-52cf040bce33 None admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:42.944379 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710171a8-1ef5-4ab5-8ae2-52cf040bce33 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:42.944653 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710171a8-1ef5-4ab5-8ae2-52cf040bce33 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:42.945384 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710171a8-1ef5-4ab5-8ae2-52cf040bce33 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:42.947087 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710171a8-1ef5-4ab5-8ae2-52cf040bce33 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:42.977848 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 462/930] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 20 22:11:42 2022] POST /identity/v3/endpoints => generated 347 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:11:42.979472 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d2fb41-cf14-4dea-ae47-c8c1918eb6ed None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:42.979957 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d2fb41-cf14-4dea-ae47-c8c1918eb6ed None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:42.980425 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d2fb41-cf14-4dea-ae47-c8c1918eb6ed None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:42.982816 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 463/931] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:11:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:11:42.983628 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:42.989776 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a19e9dc-3b95-460e-a04f-084b5423de2c None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:42.990242 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a19e9dc-3b95-460e-a04f-084b5423de2c None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:42.990946 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a19e9dc-3b95-460e-a04f-084b5423de2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:43.011559 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16475be-5796-4c4f-961f-41407137a729 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:43.018523 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-8a19e9dc-3b95-460e-a04f-084b5423de2c None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:11:43.021761 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-8a19e9dc-3b95-460e-a04f-084b5423de2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:11:43.060066 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ec00ce-a5b6-40fe-8aad-a4735ed18d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:43.060812 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ec00ce-a5b6-40fe-8aad-a4735ed18d20 None admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:43.061095 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ec00ce-a5b6-40fe-8aad-a4735ed18d20 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:43.061370 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ec00ce-a5b6-40fe-8aad-a4735ed18d20 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:43.062262 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ec00ce-a5b6-40fe-8aad-a4735ed18d20 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:43.063775 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ec00ce-a5b6-40fe-8aad-a4735ed18d20 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:43.094618 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 469/932] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 20 22:11:42 2022] POST /identity/v3/endpoints => generated 346 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:11:43.123540 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 464/933] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:11:42 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 20 22:11:43.397774 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ec00ce-a5b6-40fe-8aad-a4735ed18d20 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:43.511500 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ec00ce-a5b6-40fe-8aad-a4735ed18d20 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:43.540120 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:43.552109 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b58b42-d5bf-40fc-94f6-ada9b755b629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:43.553154 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b58b42-d5bf-40fc-94f6-ada9b755b629 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:43.553637 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b58b42-d5bf-40fc-94f6-ada9b755b629 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:43.554464 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b58b42-d5bf-40fc-94f6-ada9b755b629 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:43.567356 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b58b42-d5bf-40fc-94f6-ada9b755b629 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 22:11:43.573688 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-43b58b42-d5bf-40fc-94f6-ada9b755b629 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 20 22:11:43.573688 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:43.573688 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:43.573688 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:43.573688 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:43.573688 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:43.573688 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:43.573688 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:43.573688 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:43.573688 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:43.573688 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:43.573688 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:43.573688 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 22:11:43.573688 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 22:11:43.573688 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 22:11:43.573688 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 22:11:43.574670 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 22:11:43.574670 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 22:11:43.574670 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 22:11:43.574670 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 22:11:43.574670 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:43.574670 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:43.574670 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:43.574670 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:43.574670 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:43.574670 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:43.574670 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:43.574670 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:43.574670 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:43.574670 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:43.574670 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:43.574670 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:43.575488 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:43.575488 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:43.575488 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:43.575488 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:43.575488 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 22:11:43.575488 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 22:11:43.575488 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 22:11:43.575488 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 22:11:43.575488 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 22:11:43.575488 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 22:11:43.575488 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 20 22:11:43.575488 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:11:43.578110 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 470/934] 10.222.0.33 () {56 vars in 1120 bytes} [Tue Sep 20 22:11:43 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:43.585517 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a19e9dc-3b95-460e-a04f-084b5423de2c None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:43.651227 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:43.694580 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a19e9dc-3b95-460e-a04f-084b5423de2c None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:43.730032 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259dc59a-36fb-4cbd-8d30-c1bda9a150c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:43.730691 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259dc59a-36fb-4cbd-8d30-c1bda9a150c6 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:43.730975 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259dc59a-36fb-4cbd-8d30-c1bda9a150c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:43.731248 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259dc59a-36fb-4cbd-8d30-c1bda9a150c6 None admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:43.731919 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259dc59a-36fb-4cbd-8d30-c1bda9a150c6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:43.732224 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259dc59a-36fb-4cbd-8d30-c1bda9a150c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:43.733597 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259dc59a-36fb-4cbd-8d30-c1bda9a150c6 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:43.742766 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 465/935] 10.222.0.33 () {56 vars in 1115 bytes} [Tue Sep 20 22:11:43 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 22:11:43.748301 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b58b42-d5bf-40fc-94f6-ada9b755b629 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:43.854032 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b58b42-d5bf-40fc-94f6-ada9b755b629 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:43.892192 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15835e1-c47e-46d3-953f-7eb953643bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:43.893225 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15835e1-c47e-46d3-953f-7eb953643bc8 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:43.893700 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15835e1-c47e-46d3-953f-7eb953643bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:43.894270 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15835e1-c47e-46d3-953f-7eb953643bc8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:43.907777 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15835e1-c47e-46d3-953f-7eb953643bc8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:43.909582 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15835e1-c47e-46d3-953f-7eb953643bc8 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:43.926710 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-c15835e1-c47e-46d3-953f-7eb953643bc8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:11:43.926710 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:43.926710 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:43.926710 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:43.926710 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:43.926710 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:43.926710 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:43.926710 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:43.926710 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:43.926710 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:43.926710 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:43.926710 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:43.926710 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 22:11:43.926710 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 22:11:43.926710 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 22:11:43.926710 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 22:11:43.927703 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:43.927703 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:43.927703 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:43.927703 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:43.927703 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:43.927703 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:43.927703 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:43.927703 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:43.927703 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:43.927703 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:43.927703 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:43.927703 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:43.927703 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:43.927703 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:43.927703 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:43.927703 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:43.927703 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 22:11:43.928580 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 22:11:43.928580 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:11:43.928580 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:11:43.931036 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 471/936] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 20 22:11:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:43.937285 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259dc59a-36fb-4cbd-8d30-c1bda9a150c6 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:44.005339 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61646147-7f33-40f7-a96e-69bd3bbe5466 None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:44.005648 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61646147-7f33-40f7-a96e-69bd3bbe5466 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:44.005912 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61646147-7f33-40f7-a96e-69bd3bbe5466 None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:44.007502 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 472/937] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:11:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 20 22:11:44.012472 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e02c160-2815-4f41-8fac-6f4e22fdfa8c None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:44.012755 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e02c160-2815-4f41-8fac-6f4e22fdfa8c None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:44.013031 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e02c160-2815-4f41-8fac-6f4e22fdfa8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:44.044343 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-6e02c160-2815-4f41-8fac-6f4e22fdfa8c None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:11:44.045346 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259dc59a-36fb-4cbd-8d30-c1bda9a150c6 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:44.046095 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-6e02c160-2815-4f41-8fac-6f4e22fdfa8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:11:44.071591 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:44.085229 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1b9e5a-e61f-485a-8a48-d9fc55cc48c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:44.085885 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1b9e5a-e61f-485a-8a48-d9fc55cc48c7 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:44.086194 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1b9e5a-e61f-485a-8a48-d9fc55cc48c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:44.086475 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1b9e5a-e61f-485a-8a48-d9fc55cc48c7 None admin] PATH_INFO: `/v3/domains` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:44.087247 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1b9e5a-e61f-485a-8a48-d9fc55cc48c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:44.087560 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1b9e5a-e61f-485a-8a48-d9fc55cc48c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:44.089152 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1b9e5a-e61f-485a-8a48-d9fc55cc48c7 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:44.090388 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:44.105944 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 466/938] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 20 22:11:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:44.111421 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1b9e5a-e61f-485a-8a48-d9fc55cc48c7 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:44.148262 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 473/939] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:11:44 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 20 22:11:44.224902 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1b9e5a-e61f-485a-8a48-d9fc55cc48c7 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:44.260043 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6447f47a-6f68-40f1-82cd-ca323af49b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:44.261019 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6447f47a-6f68-40f1-82cd-ca323af49b15 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:44.261494 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6447f47a-6f68-40f1-82cd-ca323af49b15 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:44.261975 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6447f47a-6f68-40f1-82cd-ca323af49b15 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:44.270330 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6447f47a-6f68-40f1-82cd-ca323af49b15 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:44.272008 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6447f47a-6f68-40f1-82cd-ca323af49b15 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:44.283877 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-6447f47a-6f68-40f1-82cd-ca323af49b15 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 20 22:11:44.283877 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:44.283877 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:44.283877 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:44.283877 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:44.283877 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:44.283877 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:44.283877 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:44.283877 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:44.283877 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:44.283877 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:44.283877 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:44.283877 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 20 22:11:44.283877 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 20 22:11:44.283877 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 20 22:11:44.283877 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 20 22:11:44.284798 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:44.284798 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:44.284798 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 20 22:11:44.284798 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 22:11:44.284798 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 20 22:11:44.284798 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 22:11:44.284798 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:44.284798 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:44.284798 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:44.284798 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:44.284798 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:44.284798 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:44.284798 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:44.284798 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:44.284798 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:44.284798 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:44.284798 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:44.284798 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:44.286346 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:44.286346 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:44.286346 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 20 22:11:44.286346 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 20 22:11:44.286346 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 20 22:11:44.286346 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 20 22:11:44.286346 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 20 22:11:44.286346 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 20 22:11:44.286346 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 20 22:11:44.286346 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:11:44.288797 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 467/940] 10.222.0.33 () {56 vars in 1117 bytes} [Tue Sep 20 22:11:44 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:44.294679 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e02c160-2815-4f41-8fac-6f4e22fdfa8c None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:44.398297 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e02c160-2815-4f41-8fac-6f4e22fdfa8c None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:44.413942 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6447f47a-6f68-40f1-82cd-ca323af49b15 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:44.436434 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a282627-ef4f-445d-b493-595eda46fc62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:44.437048 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a282627-ef4f-445d-b493-595eda46fc62 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:44.437326 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a282627-ef4f-445d-b493-595eda46fc62 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:44.437598 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a282627-ef4f-445d-b493-595eda46fc62 None admin] PATH_INFO: `/v3/users` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:44.438429 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a282627-ef4f-445d-b493-595eda46fc62 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:44.438768 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a282627-ef4f-445d-b493-595eda46fc62 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:44.440290 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a282627-ef4f-445d-b493-595eda46fc62 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:44.459832 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 474/941] 10.222.0.33 () {56 vars in 1149 bytes} [Tue Sep 20 22:11:44 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:44.466080 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a282627-ef4f-445d-b493-595eda46fc62 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:44.477672 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:44.505107 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:44.540866 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6447f47a-6f68-40f1-82cd-ca323af49b15 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:44.589680 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f4ed21-894d-42f5-b282-b3afb63ef383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:44.590721 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f4ed21-894d-42f5-b282-b3afb63ef383 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:44.591104 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f4ed21-894d-42f5-b282-b3afb63ef383 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:44.591466 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f4ed21-894d-42f5-b282-b3afb63ef383 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:44.592159 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f4ed21-894d-42f5-b282-b3afb63ef383 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:44.592894 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a282627-ef4f-445d-b493-595eda46fc62 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:44.593684 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f4ed21-894d-42f5-b282-b3afb63ef383 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:44.605566 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-99f4ed21-894d-42f5-b282-b3afb63ef383 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 20 22:11:44.605566 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:44.605566 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 20 22:11:44.605566 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 20 22:11:44.605566 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 20 22:11:44.605566 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 20 22:11:44.605566 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 20 22:11:44.605566 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 20 22:11:44.605566 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 20 22:11:44.605566 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:11:44.605566 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 20 22:11:44.605566 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:11:44.605566 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:44.605566 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:44.605566 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:44.605566 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:44.605566 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:44.606603 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:44.606603 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:44.606603 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:44.606603 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:44.606603 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:44.606603 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:44.606603 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 20 22:11:44.606603 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 20 22:11:44.606603 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 20 22:11:44.606603 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 20 22:11:44.606603 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:44.606603 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:44.606603 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:44.606603 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:44.606603 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:44.606603 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:44.607431 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:44.607431 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:44.607431 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:44.607431 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:44.607431 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:44.607431 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:44.607431 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:44.607431 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:44.607431 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:44.607431 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:44.607431 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 20 22:11:44.607431 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 20 22:11:44.607431 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 20 22:11:44.607431 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:11:44.607431 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 468/942] 10.222.0.33 () {56 vars in 1126 bytes} [Tue Sep 20 22:11:44 2022] GET /identity/v3/services/object-store => generated 93 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 20 22:11:44.614226 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f4ed21-894d-42f5-b282-b3afb63ef383 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:44.636464 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1729e5-5901-4583-a980-722bd6f55d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:44.637309 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1729e5-5901-4583-a980-722bd6f55d85 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:44.637753 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1729e5-5901-4583-a980-722bd6f55d85 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:44.638222 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1729e5-5901-4583-a980-722bd6f55d85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:44.649438 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1729e5-5901-4583-a980-722bd6f55d85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:44.651128 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1729e5-5901-4583-a980-722bd6f55d85 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:44.669186 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-0f1729e5-5901-4583-a980-722bd6f55d85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:11:44.669186 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:44.669186 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:44.669186 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:44.669186 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:44.669186 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:44.669186 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:44.669186 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:44.669186 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:44.669186 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:44.669186 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:44.669186 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:44.669186 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 22:11:44.669186 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 22:11:44.669186 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 22:11:44.669186 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 22:11:44.670151 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:44.670151 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:44.670151 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:44.670151 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:44.670151 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:44.670151 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:44.670151 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:44.670151 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:44.670151 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:44.670151 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:44.670151 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:44.670151 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:44.670151 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:44.670151 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:44.670151 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:44.670151 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:44.670151 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 22:11:44.671063 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 22:11:44.671063 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:11:44.671063 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:11:44.673176 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 475/943] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 20 22:11:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 20 22:11:44.679013 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1729e5-5901-4583-a980-722bd6f55d85 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:44.756532 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f4ed21-894d-42f5-b282-b3afb63ef383 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:44.766433 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:44.770493 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:44.793249 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1729e5-5901-4583-a980-722bd6f55d85 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:44.803796 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8834c28-0e15-4a98-8c9d-c2600e7559c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:44.805242 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8834c28-0e15-4a98-8c9d-c2600e7559c5 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:44.805880 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8834c28-0e15-4a98-8c9d-c2600e7559c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:44.806469 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8834c28-0e15-4a98-8c9d-c2600e7559c5 None admin] PATH_INFO: `/v3/services` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:44.807361 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8834c28-0e15-4a98-8c9d-c2600e7559c5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:44.807982 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8834c28-0e15-4a98-8c9d-c2600e7559c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:44.810229 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8834c28-0e15-4a98-8c9d-c2600e7559c5 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:44.816657 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 469/944] 10.222.0.33 () {56 vars in 1122 bytes} [Tue Sep 20 22:11:44 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:44.822582 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8834c28-0e15-4a98-8c9d-c2600e7559c5 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:44.833689 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfc561b-37db-412b-a78e-46474af580de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:44.834093 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfc561b-37db-412b-a78e-46474af580de None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:44.834376 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfc561b-37db-412b-a78e-46474af580de None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:44.834704 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfc561b-37db-412b-a78e-46474af580de None admin] PATH_INFO: `/v3/domains` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:44.835355 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfc561b-37db-412b-a78e-46474af580de None admin] RBAC: Adding query filter params (name=Default) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:44.835657 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfc561b-37db-412b-a78e-46474af580de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:44.837020 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfc561b-37db-412b-a78e-46474af580de None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:44.850568 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 476/945] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 20 22:11:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 22:11:44.855773 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfc561b-37db-412b-a78e-46474af580de None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:44.955547 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8834c28-0e15-4a98-8c9d-c2600e7559c5 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:44.972307 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfc561b-37db-412b-a78e-46474af580de None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:44.998039 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50637b2f-f586-4c29-819e-62df401e79b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:44.999176 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50637b2f-f586-4c29-819e-62df401e79b4 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:44.999617 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50637b2f-f586-4c29-819e-62df401e79b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:44.999960 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50637b2f-f586-4c29-819e-62df401e79b4 None admin] PATH_INFO: `/v3/services` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:45.000655 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50637b2f-f586-4c29-819e-62df401e79b4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:45.001166 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50637b2f-f586-4c29-819e-62df401e79b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:45.003210 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50637b2f-f586-4c29-819e-62df401e79b4 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:45.010606 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 470/946] 10.222.0.33 () {56 vars in 1122 bytes} [Tue Sep 20 22:11:44 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:45.015206 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ba353e-e033-4361-8af0-733b00a0305e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:45.015467 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50637b2f-f586-4c29-819e-62df401e79b4 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:45.016101 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ba353e-e033-4361-8af0-733b00a0305e None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:45.016476 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ba353e-e033-4361-8af0-733b00a0305e None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:45.016841 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ba353e-e033-4361-8af0-733b00a0305e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:45.025843 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ba353e-e033-4361-8af0-733b00a0305e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:45.027538 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ba353e-e033-4361-8af0-733b00a0305e None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:45.029597 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:45.043229 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-03ba353e-e033-4361-8af0-733b00a0305e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 22:11:45.043229 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:45.043229 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:45.043229 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:45.043229 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:45.043229 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:45.043229 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:45.043229 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:45.043229 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:45.043229 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:45.043229 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:45.043229 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:45.043229 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 20 22:11:45.043229 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 20 22:11:45.043229 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 20 22:11:45.044322 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 20 22:11:45.044322 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:45.044322 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:45.044322 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:45.044322 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:45.044322 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:45.044322 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:45.044322 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:45.044322 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:45.044322 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:45.044322 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:45.044322 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:45.044322 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:45.044322 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:45.044322 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:45.044322 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:45.044322 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:45.045406 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 20 22:11:45.045406 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 20 22:11:45.045406 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 20 22:11:45.045406 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 20 22:11:45.045406 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 20 22:11:45.045406 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 20 22:11:45.045406 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 22:11:45.045406 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:11:45.047070 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 477/947] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Sep 20 22:11:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 20 22:11:45.052880 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ba353e-e033-4361-8af0-733b00a0305e None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:45.066712 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:45.155837 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50637b2f-f586-4c29-819e-62df401e79b4 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:45.173204 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ba353e-e033-4361-8af0-733b00a0305e None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:45.204313 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73d4760-cbc5-4927-b0c2-1bd5c9725117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:45.205806 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73d4760-cbc5-4927-b0c2-1bd5c9725117 None admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:45.206357 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73d4760-cbc5-4927-b0c2-1bd5c9725117 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:45.206903 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73d4760-cbc5-4927-b0c2-1bd5c9725117 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:45.208561 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73d4760-cbc5-4927-b0c2-1bd5c9725117 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:45.210380 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73d4760-cbc5-4927-b0c2-1bd5c9725117 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:45.210489 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d77853-c4b6-4319-9e30-f52725f32691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:45.211192 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d77853-c4b6-4319-9e30-f52725f32691 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:45.211553 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d77853-c4b6-4319-9e30-f52725f32691 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:45.211893 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d77853-c4b6-4319-9e30-f52725f32691 None admin] PATH_INFO: `/v3/projects` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:45.212654 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d77853-c4b6-4319-9e30-f52725f32691 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:45.213023 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d77853-c4b6-4319-9e30-f52725f32691 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:45.214595 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d77853-c4b6-4319-9e30-f52725f32691 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:45.234446 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 478/948] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Sep 20 22:11:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 22:11:45.236034 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a4747d-6668-4c8e-b0d7-37b50b7ab544 None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:45.236316 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a4747d-6668-4c8e-b0d7-37b50b7ab544 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:45.236582 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a4747d-6668-4c8e-b0d7-37b50b7ab544 None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:45.238051 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 479/949] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:11:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:11:45.238632 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 471/950] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 20 22:11:45 2022] POST /identity/v3/endpoints => generated 349 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 20 22:11:45.238773 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a4747d-6668-4c8e-b0d7-37b50b7ab544 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:45.244139 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51477b2b-d60b-4660-a3a5-d313ee521d9c None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:45.244429 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51477b2b-d60b-4660-a3a5-d313ee521d9c None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:45.244730 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51477b2b-d60b-4660-a3a5-d313ee521d9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:45.268767 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-51477b2b-d60b-4660-a3a5-d313ee521d9c None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:11:45.270759 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-51477b2b-d60b-4660-a3a5-d313ee521d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:11:45.334140 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:45.394534 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 472/951] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:11:45 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 20 22:11:45.399378 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a4747d-6668-4c8e-b0d7-37b50b7ab544 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:45.417675 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c87ce4b-c269-409c-8c58-27c56cc11e41 None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:45.417965 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c87ce4b-c269-409c-8c58-27c56cc11e41 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:45.418246 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c87ce4b-c269-409c-8c58-27c56cc11e41 None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:45.419779 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 473/952] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:11:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 20 22:11:45.424910 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9996a2-9356-4aae-8966-72d84ac3ed35 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:45.425198 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9996a2-9356-4aae-8966-72d84ac3ed35 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:45.425476 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9996a2-9356-4aae-8966-72d84ac3ed35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:45.447109 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-7d9996a2-9356-4aae-8966-72d84ac3ed35 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:11:45.448800 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-7d9996a2-9356-4aae-8966-72d84ac3ed35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:11:45.452654 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2a5e0f-ceba-4bb9-9db1-102b9de36fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:45.453325 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2a5e0f-ceba-4bb9-9db1-102b9de36fc8 None admin] REQUEST_METHOD: `PUT` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:45.453601 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2a5e0f-ceba-4bb9-9db1-102b9de36fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:45.453874 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2a5e0f-ceba-4bb9-9db1-102b9de36fc8 None admin] PATH_INFO: `/v3/projects/3ce415d02aa9489bae19cd514805fd8c/users/e916748fdee84c34af034e75a919b986/roles/9fd7d9b8b5224290acc6e44595c9000b` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:45.458895 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2a5e0f-ceba-4bb9-9db1-102b9de36fc8 None admin] RBAC: Authorizing `identity:create_grant(project_id=3ce415d02aa9489bae19cd514805fd8c, user_id=e916748fdee84c34af034e75a919b986, role_id=9fd7d9b8b5224290acc6e44595c9000b)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:45.460378 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2a5e0f-ceba-4bb9-9db1-102b9de36fc8 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:45.463107 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:45.476913 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 480/953] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Sep 20 22:11:45 2022] PUT /identity/v3/projects/3ce415d02aa9489bae19cd514805fd8c/users/e916748fdee84c34af034e75a919b986/roles/9fd7d9b8b5224290acc6e44595c9000b => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:11:45.542760 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 474/954] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:11:45 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 20 22:11:45.671076 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2a5e0f-ceba-4bb9-9db1-102b9de36fc8 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:45.780197 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2a5e0f-ceba-4bb9-9db1-102b9de36fc8 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:45.800105 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:45.818487 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9259a1e-47c8-4da6-9bb1-910d50bddec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:45.819152 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9259a1e-47c8-4da6-9bb1-910d50bddec2 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:45.819434 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9259a1e-47c8-4da6-9bb1-910d50bddec2 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:45.819709 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9259a1e-47c8-4da6-9bb1-910d50bddec2 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:45.820291 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9259a1e-47c8-4da6-9bb1-910d50bddec2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:45.821651 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9259a1e-47c8-4da6-9bb1-910d50bddec2 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:45.829580 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9996a2-9356-4aae-8966-72d84ac3ed35 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:45.831153 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-e9259a1e-47c8-4da6-9bb1-910d50bddec2 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 20 22:11:45.831153 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:45.831153 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 20 22:11:45.831153 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 20 22:11:45.831153 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 20 22:11:45.831153 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 20 22:11:45.831153 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 20 22:11:45.831153 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 20 22:11:45.831153 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 20 22:11:45.831153 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:11:45.831153 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 20 22:11:45.831153 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:11:45.831153 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:45.831153 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:45.831153 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:45.831153 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:45.831153 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:45.832121 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:45.832121 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:45.832121 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:45.832121 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:45.832121 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:45.832121 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:45.832121 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 20 22:11:45.832121 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 20 22:11:45.832121 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 20 22:11:45.832121 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 20 22:11:45.832121 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:45.832121 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:45.832121 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:45.832121 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:45.832121 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:45.832121 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:45.833023 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:45.833023 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:45.833023 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:45.833023 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:45.833023 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:45.833023 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:45.833023 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:45.833023 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:45.833023 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:45.833023 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:45.833023 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 20 22:11:45.833023 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 20 22:11:45.833023 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 20 22:11:45.833023 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:11:45.833023 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 481/955] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Sep 20 22:11:45 2022] GET /identity/v3/services/compute => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:45.842386 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9259a1e-47c8-4da6-9bb1-910d50bddec2 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:45.945592 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9996a2-9356-4aae-8966-72d84ac3ed35 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:45.961108 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9259a1e-47c8-4da6-9bb1-910d50bddec2 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:45.994803 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb481a9-aadb-4c31-87f8-d16a80734168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:45.995474 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb481a9-aadb-4c31-87f8-d16a80734168 None admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:45.995678 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb481a9-aadb-4c31-87f8-d16a80734168 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:45.995939 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb481a9-aadb-4c31-87f8-d16a80734168 None admin] PATH_INFO: `/v3/projects` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:45.996586 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb481a9-aadb-4c31-87f8-d16a80734168 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:45.998003 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb481a9-aadb-4c31-87f8-d16a80734168 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:46.000637 dv-cinder-858276-1-smb devstack@keystone.service[81307]: WARNING keystone.server.flask.common [None req-3eb481a9-aadb-4c31-87f8-d16a80734168 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 20 22:11:46.007484 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2e0626-ab20-419b-95c3-1b04f6d8243b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:46.008355 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2e0626-ab20-419b-95c3-1b04f6d8243b None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:46.009270 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2e0626-ab20-419b-95c3-1b04f6d8243b None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:46.009749 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2e0626-ab20-419b-95c3-1b04f6d8243b None admin] PATH_INFO: `/v3/services` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:46.011047 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2e0626-ab20-419b-95c3-1b04f6d8243b None admin] RBAC: Adding query filter params (name=compute) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:46.011841 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2e0626-ab20-419b-95c3-1b04f6d8243b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:46.013414 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2e0626-ab20-419b-95c3-1b04f6d8243b None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:46.019998 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.sql.core [None req-3eb481a9-aadb-4c31-87f8-d16a80734168 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 20 22:11:46.019998 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 20 22:11:46.019998 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [parameters: {'id': '48a66ab209f04a0c8c9c667fd1dffcf2', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 20 22:11:46.019998 dv-cinder-858276-1-smb devstack@keystone.service[81307]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81307) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 20 22:11:46.020791 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 482/956] 10.222.0.33 () {56 vars in 1112 bytes} [Tue Sep 20 22:11:45 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:46.026629 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2e0626-ab20-419b-95c3-1b04f6d8243b None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:46.040571 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-3eb481a9-aadb-4c31-87f8-d16a80734168 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 48a66ab209f04a0c8c9c667fd1dffcf2.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 48a66ab209f04a0c8c9c667fd1dffcf2. Sep 20 22:11:46.040571 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:46.040571 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 20 22:11:46.040571 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 20 22:11:46.040571 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 20 22:11:46.040571 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 20 22:11:46.040571 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 20 22:11:46.040571 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application result = self._query(query) Sep 20 22:11:46.040571 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 20 22:11:46.040571 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application conn.query(q) Sep 20 22:11:46.040571 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 20 22:11:46.040571 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 20 22:11:46.040571 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 20 22:11:46.041488 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application result.read() Sep 20 22:11:46.041488 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 20 22:11:46.041488 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 20 22:11:46.041488 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 20 22:11:46.041488 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 20 22:11:46.041488 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 20 22:11:46.041488 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 20 22:11:46.041488 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 20 22:11:46.041488 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 20 22:11:46.041488 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 20 22:11:46.041488 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:11:46.041488 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 20 22:11:46.041488 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:11:46.041488 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:46.041488 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 20 22:11:46.041488 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 20 22:11:46.041488 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 20 22:11:46.041488 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 20 22:11:46.042453 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 20 22:11:46.042453 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application next(self.gen) Sep 20 22:11:46.042453 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 20 22:11:46.042453 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application yield resource Sep 20 22:11:46.042453 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 20 22:11:46.042453 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application next(self.gen) Sep 20 22:11:46.042453 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 20 22:11:46.042453 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application self.session.rollback() Sep 20 22:11:46.042453 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 20 22:11:46.042453 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application self.force_reraise() Sep 20 22:11:46.042453 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 20 22:11:46.042453 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise self.value Sep 20 22:11:46.042453 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 20 22:11:46.042453 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 20 22:11:46.042453 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 20 22:11:46.042453 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application session.commit() Sep 20 22:11:46.042453 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 20 22:11:46.043504 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 20 22:11:46.043504 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 20 22:11:46.043504 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application self._prepare_impl() Sep 20 22:11:46.043504 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 20 22:11:46.043504 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application self.session.flush() Sep 20 22:11:46.043504 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 20 22:11:46.043504 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application self._flush(objects) Sep 20 22:11:46.043504 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 20 22:11:46.043504 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 20 22:11:46.043504 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 20 22:11:46.043504 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application compat.raise_( Sep 20 22:11:46.043504 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 20 22:11:46.043504 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception Sep 20 22:11:46.043504 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 20 22:11:46.043504 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application flush_context.execute() Sep 20 22:11:46.043504 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 20 22:11:46.043504 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rec.execute(self) Sep 20 22:11:46.044393 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 20 22:11:46.044393 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 20 22:11:46.044393 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 20 22:11:46.044393 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 20 22:11:46.044393 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 20 22:11:46.044393 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 20 22:11:46.044393 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 20 22:11:46.044393 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 20 22:11:46.044393 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 20 22:11:46.044393 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 20 22:11:46.044393 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 20 22:11:46.044393 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 20 22:11:46.044393 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 20 22:11:46.044393 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 20 22:11:46.044393 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 20 22:11:46.045194 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 20 22:11:46.045194 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 20 22:11:46.045194 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception Sep 20 22:11:46.045194 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 20 22:11:46.045194 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 20 22:11:46.045194 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 20 22:11:46.045194 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 20 22:11:46.045194 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 20 22:11:46.045194 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application result = self._query(query) Sep 20 22:11:46.045194 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 20 22:11:46.045194 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application conn.query(q) Sep 20 22:11:46.045194 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 20 22:11:46.045194 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 20 22:11:46.045194 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 20 22:11:46.045194 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application result.read() Sep 20 22:11:46.045194 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 20 22:11:46.045194 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 20 22:11:46.046061 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 20 22:11:46.046061 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 20 22:11:46.046061 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 20 22:11:46.046061 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 20 22:11:46.046061 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 20 22:11:46.046061 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 20 22:11:46.046061 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 20 22:11:46.046061 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 20 22:11:46.046061 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [parameters: {'id': '48a66ab209f04a0c8c9c667fd1dffcf2', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 20 22:11:46.046061 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 20 22:11:46.046061 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:11:46.046061 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 20 22:11:46.046061 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:11:46.046061 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:46.046061 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 20 22:11:46.048615 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 20 22:11:46.048615 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 20 22:11:46.048615 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 20 22:11:46.048615 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 20 22:11:46.048615 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:11:46.048615 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 20 22:11:46.048615 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:11:46.048615 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:46.048615 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:46.048615 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:46.048615 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:46.048615 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:46.048615 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:46.048615 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:46.048615 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:46.048615 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:46.048615 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:46.050856 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:46.050856 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 20 22:11:46.050856 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 20 22:11:46.050856 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:46.050856 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:46.050856 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 20 22:11:46.050856 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 20 22:11:46.050856 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 48a66ab209f04a0c8c9c667fd1dffcf2. Sep 20 22:11:46.050856 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:11:46.050856 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 475/957] 10.222.0.33 () {60 vars in 1140 bytes} [Tue Sep 20 22:11:45 2022] POST /identity/v3/projects => generated 262 bytes in 213 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:46.050856 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb481a9-aadb-4c31-87f8-d16a80734168 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:46.058593 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:46.081858 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:46.142014 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2e0626-ab20-419b-95c3-1b04f6d8243b None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:46.181978 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cc2957-3f77-4a57-875b-cacbc6c4c6e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:46.182547 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cc2957-3f77-4a57-875b-cacbc6c4c6e0 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:46.182797 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cc2957-3f77-4a57-875b-cacbc6c4c6e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:46.183051 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cc2957-3f77-4a57-875b-cacbc6c4c6e0 None admin] PATH_INFO: `/v3/services` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:46.183733 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cc2957-3f77-4a57-875b-cacbc6c4c6e0 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:46.184035 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cc2957-3f77-4a57-875b-cacbc6c4c6e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:46.185848 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cc2957-3f77-4a57-875b-cacbc6c4c6e0 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:46.194543 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 483/958] 10.222.0.33 () {56 vars in 1112 bytes} [Tue Sep 20 22:11:46 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:46.196401 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb481a9-aadb-4c31-87f8-d16a80734168 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:46.236738 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a9a0d2-11e7-4db4-97a2-5bade54af1c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:46.237403 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a9a0d2-11e7-4db4-97a2-5bade54af1c1 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:46.237683 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a9a0d2-11e7-4db4-97a2-5bade54af1c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:46.237954 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a9a0d2-11e7-4db4-97a2-5bade54af1c1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:46.246217 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a9a0d2-11e7-4db4-97a2-5bade54af1c1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:46.248001 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a9a0d2-11e7-4db4-97a2-5bade54af1c1 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:46.261286 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-e6a9a0d2-11e7-4db4-97a2-5bade54af1c1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 22:11:46.261286 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:46.261286 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:46.261286 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:46.261286 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:46.261286 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:46.261286 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:46.261286 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:46.261286 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:46.261286 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:46.261286 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:46.261286 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:46.261286 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 20 22:11:46.261286 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 20 22:11:46.261286 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 20 22:11:46.262341 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 20 22:11:46.262341 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:46.262341 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:46.262341 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:46.262341 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:46.262341 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:46.262341 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:46.262341 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:46.262341 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:46.262341 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:46.262341 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:46.262341 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:46.262341 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:46.262341 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:46.262341 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:46.262341 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:46.262341 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:46.263321 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 20 22:11:46.263321 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 20 22:11:46.263321 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 20 22:11:46.263321 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 20 22:11:46.263321 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 20 22:11:46.263321 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 20 22:11:46.263321 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 22:11:46.263321 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:11:46.263321 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 476/959] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Sep 20 22:11:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:46.268709 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cc2957-3f77-4a57-875b-cacbc6c4c6e0 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:46.380211 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cc2957-3f77-4a57-875b-cacbc6c4c6e0 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:46.394017 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:46.417885 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab3c573-5b54-4cfa-901f-c1223f3849f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:46.418916 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab3c573-5b54-4cfa-901f-c1223f3849f6 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:46.419433 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab3c573-5b54-4cfa-901f-c1223f3849f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:46.419896 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab3c573-5b54-4cfa-901f-c1223f3849f6 None admin] PATH_INFO: `/v3/projects` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:46.420821 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab3c573-5b54-4cfa-901f-c1223f3849f6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:46.421359 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab3c573-5b54-4cfa-901f-c1223f3849f6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:46.423150 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab3c573-5b54-4cfa-901f-c1223f3849f6 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:46.443236 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 484/960] 10.222.0.33 () {56 vars in 1112 bytes} [Tue Sep 20 22:11:46 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:47.535590 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d8b1d7-79d7-419e-bd0c-55038e8ec338 None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:47.536098 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d8b1d7-79d7-419e-bd0c-55038e8ec338 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:47.536174 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d8b1d7-79d7-419e-bd0c-55038e8ec338 None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:47.540445 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 477/961] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:11:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:11:47.546043 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb503e1-1219-4501-8bf6-5d20cc5810f8 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:47.546449 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb503e1-1219-4501-8bf6-5d20cc5810f8 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:47.546671 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb503e1-1219-4501-8bf6-5d20cc5810f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:47.565387 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-ceb503e1-1219-4501-8bf6-5d20cc5810f8 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:11:47.567043 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-ceb503e1-1219-4501-8bf6-5d20cc5810f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:11:47.638622 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 485/962] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:11:47 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 20 22:11:47.733396 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68352144-3c17-43bf-808e-a551ae226a59 None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:47.734011 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68352144-3c17-43bf-808e-a551ae226a59 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:47.734481 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68352144-3c17-43bf-808e-a551ae226a59 None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:47.736278 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 478/963] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:11:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:11:47.741725 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c970caf4-9962-4f88-b508-0d324fddd1d0 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:47.742277 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c970caf4-9962-4f88-b508-0d324fddd1d0 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:47.742783 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c970caf4-9962-4f88-b508-0d324fddd1d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:47.761828 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-c970caf4-9962-4f88-b508-0d324fddd1d0 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:11:47.763313 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-c970caf4-9962-4f88-b508-0d324fddd1d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:11:47.836223 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 486/964] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:11:47 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 20 22:11:47.905183 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68352144-3c17-43bf-808e-a551ae226a59 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:47.971904 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:48.012861 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68352144-3c17-43bf-808e-a551ae226a59 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:48.047374 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eff4fe-ccad-4d00-9a2a-a604a24d0dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:48.048010 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eff4fe-ccad-4d00-9a2a-a604a24d0dae None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:48.048288 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eff4fe-ccad-4d00-9a2a-a604a24d0dae None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:48.048555 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eff4fe-ccad-4d00-9a2a-a604a24d0dae None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:48.049133 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18eff4fe-ccad-4d00-9a2a-a604a24d0dae None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:48.050526 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18eff4fe-ccad-4d00-9a2a-a604a24d0dae None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:48.060596 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-18eff4fe-ccad-4d00-9a2a-a604a24d0dae None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 20 22:11:48.060596 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:48.060596 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 20 22:11:48.060596 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 20 22:11:48.060596 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 20 22:11:48.060596 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 20 22:11:48.060596 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 20 22:11:48.060596 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 20 22:11:48.060596 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 20 22:11:48.060596 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:11:48.060596 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 20 22:11:48.060596 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:11:48.060596 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:48.060596 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:48.060596 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:48.060596 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:48.060596 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:48.061626 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:48.061626 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:48.061626 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:48.061626 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:48.061626 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:48.061626 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:48.061626 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 20 22:11:48.061626 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 20 22:11:48.061626 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 20 22:11:48.061626 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 20 22:11:48.061626 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:48.061626 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:48.061626 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:48.061626 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:48.061626 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:48.061626 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:48.062496 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:48.062496 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:48.062496 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:48.062496 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:48.062496 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:48.062496 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:48.062496 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:48.062496 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:48.062496 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:48.062496 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:48.062496 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 20 22:11:48.062496 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 20 22:11:48.062496 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 20 22:11:48.062496 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:11:48.062496 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 479/965] 10.222.0.33 () {56 vars in 1126 bytes} [Tue Sep 20 22:11:47 2022] GET /identity/v3/services/object-store => generated 93 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:48.068539 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c970caf4-9962-4f88-b508-0d324fddd1d0 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:48.103883 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:48.147401 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eff4fe-ccad-4d00-9a2a-a604a24d0dae None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:48.179827 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c970caf4-9962-4f88-b508-0d324fddd1d0 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:48.224662 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd161b0-e757-4478-b9bc-fdb1af341e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:48.225003 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd161b0-e757-4478-b9bc-fdb1af341e16 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:48.225276 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd161b0-e757-4478-b9bc-fdb1af341e16 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:48.225540 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd161b0-e757-4478-b9bc-fdb1af341e16 None admin] PATH_INFO: `/v3/services` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:48.226166 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd161b0-e757-4478-b9bc-fdb1af341e16 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:48.226466 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd161b0-e757-4478-b9bc-fdb1af341e16 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:48.227842 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd161b0-e757-4478-b9bc-fdb1af341e16 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:48.232946 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 487/966] 10.222.0.33 () {56 vars in 1122 bytes} [Tue Sep 20 22:11:48 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:48.238148 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd161b0-e757-4478-b9bc-fdb1af341e16 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:48.262266 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eff4fe-ccad-4d00-9a2a-a604a24d0dae None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:48.303010 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:48.314394 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682a8218-b1a2-48fa-8cef-4acc9061d6a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:48.315425 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a8218-b1a2-48fa-8cef-4acc9061d6a7 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:48.316079 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a8218-b1a2-48fa-8cef-4acc9061d6a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:48.317122 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a8218-b1a2-48fa-8cef-4acc9061d6a7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:48.329106 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682a8218-b1a2-48fa-8cef-4acc9061d6a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 22:11:48.336036 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-682a8218-b1a2-48fa-8cef-4acc9061d6a7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 20 22:11:48.336036 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:48.336036 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:48.336036 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:48.336036 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:48.336036 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:48.336036 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:48.336036 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:48.336036 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:48.336036 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:48.336036 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:48.336036 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:48.336036 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 22:11:48.336036 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 22:11:48.336036 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 22:11:48.336036 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 22:11:48.337057 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 22:11:48.337057 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 22:11:48.337057 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 22:11:48.337057 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 22:11:48.337057 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:48.337057 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:48.337057 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:48.337057 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:48.337057 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:48.337057 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:48.337057 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:48.337057 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:48.337057 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:48.337057 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:48.337057 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:48.337057 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:48.337953 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:48.337953 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:48.337953 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:48.337953 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:48.337953 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 22:11:48.337953 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 22:11:48.337953 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 22:11:48.337953 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 22:11:48.337953 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 22:11:48.337953 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 22:11:48.337953 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 20 22:11:48.337953 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:11:48.345871 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 480/967] 10.222.0.33 () {56 vars in 1120 bytes} [Tue Sep 20 22:11:48 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 20 22:11:48.346582 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:48.348694 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682a8218-b1a2-48fa-8cef-4acc9061d6a7 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:48.350088 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd161b0-e757-4478-b9bc-fdb1af341e16 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:48.392446 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a831b55-dd86-42bd-bae4-e08d24adb562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:48.392931 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a831b55-dd86-42bd-bae4-e08d24adb562 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:48.393205 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a831b55-dd86-42bd-bae4-e08d24adb562 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:48.393472 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a831b55-dd86-42bd-bae4-e08d24adb562 None admin] PATH_INFO: `/v3/services` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:48.394100 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a831b55-dd86-42bd-bae4-e08d24adb562 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:48.394399 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a831b55-dd86-42bd-bae4-e08d24adb562 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:48.396377 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a831b55-dd86-42bd-bae4-e08d24adb562 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:48.401671 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 488/968] 10.222.0.33 () {56 vars in 1122 bytes} [Tue Sep 20 22:11:48 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:48.407499 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a831b55-dd86-42bd-bae4-e08d24adb562 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:48.465070 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682a8218-b1a2-48fa-8cef-4acc9061d6a7 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:48.500882 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a31abca-e4f9-4801-9430-30cb97ac4145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:48.502164 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a31abca-e4f9-4801-9430-30cb97ac4145 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:48.502786 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a31abca-e4f9-4801-9430-30cb97ac4145 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:48.503235 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a31abca-e4f9-4801-9430-30cb97ac4145 None admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:48.504143 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a31abca-e4f9-4801-9430-30cb97ac4145 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:48.504910 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a31abca-e4f9-4801-9430-30cb97ac4145 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:48.506716 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a31abca-e4f9-4801-9430-30cb97ac4145 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:48.513852 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a831b55-dd86-42bd-bae4-e08d24adb562 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:48.517360 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 481/969] 10.222.0.33 () {56 vars in 1115 bytes} [Tue Sep 20 22:11:48 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:48.519585 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ebb8c-528b-4274-87d3-b59acf4880e9 None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:48.520285 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ebb8c-528b-4274-87d3-b59acf4880e9 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:48.520923 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ebb8c-528b-4274-87d3-b59acf4880e9 None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:48.523344 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 482/970] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:11:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:11:48.525876 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789ebb8c-528b-4274-87d3-b59acf4880e9 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:48.552562 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a264b3-3a3d-4817-8d6a-959b76c7d4a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:48.553166 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a264b3-3a3d-4817-8d6a-959b76c7d4a0 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:48.553442 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a264b3-3a3d-4817-8d6a-959b76c7d4a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:48.553726 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a264b3-3a3d-4817-8d6a-959b76c7d4a0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:48.554699 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a264b3-3a3d-4817-8d6a-959b76c7d4a0 None admin] RBAC: Adding query filter params (interface=admin, service_id=b6c846dd569948c3ab097d329d3ef727, region_id=RegionOne) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:48.555011 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a264b3-3a3d-4817-8d6a-959b76c7d4a0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:48.556405 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a264b3-3a3d-4817-8d6a-959b76c7d4a0 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:48.561942 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 489/971] 10.222.0.33 () {56 vars in 1249 bytes} [Tue Sep 20 22:11:48 2022] GET /identity/v3/endpoints?service_id=b6c846dd569948c3ab097d329d3ef727&interface=admin®ion_id=RegionOne => generated 193 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:48.563268 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c2e2d0-61b6-42b6-b415-21283015c1f3 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:48.563553 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c2e2d0-61b6-42b6-b415-21283015c1f3 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:48.563824 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c2e2d0-61b6-42b6-b415-21283015c1f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:48.584954 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-02c2e2d0-61b6-42b6-b415-21283015c1f3 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:11:48.586857 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-02c2e2d0-61b6-42b6-b415-21283015c1f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:11:48.596442 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:48.607978 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:48.651137 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789ebb8c-528b-4274-87d3-b59acf4880e9 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:48.664707 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 490/972] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:11:48 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 20 22:11:48.666305 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c2e2d0-61b6-42b6-b415-21283015c1f3 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:48.695328 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2732feac-ffc5-4d24-8583-eafc8aa1a3c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:48.695966 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2732feac-ffc5-4d24-8583-eafc8aa1a3c7 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:48.696258 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2732feac-ffc5-4d24-8583-eafc8aa1a3c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:48.696521 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2732feac-ffc5-4d24-8583-eafc8aa1a3c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:48.707756 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2732feac-ffc5-4d24-8583-eafc8aa1a3c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:48.709309 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2732feac-ffc5-4d24-8583-eafc8aa1a3c7 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:48.724982 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-2732feac-ffc5-4d24-8583-eafc8aa1a3c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:11:48.724982 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:48.724982 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:48.724982 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:48.724982 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:48.724982 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:48.724982 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:48.724982 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:48.724982 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:48.724982 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:48.724982 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:48.724982 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:48.724982 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 22:11:48.724982 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 22:11:48.724982 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 22:11:48.724982 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 22:11:48.725961 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:48.725961 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:48.725961 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:48.725961 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:48.725961 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:48.725961 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:48.725961 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:48.725961 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:48.725961 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:48.725961 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:48.725961 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:48.725961 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:48.725961 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:48.725961 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:48.725961 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:48.725961 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:48.725961 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 22:11:48.727039 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 22:11:48.727039 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:11:48.727039 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:11:48.727039 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 483/973] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 20 22:11:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:48.727800 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd447754-070c-4a31-80bd-8ca9105d32b4 None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:48.727800 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd447754-070c-4a31-80bd-8ca9105d32b4 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:48.727951 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd447754-070c-4a31-80bd-8ca9105d32b4 None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:48.733390 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 484/974] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:11:48 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:11:48.734560 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5364ec-0be7-4e0e-b786-77e7f3e3bb84 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:48.734964 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5364ec-0be7-4e0e-b786-77e7f3e3bb84 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:48.735258 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5364ec-0be7-4e0e-b786-77e7f3e3bb84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:48.754363 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-2a5364ec-0be7-4e0e-b786-77e7f3e3bb84 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:11:48.755878 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-2a5364ec-0be7-4e0e-b786-77e7f3e3bb84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:11:48.775308 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c2e2d0-61b6-42b6-b415-21283015c1f3 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:48.811741 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d37a86d-d3cc-457c-aced-1c2564081ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:48.812366 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d37a86d-d3cc-457c-aced-1c2564081ae8 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:48.812631 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d37a86d-d3cc-457c-aced-1c2564081ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:48.812899 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d37a86d-d3cc-457c-aced-1c2564081ae8 None admin] PATH_INFO: `/v3/services` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:48.813499 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d37a86d-d3cc-457c-aced-1c2564081ae8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:48.814887 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d37a86d-d3cc-457c-aced-1c2564081ae8 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:48.830881 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 485/975] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:11:48 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 20 22:11:48.830881 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5364ec-0be7-4e0e-b786-77e7f3e3bb84 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:48.831204 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 491/976] 10.222.0.33 () {56 vars in 1087 bytes} [Tue Sep 20 22:11:48 2022] GET /identity/v3/services => generated 1497 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:11:48.871080 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:48.950012 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d37a86d-d3cc-457c-aced-1c2564081ae8 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:48.959277 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5364ec-0be7-4e0e-b786-77e7f3e3bb84 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:48.971576 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:49.008532 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723adecf-c248-4d5e-8c84-50219dce2042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:49.009379 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723adecf-c248-4d5e-8c84-50219dce2042 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:49.010121 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723adecf-c248-4d5e-8c84-50219dce2042 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:49.010396 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723adecf-c248-4d5e-8c84-50219dce2042 None admin] PATH_INFO: `/v3/domains` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:49.011086 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723adecf-c248-4d5e-8c84-50219dce2042 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:49.011386 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723adecf-c248-4d5e-8c84-50219dce2042 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:49.012738 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723adecf-c248-4d5e-8c84-50219dce2042 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:49.025727 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 486/977] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 20 22:11:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:49.031440 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723adecf-c248-4d5e-8c84-50219dce2042 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:49.076577 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d37a86d-d3cc-457c-aced-1c2564081ae8 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:49.120815 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32e90c6-f75e-465f-941a-c1bd54852010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:49.121819 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32e90c6-f75e-465f-941a-c1bd54852010 None admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:49.122106 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32e90c6-f75e-465f-941a-c1bd54852010 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:49.122671 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32e90c6-f75e-465f-941a-c1bd54852010 None admin] PATH_INFO: `/v3/services` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:49.123330 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32e90c6-f75e-465f-941a-c1bd54852010 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:49.124688 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32e90c6-f75e-465f-941a-c1bd54852010 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:49.133607 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:49.143579 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723adecf-c248-4d5e-8c84-50219dce2042 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:49.144607 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 492/978] 10.222.0.33 () {60 vars in 1141 bytes} [Tue Sep 20 22:11:48 2022] POST /identity/v3/services => generated 242 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 20 22:11:49.145989 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32e90c6-f75e-465f-941a-c1bd54852010 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:49.193434 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eb5efc-9feb-49c6-a55c-64e6c1e5ffe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:49.194450 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eb5efc-9feb-49c6-a55c-64e6c1e5ffe7 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:49.194926 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eb5efc-9feb-49c6-a55c-64e6c1e5ffe7 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:49.195444 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eb5efc-9feb-49c6-a55c-64e6c1e5ffe7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:49.205518 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7eb5efc-9feb-49c6-a55c-64e6c1e5ffe7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:49.208089 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7eb5efc-9feb-49c6-a55c-64e6c1e5ffe7 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:49.221737 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-d7eb5efc-9feb-49c6-a55c-64e6c1e5ffe7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 20 22:11:49.221737 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:49.221737 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:49.221737 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:49.221737 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:49.221737 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:49.221737 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:49.221737 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:49.221737 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:49.221737 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:49.221737 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:49.221737 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:49.221737 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 20 22:11:49.221737 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 20 22:11:49.221737 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 20 22:11:49.221737 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 20 22:11:49.227023 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:49.227023 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:49.227023 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 20 22:11:49.227023 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 22:11:49.227023 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 20 22:11:49.227023 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 22:11:49.227023 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:49.227023 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:49.227023 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:49.227023 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:49.227023 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:49.227023 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:49.227023 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:49.227023 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:49.227023 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:49.227023 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:49.227023 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:49.227023 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:49.228862 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:49.228862 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:49.228862 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 20 22:11:49.228862 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 20 22:11:49.228862 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 20 22:11:49.228862 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 20 22:11:49.228862 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 20 22:11:49.228862 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 20 22:11:49.228862 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 20 22:11:49.228862 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:11:49.232368 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 487/979] 10.222.0.33 () {56 vars in 1117 bytes} [Tue Sep 20 22:11:49 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:49.239876 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eb5efc-9feb-49c6-a55c-64e6c1e5ffe7 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:49.244918 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:49.274145 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32e90c6-f75e-465f-941a-c1bd54852010 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:49.315409 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ea6135-9c0e-4b24-9bfa-56ed6095c97e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:49.316037 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ea6135-9c0e-4b24-9bfa-56ed6095c97e None admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:49.317043 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ea6135-9c0e-4b24-9bfa-56ed6095c97e None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:49.317386 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ea6135-9c0e-4b24-9bfa-56ed6095c97e None admin] PATH_INFO: `/v3/users` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:49.318057 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ea6135-9c0e-4b24-9bfa-56ed6095c97e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:49.319667 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ea6135-9c0e-4b24-9bfa-56ed6095c97e None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:49.322297 dv-cinder-858276-1-smb devstack@keystone.service[81306]: WARNING keystone.server.flask.common [None req-b7ea6135-9c0e-4b24-9bfa-56ed6095c97e None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 20 22:11:49.339137 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.sql.core [None req-b7ea6135-9c0e-4b24-9bfa-56ed6095c97e None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 20 22:11:49.339137 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 20 22:11:49.339137 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [parameters: {'user_id': '13bd8d3c7ea64d7aaec718d39d05ce0b', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 20 22:11:49.339137 dv-cinder-858276-1-smb devstack@keystone.service[81306]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81306) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 20 22:11:49.348415 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-b7ea6135-9c0e-4b24-9bfa-56ed6095c97e None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 20 22:11:49.348415 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:49.348415 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 20 22:11:49.348415 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 20 22:11:49.348415 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 20 22:11:49.348415 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 20 22:11:49.348415 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 20 22:11:49.348415 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application result = self._query(query) Sep 20 22:11:49.348415 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 20 22:11:49.348415 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application conn.query(q) Sep 20 22:11:49.348415 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 20 22:11:49.348415 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 20 22:11:49.348415 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 20 22:11:49.348415 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application result.read() Sep 20 22:11:49.348415 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 20 22:11:49.349353 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 20 22:11:49.349353 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 20 22:11:49.349353 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 20 22:11:49.349353 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 20 22:11:49.349353 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 20 22:11:49.349353 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 20 22:11:49.349353 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 20 22:11:49.349353 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 20 22:11:49.349353 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:11:49.349353 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 20 22:11:49.349353 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:11:49.349353 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:49.349353 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 20 22:11:49.349353 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 20 22:11:49.349353 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 20 22:11:49.349353 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 20 22:11:49.349353 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 20 22:11:49.349353 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application next(self.gen) Sep 20 22:11:49.350315 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 20 22:11:49.350315 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application yield resource Sep 20 22:11:49.350315 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 20 22:11:49.350315 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application next(self.gen) Sep 20 22:11:49.350315 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 20 22:11:49.350315 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application self.session.rollback() Sep 20 22:11:49.350315 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 20 22:11:49.350315 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application self.force_reraise() Sep 20 22:11:49.350315 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 20 22:11:49.350315 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise self.value Sep 20 22:11:49.350315 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 20 22:11:49.350315 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 20 22:11:49.350315 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 20 22:11:49.350315 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application session.commit() Sep 20 22:11:49.350315 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 20 22:11:49.350315 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 20 22:11:49.350315 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 20 22:11:49.351236 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application self._prepare_impl() Sep 20 22:11:49.351236 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 20 22:11:49.351236 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application self.session.flush() Sep 20 22:11:49.351236 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 20 22:11:49.351236 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application self._flush(objects) Sep 20 22:11:49.351236 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 20 22:11:49.351236 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 20 22:11:49.351236 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 20 22:11:49.351236 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application compat.raise_( Sep 20 22:11:49.351236 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 20 22:11:49.351236 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception Sep 20 22:11:49.351236 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 20 22:11:49.351236 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application flush_context.execute() Sep 20 22:11:49.351236 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 20 22:11:49.351236 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rec.execute(self) Sep 20 22:11:49.351236 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 20 22:11:49.351236 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 20 22:11:49.352126 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 20 22:11:49.352126 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 20 22:11:49.352126 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 20 22:11:49.352126 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 20 22:11:49.352126 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 20 22:11:49.352126 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 20 22:11:49.352126 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 20 22:11:49.352126 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 20 22:11:49.352126 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 20 22:11:49.352126 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 20 22:11:49.352126 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 20 22:11:49.352126 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 20 22:11:49.352126 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 20 22:11:49.352126 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 20 22:11:49.352126 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 20 22:11:49.352126 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception Sep 20 22:11:49.352983 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 20 22:11:49.352983 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 20 22:11:49.352983 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 20 22:11:49.352983 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 20 22:11:49.352983 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 20 22:11:49.352983 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application result = self._query(query) Sep 20 22:11:49.352983 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 20 22:11:49.352983 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application conn.query(q) Sep 20 22:11:49.352983 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 20 22:11:49.352983 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 20 22:11:49.352983 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 20 22:11:49.352983 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application result.read() Sep 20 22:11:49.352983 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 20 22:11:49.352983 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 20 22:11:49.352983 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 20 22:11:49.352983 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 20 22:11:49.353911 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 20 22:11:49.353911 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 20 22:11:49.353911 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 20 22:11:49.353911 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 20 22:11:49.353911 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 20 22:11:49.353911 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 20 22:11:49.353911 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [parameters: {'user_id': '13bd8d3c7ea64d7aaec718d39d05ce0b', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 20 22:11:49.353911 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 20 22:11:49.353911 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:11:49.353911 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 20 22:11:49.353911 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:11:49.353911 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:49.353911 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:49.353911 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:49.353911 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:49.355200 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:49.355200 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:49.355200 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:49.355200 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:49.355200 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:49.355200 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:49.355200 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:49.355200 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 20 22:11:49.355200 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 20 22:11:49.355200 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:49.355200 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:49.355200 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 20 22:11:49.355200 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 22:11:49.355200 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 20 22:11:49.355200 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 22:11:49.355200 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 20 22:11:49.355200 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 20 22:11:49.356157 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 20 22:11:49.356157 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 20 22:11:49.356157 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 20 22:11:49.356157 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 20 22:11:49.356157 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 20 22:11:49.356157 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:11:49.356157 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 493/980] 10.222.0.33 () {60 vars in 1131 bytes} [Tue Sep 20 22:11:49 2022] POST /identity/v3/users => generated 160 bytes in 205 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:49.356567 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ea6135-9c0e-4b24-9bfa-56ed6095c97e None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:49.389442 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eb5efc-9feb-49c6-a55c-64e6c1e5ffe7 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:49.437236 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381532bb-b1cd-4fbe-bc04-c7a1b9c54606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:49.438398 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381532bb-b1cd-4fbe-bc04-c7a1b9c54606 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:49.438890 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381532bb-b1cd-4fbe-bc04-c7a1b9c54606 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:49.439371 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381532bb-b1cd-4fbe-bc04-c7a1b9c54606 None admin] PATH_INFO: `/v3/users` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:49.440315 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381532bb-b1cd-4fbe-bc04-c7a1b9c54606 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:49.441035 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381532bb-b1cd-4fbe-bc04-c7a1b9c54606 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:49.444221 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381532bb-b1cd-4fbe-bc04-c7a1b9c54606 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:49.466646 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 488/981] 10.222.0.33 () {56 vars in 1149 bytes} [Tue Sep 20 22:11:49 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:49.471835 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381532bb-b1cd-4fbe-bc04-c7a1b9c54606 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:49.480954 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:49.485200 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ea6135-9c0e-4b24-9bfa-56ed6095c97e None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:49.531240 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd096ff-14b2-4063-97f5-62c0b19d4068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:49.531889 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd096ff-14b2-4063-97f5-62c0b19d4068 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:49.534680 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd096ff-14b2-4063-97f5-62c0b19d4068 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:49.534966 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd096ff-14b2-4063-97f5-62c0b19d4068 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:49.543531 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd096ff-14b2-4063-97f5-62c0b19d4068 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:49.545176 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd096ff-14b2-4063-97f5-62c0b19d4068 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:49.547351 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:49.558795 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-ebd096ff-14b2-4063-97f5-62c0b19d4068 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 20 22:11:49.558795 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:49.558795 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:49.558795 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:49.558795 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:49.558795 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:49.558795 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:49.558795 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:49.558795 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:49.558795 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:49.558795 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:49.558795 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:49.558795 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 20 22:11:49.558795 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 20 22:11:49.558795 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 20 22:11:49.558795 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 20 22:11:49.560215 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:49.560215 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:49.560215 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 20 22:11:49.560215 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 22:11:49.560215 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 20 22:11:49.560215 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 22:11:49.560215 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:49.560215 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:49.560215 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:49.560215 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:49.560215 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:49.560215 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:49.560215 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:49.560215 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:49.560215 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:49.560215 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:49.560215 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:49.560215 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:49.561160 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:49.561160 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:49.561160 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 20 22:11:49.561160 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 20 22:11:49.561160 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 20 22:11:49.561160 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 20 22:11:49.561160 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 20 22:11:49.561160 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 20 22:11:49.561160 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 20 22:11:49.561160 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:11:49.568986 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 494/982] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 20 22:11:49 2022] GET /identity/v3/users/cinder => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 20 22:11:49.569864 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd096ff-14b2-4063-97f5-62c0b19d4068 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:49.612763 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381532bb-b1cd-4fbe-bc04-c7a1b9c54606 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:49.662579 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90769fe3-ed92-4fe5-9d6c-22468db0e494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:49.663825 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90769fe3-ed92-4fe5-9d6c-22468db0e494 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:49.664737 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90769fe3-ed92-4fe5-9d6c-22468db0e494 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:49.665214 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90769fe3-ed92-4fe5-9d6c-22468db0e494 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:49.680347 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd096ff-14b2-4063-97f5-62c0b19d4068 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:49.715868 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332f41b2-cf5e-49bc-8f01-05478fdbbc65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:49.716476 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332f41b2-cf5e-49bc-8f01-05478fdbbc65 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:49.716811 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332f41b2-cf5e-49bc-8f01-05478fdbbc65 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:49.717028 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332f41b2-cf5e-49bc-8f01-05478fdbbc65 None admin] PATH_INFO: `/v3/users` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:49.717733 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332f41b2-cf5e-49bc-8f01-05478fdbbc65 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:49.718039 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332f41b2-cf5e-49bc-8f01-05478fdbbc65 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:49.719510 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332f41b2-cf5e-49bc-8f01-05478fdbbc65 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:49.758039 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90769fe3-ed92-4fe5-9d6c-22468db0e494 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:49.760242 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90769fe3-ed92-4fe5-9d6c-22468db0e494 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:49.769763 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:49.770976 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 495/983] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Sep 20 22:11:49 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:49.900073 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 489/984] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 20 22:11:49 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 20 22:11:49.905974 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332f41b2-cf5e-49bc-8f01-05478fdbbc65 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:49.969803 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:50.018630 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332f41b2-cf5e-49bc-8f01-05478fdbbc65 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:50.057828 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e16123a-30c3-432c-9dad-76e80e874352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:50.058477 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e16123a-30c3-432c-9dad-76e80e874352 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:50.058785 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e16123a-30c3-432c-9dad-76e80e874352 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:50.059623 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e16123a-30c3-432c-9dad-76e80e874352 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:50.070373 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e16123a-30c3-432c-9dad-76e80e874352 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:50.071865 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e16123a-30c3-432c-9dad-76e80e874352 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:50.089275 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-1e16123a-30c3-432c-9dad-76e80e874352 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:11:50.089275 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:50.089275 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:50.089275 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:50.089275 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:50.089275 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:50.089275 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:50.089275 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:50.089275 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:50.089275 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:50.089275 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:50.089275 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:50.089275 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 22:11:50.089275 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 22:11:50.089275 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 22:11:50.089275 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 22:11:50.090260 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:50.090260 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:50.090260 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:50.090260 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:50.090260 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:50.090260 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:50.090260 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:50.090260 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:50.090260 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:50.090260 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:50.090260 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:50.090260 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:50.090260 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:50.090260 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:50.090260 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:50.090260 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:50.090260 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 22:11:50.091275 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 22:11:50.091275 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:11:50.091275 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:11:50.093442 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 496/985] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 20 22:11:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:50.096258 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90769fe3-ed92-4fe5-9d6c-22468db0e494 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:50.202952 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90769fe3-ed92-4fe5-9d6c-22468db0e494 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:50.211378 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:50.239724 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce30df97-ca02-4818-88bc-087a2d4aaba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:50.240263 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce30df97-ca02-4818-88bc-087a2d4aaba2 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:50.240543 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce30df97-ca02-4818-88bc-087a2d4aaba2 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:50.240817 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce30df97-ca02-4818-88bc-087a2d4aaba2 None admin] PATH_INFO: `/v3/domains` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:50.241456 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce30df97-ca02-4818-88bc-087a2d4aaba2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:50.241757 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce30df97-ca02-4818-88bc-087a2d4aaba2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:50.243151 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce30df97-ca02-4818-88bc-087a2d4aaba2 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:50.258626 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 490/986] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 20 22:11:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:50.260152 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e16123a-30c3-432c-9dad-76e80e874352 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:50.368684 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e16123a-30c3-432c-9dad-76e80e874352 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:50.377538 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:50.403504 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0855e26a-eda5-440a-9e64-a181150fc721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:50.404132 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0855e26a-eda5-440a-9e64-a181150fc721 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:50.404415 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0855e26a-eda5-440a-9e64-a181150fc721 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:50.404692 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0855e26a-eda5-440a-9e64-a181150fc721 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:50.411835 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0855e26a-eda5-440a-9e64-a181150fc721 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:50.413274 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0855e26a-eda5-440a-9e64-a181150fc721 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:50.424348 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-0855e26a-eda5-440a-9e64-a181150fc721 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 22:11:50.424348 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:50.424348 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:50.424348 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:50.424348 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:50.424348 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:50.424348 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:50.424348 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:50.424348 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:50.424348 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:50.424348 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:50.424348 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:50.424348 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 20 22:11:50.424348 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 20 22:11:50.424348 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 20 22:11:50.425226 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 20 22:11:50.425226 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:50.425226 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:50.425226 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:50.425226 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:50.425226 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:50.425226 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:50.425226 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:50.425226 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:50.425226 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:50.425226 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:50.425226 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:50.425226 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:50.425226 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:50.425226 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:50.425226 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:50.425226 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:50.426143 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 20 22:11:50.426143 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 20 22:11:50.426143 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 20 22:11:50.426143 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 20 22:11:50.426143 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 20 22:11:50.426143 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 20 22:11:50.426143 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 22:11:50.426143 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:11:50.426143 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 497/987] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Sep 20 22:11:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:50.432789 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce30df97-ca02-4818-88bc-087a2d4aaba2 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:50.536668 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce30df97-ca02-4818-88bc-087a2d4aaba2 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:50.571938 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e703754-236a-44d2-9066-f1d20a65d645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:50.572546 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e703754-236a-44d2-9066-f1d20a65d645 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:50.572826 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e703754-236a-44d2-9066-f1d20a65d645 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:50.573096 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e703754-236a-44d2-9066-f1d20a65d645 None admin] PATH_INFO: `/v3/projects` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:50.573786 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e703754-236a-44d2-9066-f1d20a65d645 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:50.574086 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e703754-236a-44d2-9066-f1d20a65d645 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:50.575634 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e703754-236a-44d2-9066-f1d20a65d645 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:50.593261 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 491/988] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Sep 20 22:11:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:50.594911 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0855e26a-eda5-440a-9e64-a181150fc721 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:50.694383 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0855e26a-eda5-440a-9e64-a181150fc721 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:50.727533 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba450c1-a487-4fc3-9b21-1883dc4384d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:50.728137 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba450c1-a487-4fc3-9b21-1883dc4384d8 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:50.728416 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba450c1-a487-4fc3-9b21-1883dc4384d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:50.728687 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba450c1-a487-4fc3-9b21-1883dc4384d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:50.729399 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba450c1-a487-4fc3-9b21-1883dc4384d8 None admin] RBAC: Adding query filter params (role.id=9fd7d9b8b5224290acc6e44595c9000b, scope.project.id=3ce415d02aa9489bae19cd514805fd8c, user.id=e916748fdee84c34af034e75a919b986) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:50.729709 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba450c1-a487-4fc3-9b21-1883dc4384d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:50.731155 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba450c1-a487-4fc3-9b21-1883dc4384d8 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:50.742621 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 498/989] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Sep 20 22:11:50 2022] GET /identity/v3/role_assignments?user.id=e916748fdee84c34af034e75a919b986&scope.project.id=3ce415d02aa9489bae19cd514805fd8c&role.id=9fd7d9b8b5224290acc6e44595c9000b => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:51.079284 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc45281-a42a-45c5-bc93-2f0113a9a698 None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:51.079819 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc45281-a42a-45c5-bc93-2f0113a9a698 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:51.079819 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc45281-a42a-45c5-bc93-2f0113a9a698 None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:51.081191 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 492/990] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:11:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:11:51.086596 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db153550-8eac-4e4d-85ec-c6092e9e132d None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:51.086887 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db153550-8eac-4e4d-85ec-c6092e9e132d None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:51.087194 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db153550-8eac-4e4d-85ec-c6092e9e132d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:51.105415 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-db153550-8eac-4e4d-85ec-c6092e9e132d None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:11:51.106942 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-db153550-8eac-4e4d-85ec-c6092e9e132d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:11:51.133582 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:51.175769 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 499/991] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:11:51 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 20 22:11:51.445129 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc45281-a42a-45c5-bc93-2f0113a9a698 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:51.451849 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d26eb2-cd29-46fb-b8b3-3dcabb29742d None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:51.452143 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d26eb2-cd29-46fb-b8b3-3dcabb29742d None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:51.452417 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d26eb2-cd29-46fb-b8b3-3dcabb29742d None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:51.453938 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 500/992] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:11:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:11:51.459056 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a11a09-435f-4725-b674-691d54974dfb None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:51.459345 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a11a09-435f-4725-b674-691d54974dfb None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:51.459620 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a11a09-435f-4725-b674-691d54974dfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:51.473275 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:51.479688 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-94a11a09-435f-4725-b674-691d54974dfb None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:11:51.480896 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-94a11a09-435f-4725-b674-691d54974dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:11:51.554440 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 501/993] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:11:51 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 20 22:11:51.556588 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc45281-a42a-45c5-bc93-2f0113a9a698 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:51.590352 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc16ece-c30f-49e7-8151-d1575c3d29e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:51.590999 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc16ece-c30f-49e7-8151-d1575c3d29e3 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:51.591277 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc16ece-c30f-49e7-8151-d1575c3d29e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:51.591545 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc16ece-c30f-49e7-8151-d1575c3d29e3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:51.592179 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc16ece-c30f-49e7-8151-d1575c3d29e3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:51.593575 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc16ece-c30f-49e7-8151-d1575c3d29e3 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:51.602668 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-acc16ece-c30f-49e7-8151-d1575c3d29e3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 20 22:11:51.602668 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:51.602668 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 20 22:11:51.602668 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 20 22:11:51.602668 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 20 22:11:51.602668 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 20 22:11:51.602668 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 20 22:11:51.602668 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 20 22:11:51.602668 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 20 22:11:51.602668 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:11:51.602668 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 20 22:11:51.602668 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:11:51.602668 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:51.602668 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:51.602668 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:51.602668 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:51.602668 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:51.603639 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:51.603639 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:51.603639 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:51.603639 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:51.603639 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:51.603639 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:51.603639 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 20 22:11:51.603639 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 20 22:11:51.603639 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 20 22:11:51.603639 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 20 22:11:51.603639 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:51.603639 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:51.603639 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:51.603639 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:51.603639 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:51.603639 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:51.604488 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:51.604488 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:51.604488 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:51.604488 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:51.604488 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:51.604488 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:51.604488 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:51.604488 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:51.604488 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:51.604488 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:51.604488 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 20 22:11:51.604488 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 20 22:11:51.604488 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 20 22:11:51.604488 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:11:51.606818 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 493/994] 10.222.0.33 () {56 vars in 1126 bytes} [Tue Sep 20 22:11:51 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:51.609579 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a11a09-435f-4725-b674-691d54974dfb None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:51.704526 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:51.714737 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a11a09-435f-4725-b674-691d54974dfb None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:51.749622 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffc0337-2fc6-45a4-ab85-08c3519a3b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:51.750227 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc0337-2fc6-45a4-ab85-08c3519a3b82 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:51.750531 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc0337-2fc6-45a4-ab85-08c3519a3b82 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:51.750803 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc0337-2fc6-45a4-ab85-08c3519a3b82 None admin] PATH_INFO: `/v3/services` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:51.751422 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffc0337-2fc6-45a4-ab85-08c3519a3b82 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:51.751722 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffc0337-2fc6-45a4-ab85-08c3519a3b82 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:51.753084 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffc0337-2fc6-45a4-ab85-08c3519a3b82 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:51.758654 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 502/995] 10.222.0.33 () {56 vars in 1122 bytes} [Tue Sep 20 22:11:51 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:51.764099 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc16ece-c30f-49e7-8151-d1575c3d29e3 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:51.822719 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffc0337-2fc6-45a4-ab85-08c3519a3b82 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:51.857125 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:51.868239 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc16ece-c30f-49e7-8151-d1575c3d29e3 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:51.903739 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f49cfc-2275-4f7b-bfd2-11654315d0fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:51.904351 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f49cfc-2275-4f7b-bfd2-11654315d0fd None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:51.904631 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f49cfc-2275-4f7b-bfd2-11654315d0fd None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:51.904903 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f49cfc-2275-4f7b-bfd2-11654315d0fd None admin] PATH_INFO: `/v3/services` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:51.905532 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f49cfc-2275-4f7b-bfd2-11654315d0fd None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:51.905838 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f49cfc-2275-4f7b-bfd2-11654315d0fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:51.907247 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f49cfc-2275-4f7b-bfd2-11654315d0fd None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:51.917141 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 494/996] 10.222.0.33 () {56 vars in 1122 bytes} [Tue Sep 20 22:11:51 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:51.918164 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f49cfc-2275-4f7b-bfd2-11654315d0fd None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:51.935807 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffc0337-2fc6-45a4-ab85-08c3519a3b82 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:51.972195 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46579ff-a763-452f-932d-218b9b2d7a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:51.973320 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46579ff-a763-452f-932d-218b9b2d7a2b None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:51.973590 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46579ff-a763-452f-932d-218b9b2d7a2b None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:51.973878 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46579ff-a763-452f-932d-218b9b2d7a2b None admin] PATH_INFO: `/v3/services/compute` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:51.974559 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46579ff-a763-452f-932d-218b9b2d7a2b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:51.975904 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46579ff-a763-452f-932d-218b9b2d7a2b None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:51.987439 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-b46579ff-a763-452f-932d-218b9b2d7a2b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 20 22:11:51.987439 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:51.987439 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 20 22:11:51.987439 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 20 22:11:51.987439 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 20 22:11:51.987439 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 20 22:11:51.987439 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 20 22:11:51.987439 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 20 22:11:51.987439 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 20 22:11:51.987439 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:11:51.987439 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 20 22:11:51.987439 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:11:51.987439 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:51.987439 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:51.987439 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:51.987439 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:51.987439 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:51.989003 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:51.989003 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:51.989003 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:51.989003 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:51.989003 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:51.989003 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:51.989003 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 20 22:11:51.989003 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 20 22:11:51.989003 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 20 22:11:51.989003 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 20 22:11:51.989003 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:51.989003 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:51.989003 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:51.989003 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:51.989003 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:51.989003 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:51.989846 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:51.989846 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:51.989846 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:51.989846 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:51.989846 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:51.989846 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:51.989846 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:51.989846 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:51.989846 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:51.989846 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:51.989846 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 20 22:11:51.989846 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 20 22:11:51.989846 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 20 22:11:51.989846 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:11:51.989846 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 503/997] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Sep 20 22:11:51 2022] GET /identity/v3/services/compute => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 20 22:11:51.995150 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46579ff-a763-452f-932d-218b9b2d7a2b None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:52.020959 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:52.027215 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f49cfc-2275-4f7b-bfd2-11654315d0fd None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:52.063830 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0c9b97-f308-4d34-8073-0099aab534e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:52.064486 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0c9b97-f308-4d34-8073-0099aab534e4 None admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:52.064706 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0c9b97-f308-4d34-8073-0099aab534e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:52.064972 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0c9b97-f308-4d34-8073-0099aab534e4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:52.065628 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0c9b97-f308-4d34-8073-0099aab534e4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:52.067728 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0c9b97-f308-4d34-8073-0099aab534e4 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:52.094540 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 495/998] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 20 22:11:51 2022] POST /identity/v3/endpoints => generated 325 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:11:52.117684 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46579ff-a763-452f-932d-218b9b2d7a2b None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:52.163116 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e3beb7-558d-40a2-9bfe-364c2f6b6ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:52.163828 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e3beb7-558d-40a2-9bfe-364c2f6b6ba1 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:52.164106 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e3beb7-558d-40a2-9bfe-364c2f6b6ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:52.164435 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e3beb7-558d-40a2-9bfe-364c2f6b6ba1 None admin] PATH_INFO: `/v3/services` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:52.165165 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e3beb7-558d-40a2-9bfe-364c2f6b6ba1 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:52.165473 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e3beb7-558d-40a2-9bfe-364c2f6b6ba1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:52.166864 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e3beb7-558d-40a2-9bfe-364c2f6b6ba1 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:52.176867 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 504/999] 10.222.0.33 () {56 vars in 1112 bytes} [Tue Sep 20 22:11:51 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 22:11:52.178420 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0c9b97-f308-4d34-8073-0099aab534e4 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:52.196272 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:52.288713 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0c9b97-f308-4d34-8073-0099aab534e4 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:52.329043 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75de707b-8140-4dd8-b619-ef7452a4fdab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:52.329651 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75de707b-8140-4dd8-b619-ef7452a4fdab None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:52.329928 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75de707b-8140-4dd8-b619-ef7452a4fdab None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:52.330196 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75de707b-8140-4dd8-b619-ef7452a4fdab None admin] PATH_INFO: `/v3/services` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:52.330876 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75de707b-8140-4dd8-b619-ef7452a4fdab None admin] RBAC: Adding query filter params (type=compute) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:52.331175 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75de707b-8140-4dd8-b619-ef7452a4fdab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:52.332562 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75de707b-8140-4dd8-b619-ef7452a4fdab None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:52.337524 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 496/1000] 10.222.0.33 () {56 vars in 1112 bytes} [Tue Sep 20 22:11:52 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:52.343314 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e3beb7-558d-40a2-9bfe-364c2f6b6ba1 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:52.424689 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:52.446214 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e3beb7-558d-40a2-9bfe-364c2f6b6ba1 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:52.480740 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168e12e1-3396-4ab6-8cad-da18006ab73b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:52.481347 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e12e1-3396-4ab6-8cad-da18006ab73b None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:52.481621 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e12e1-3396-4ab6-8cad-da18006ab73b None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:52.481890 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e12e1-3396-4ab6-8cad-da18006ab73b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:52.482605 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168e12e1-3396-4ab6-8cad-da18006ab73b None admin] RBAC: Adding query filter params (interface=public, service_id=d47e69cab5ee44149453862c4aaa5aee, region_id=RegionOne) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:52.482909 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168e12e1-3396-4ab6-8cad-da18006ab73b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:52.484251 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168e12e1-3396-4ab6-8cad-da18006ab73b None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:52.494109 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 505/1001] 10.222.0.33 () {56 vars in 1251 bytes} [Tue Sep 20 22:11:52 2022] GET /identity/v3/endpoints?service_id=d47e69cab5ee44149453862c4aaa5aee&interface=public®ion_id=RegionOne => generated 194 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:52.495747 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75de707b-8140-4dd8-b619-ef7452a4fdab None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:52.578354 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:52.603342 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75de707b-8140-4dd8-b619-ef7452a4fdab None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:52.636589 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fbdbcb-fa8d-48fb-9882-38ba7c480e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:52.637199 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fbdbcb-fa8d-48fb-9882-38ba7c480e3f None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:52.637481 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fbdbcb-fa8d-48fb-9882-38ba7c480e3f None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:52.637753 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fbdbcb-fa8d-48fb-9882-38ba7c480e3f None admin] PATH_INFO: `/v3/services` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:52.638354 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fbdbcb-fa8d-48fb-9882-38ba7c480e3f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:52.639764 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fbdbcb-fa8d-48fb-9882-38ba7c480e3f None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:52.654607 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 497/1002] 10.222.0.33 () {56 vars in 1087 bytes} [Tue Sep 20 22:11:52 2022] GET /identity/v3/services => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:11:52.929455 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921130a0-27ba-4f39-970d-53940f1f98a7 None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:52.929976 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921130a0-27ba-4f39-970d-53940f1f98a7 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:52.929976 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921130a0-27ba-4f39-970d-53940f1f98a7 None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:52.931490 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 506/1003] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:11:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:11:52.936483 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b862a88f-7573-41a8-8b35-a6ffbdccaf36 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:52.936774 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b862a88f-7573-41a8-8b35-a6ffbdccaf36 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:52.937053 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b862a88f-7573-41a8-8b35-a6ffbdccaf36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:52.959857 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-b862a88f-7573-41a8-8b35-a6ffbdccaf36 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:11:52.961046 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-b862a88f-7573-41a8-8b35-a6ffbdccaf36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:11:53.030336 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 498/1004] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:11:52 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 20 22:11:53.296654 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921130a0-27ba-4f39-970d-53940f1f98a7 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:53.404465 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921130a0-27ba-4f39-970d-53940f1f98a7 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:53.438887 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf834349-8845-48c5-a9e0-2cad8f2e7bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:53.439520 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf834349-8845-48c5-a9e0-2cad8f2e7bc7 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:53.439801 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf834349-8845-48c5-a9e0-2cad8f2e7bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:53.440077 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf834349-8845-48c5-a9e0-2cad8f2e7bc7 None admin] PATH_INFO: `/v3/services/image` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:53.440656 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf834349-8845-48c5-a9e0-2cad8f2e7bc7 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:53.442060 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf834349-8845-48c5-a9e0-2cad8f2e7bc7 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:53.450893 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-bf834349-8845-48c5-a9e0-2cad8f2e7bc7 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 20 22:11:53.450893 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:53.450893 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 20 22:11:53.450893 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 20 22:11:53.450893 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 20 22:11:53.450893 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 20 22:11:53.450893 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 20 22:11:53.450893 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 20 22:11:53.450893 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 20 22:11:53.450893 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:11:53.450893 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 20 22:11:53.450893 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:11:53.450893 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:53.450893 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:53.450893 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:53.450893 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:53.450893 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:53.451965 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:53.451965 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:53.451965 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:53.451965 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:53.451965 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:53.451965 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:53.451965 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 20 22:11:53.451965 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 20 22:11:53.451965 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 20 22:11:53.451965 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 20 22:11:53.451965 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:53.451965 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:53.451965 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:53.451965 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:53.451965 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:53.451965 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:53.452896 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:53.452896 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:53.452896 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:53.452896 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:53.452896 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:53.452896 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:53.452896 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:53.452896 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:53.452896 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:53.452896 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:53.452896 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 20 22:11:53.452896 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 20 22:11:53.452896 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 20 22:11:53.452896 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:11:53.452896 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 507/1005] 10.222.0.33 () {56 vars in 1105 bytes} [Tue Sep 20 22:11:53 2022] GET /identity/v3/services/image => generated 86 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:53.457981 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b862a88f-7573-41a8-8b35-a6ffbdccaf36 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:53.532488 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:53.565164 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b862a88f-7573-41a8-8b35-a6ffbdccaf36 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:53.598456 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d45df4-833c-4f82-a1f1-c1226281ff03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:53.599084 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d45df4-833c-4f82-a1f1-c1226281ff03 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:53.599365 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d45df4-833c-4f82-a1f1-c1226281ff03 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:53.599633 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d45df4-833c-4f82-a1f1-c1226281ff03 None admin] PATH_INFO: `/v3/services` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:53.600248 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d45df4-833c-4f82-a1f1-c1226281ff03 None admin] RBAC: Adding query filter params (name=image) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:53.600547 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d45df4-833c-4f82-a1f1-c1226281ff03 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:53.601953 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d45df4-833c-4f82-a1f1-c1226281ff03 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:53.607685 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 499/1006] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 20 22:11:53 2022] GET /identity/v3/services?name=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:53.612483 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf834349-8845-48c5-a9e0-2cad8f2e7bc7 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:53.624206 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:53.712478 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf834349-8845-48c5-a9e0-2cad8f2e7bc7 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:53.746983 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119b5d78-5f58-42c3-aa99-0fab478d7d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:53.747589 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119b5d78-5f58-42c3-aa99-0fab478d7d55 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:53.747868 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119b5d78-5f58-42c3-aa99-0fab478d7d55 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:53.748138 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119b5d78-5f58-42c3-aa99-0fab478d7d55 None admin] PATH_INFO: `/v3/services` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:53.748785 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119b5d78-5f58-42c3-aa99-0fab478d7d55 None admin] RBAC: Adding query filter params (type=image) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:53.749086 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119b5d78-5f58-42c3-aa99-0fab478d7d55 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:53.750444 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119b5d78-5f58-42c3-aa99-0fab478d7d55 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:53.755327 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 508/1007] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 20 22:11:53 2022] GET /identity/v3/services?type=image => generated 122 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 22:11:54.317455 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47f1b1e-8abc-4daf-a502-2f2b48fea35e None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:54.317740 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47f1b1e-8abc-4daf-a502-2f2b48fea35e None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:54.318007 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47f1b1e-8abc-4daf-a502-2f2b48fea35e None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:54.319617 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 500/1008] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:11:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:11:54.324677 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e23cb1-9fd3-47e8-b008-931b2c0a1e5e None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:54.325113 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e23cb1-9fd3-47e8-b008-931b2c0a1e5e None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:54.325295 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e23cb1-9fd3-47e8-b008-931b2c0a1e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:54.343771 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-68e23cb1-9fd3-47e8-b008-931b2c0a1e5e None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:11:54.344949 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-68e23cb1-9fd3-47e8-b008-931b2c0a1e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:11:54.413603 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 509/1009] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:11:54 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 20 22:11:54.684327 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47f1b1e-8abc-4daf-a502-2f2b48fea35e None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:54.791286 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47f1b1e-8abc-4daf-a502-2f2b48fea35e None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:54.806903 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d1f5ab-4b2b-4c93-99e6-ab20b57da1ff None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:54.807188 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d1f5ab-4b2b-4c93-99e6-ab20b57da1ff None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:54.807453 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d1f5ab-4b2b-4c93-99e6-ab20b57da1ff None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:54.808902 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 510/1010] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:11:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 20 22:11:54.813464 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868f77e4-b57b-4ece-a9bb-705b333d433b None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:54.813743 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868f77e4-b57b-4ece-a9bb-705b333d433b None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:54.814021 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868f77e4-b57b-4ece-a9bb-705b333d433b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:54.820823 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:54.829468 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2313bbb-53c4-4250-9b93-e768d7046e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:54.830307 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2313bbb-53c4-4250-9b93-e768d7046e00 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:54.830770 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2313bbb-53c4-4250-9b93-e768d7046e00 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:54.831184 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2313bbb-53c4-4250-9b93-e768d7046e00 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:54.832483 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-868f77e4-b57b-4ece-a9bb-705b333d433b None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:11:54.832714 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2313bbb-53c4-4250-9b93-e768d7046e00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:54.833661 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-868f77e4-b57b-4ece-a9bb-705b333d433b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:11:54.834561 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2313bbb-53c4-4250-9b93-e768d7046e00 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:54.836618 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 501/1011] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 20 22:11:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:54.842164 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2313bbb-53c4-4250-9b93-e768d7046e00 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:54.846077 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:54.917870 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 511/1012] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:11:54 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 20 22:11:54.954652 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2313bbb-53c4-4250-9b93-e768d7046e00 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:54.995563 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c5ff90-2947-4b85-bb72-5be9b0470a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:54.996171 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c5ff90-2947-4b85-bb72-5be9b0470a66 None admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:54.996447 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c5ff90-2947-4b85-bb72-5be9b0470a66 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:54.996712 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c5ff90-2947-4b85-bb72-5be9b0470a66 None admin] PATH_INFO: `/v3/projects` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:54.997350 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c5ff90-2947-4b85-bb72-5be9b0470a66 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:54.998772 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c5ff90-2947-4b85-bb72-5be9b0470a66 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:55.028708 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 502/1013] 10.222.0.33 () {60 vars in 1141 bytes} [Tue Sep 20 22:11:54 2022] POST /identity/v3/projects => generated 311 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 20 22:11:55.191881 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868f77e4-b57b-4ece-a9bb-705b333d433b None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:55.291838 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868f77e4-b57b-4ece-a9bb-705b333d433b None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:55.323031 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:55.329171 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9f0eb7-7b7b-4a65-8665-bbdda4b4400b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:55.329856 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9f0eb7-7b7b-4a65-8665-bbdda4b4400b None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:55.330070 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9f0eb7-7b7b-4a65-8665-bbdda4b4400b None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:55.330332 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9f0eb7-7b7b-4a65-8665-bbdda4b4400b None admin] PATH_INFO: `/v3/services/compute` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:55.330934 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9f0eb7-7b7b-4a65-8665-bbdda4b4400b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:55.332329 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9f0eb7-7b7b-4a65-8665-bbdda4b4400b None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:55.341325 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-5e9f0eb7-7b7b-4a65-8665-bbdda4b4400b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 20 22:11:55.341325 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:55.341325 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 20 22:11:55.341325 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 20 22:11:55.341325 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 20 22:11:55.341325 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 20 22:11:55.341325 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 20 22:11:55.341325 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 20 22:11:55.341325 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 20 22:11:55.341325 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:11:55.341325 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 20 22:11:55.341325 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:11:55.341325 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:55.341325 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:55.341325 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:55.341325 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:55.341325 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:55.342335 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:55.342335 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:55.342335 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:55.342335 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:55.342335 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:55.342335 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:55.342335 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 20 22:11:55.342335 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 20 22:11:55.342335 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 20 22:11:55.342335 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 20 22:11:55.342335 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:55.342335 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:55.342335 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:55.342335 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:55.342335 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:55.342335 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:55.343883 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:55.343883 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:55.343883 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:55.343883 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:55.343883 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:55.343883 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:55.343883 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:55.343883 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:55.343883 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:55.343883 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:55.343883 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 20 22:11:55.343883 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 20 22:11:55.343883 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 20 22:11:55.343883 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:11:55.343883 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 512/1014] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Sep 20 22:11:55 2022] GET /identity/v3/services/compute => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:55.348429 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c5ff90-2947-4b85-bb72-5be9b0470a66 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:55.405497 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:55.454708 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c5ff90-2947-4b85-bb72-5be9b0470a66 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:55.490891 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eded7a-7df5-4444-963e-26e55c098a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:55.491502 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eded7a-7df5-4444-963e-26e55c098a0f None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:55.491780 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eded7a-7df5-4444-963e-26e55c098a0f None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:55.492048 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eded7a-7df5-4444-963e-26e55c098a0f None admin] PATH_INFO: `/v3/services` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:55.492671 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eded7a-7df5-4444-963e-26e55c098a0f None admin] RBAC: Adding query filter params (name=compute) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:55.492969 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eded7a-7df5-4444-963e-26e55c098a0f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:55.494332 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eded7a-7df5-4444-963e-26e55c098a0f None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:55.504729 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 503/1015] 10.222.0.33 () {56 vars in 1112 bytes} [Tue Sep 20 22:11:55 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:55.505988 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9f0eb7-7b7b-4a65-8665-bbdda4b4400b None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:55.609718 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9f0eb7-7b7b-4a65-8665-bbdda4b4400b None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:55.644648 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e87667-2c45-4dd6-95fe-0016552b1d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:55.645246 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e87667-2c45-4dd6-95fe-0016552b1d0f None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:55.645524 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e87667-2c45-4dd6-95fe-0016552b1d0f None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:55.645794 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e87667-2c45-4dd6-95fe-0016552b1d0f None admin] PATH_INFO: `/v3/services` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:55.646416 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e87667-2c45-4dd6-95fe-0016552b1d0f None admin] RBAC: Adding query filter params (type=compute) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:55.646748 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e87667-2c45-4dd6-95fe-0016552b1d0f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:55.648156 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e87667-2c45-4dd6-95fe-0016552b1d0f None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:55.653865 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 513/1016] 10.222.0.33 () {56 vars in 1112 bytes} [Tue Sep 20 22:11:55 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 22:11:55.658656 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eded7a-7df5-4444-963e-26e55c098a0f None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:55.762524 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eded7a-7df5-4444-963e-26e55c098a0f None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:55.783089 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:55.798486 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e85a8b2-051e-4a2d-9bb7-92b831bf407d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:55.799320 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e85a8b2-051e-4a2d-9bb7-92b831bf407d None admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:55.799609 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e85a8b2-051e-4a2d-9bb7-92b831bf407d None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:55.799884 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e85a8b2-051e-4a2d-9bb7-92b831bf407d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:55.800584 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e85a8b2-051e-4a2d-9bb7-92b831bf407d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:55.801949 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e85a8b2-051e-4a2d-9bb7-92b831bf407d None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:55.830549 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 504/1017] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 20 22:11:55 2022] POST /identity/v3/endpoints => generated 334 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:11:55.958897 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d323e9b-e215-4e8a-bb8e-f510c5c70b04 None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:55.959082 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d323e9b-e215-4e8a-bb8e-f510c5c70b04 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:55.959351 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d323e9b-e215-4e8a-bb8e-f510c5c70b04 None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:55.961033 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 514/1018] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:11:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:11:55.966902 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb80ef5-e0fe-42b0-91a7-1ada3cc04e15 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:55.967220 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb80ef5-e0fe-42b0-91a7-1ada3cc04e15 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:55.967455 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb80ef5-e0fe-42b0-91a7-1ada3cc04e15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:55.987800 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-aeb80ef5-e0fe-42b0-91a7-1ada3cc04e15 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:11:55.989661 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-aeb80ef5-e0fe-42b0-91a7-1ada3cc04e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:11:56.065789 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 505/1019] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:11:55 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 20 22:11:56.330264 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d323e9b-e215-4e8a-bb8e-f510c5c70b04 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:56.392219 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:56.436391 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d323e9b-e215-4e8a-bb8e-f510c5c70b04 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:56.470664 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b59428-dcd9-41ff-a8bf-f918792a497d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:56.471274 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b59428-dcd9-41ff-a8bf-f918792a497d None admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:56.471546 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b59428-dcd9-41ff-a8bf-f918792a497d None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:56.471815 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b59428-dcd9-41ff-a8bf-f918792a497d None admin] PATH_INFO: `/v3/services` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:56.472535 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b59428-dcd9-41ff-a8bf-f918792a497d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:56.473875 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b59428-dcd9-41ff-a8bf-f918792a497d None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:56.491714 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 515/1020] 10.222.0.33 () {60 vars in 1141 bytes} [Tue Sep 20 22:11:56 2022] POST /identity/v3/services => generated 242 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:11:57.245907 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17558ff-e813-41c0-99d6-4cd88e7c0e20 None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:57.246425 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17558ff-e813-41c0-99d6-4cd88e7c0e20 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:57.246526 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17558ff-e813-41c0-99d6-4cd88e7c0e20 None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:57.247869 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 506/1021] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:11:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:11:57.253025 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf31c41-d7a2-4956-a63b-db0cb7b8daf6 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:57.253315 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf31c41-d7a2-4956-a63b-db0cb7b8daf6 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:57.254125 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf31c41-d7a2-4956-a63b-db0cb7b8daf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:57.272770 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-3cf31c41-d7a2-4956-a63b-db0cb7b8daf6 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:11:57.273952 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-3cf31c41-d7a2-4956-a63b-db0cb7b8daf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:11:57.353102 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 516/1022] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:11:57 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 20 22:11:57.624410 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17558ff-e813-41c0-99d6-4cd88e7c0e20 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:57.728933 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17558ff-e813-41c0-99d6-4cd88e7c0e20 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:57.730649 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:57.767606 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4567bd7-7ef4-4fa5-97a2-64d5de767218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:57.768244 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4567bd7-7ef4-4fa5-97a2-64d5de767218 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:57.768526 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4567bd7-7ef4-4fa5-97a2-64d5de767218 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:57.768795 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4567bd7-7ef4-4fa5-97a2-64d5de767218 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:57.769987 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4567bd7-7ef4-4fa5-97a2-64d5de767218 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:57.771449 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4567bd7-7ef4-4fa5-97a2-64d5de767218 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:57.773181 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 507/1023] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 20 22:11:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:57.779027 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf31c41-d7a2-4956-a63b-db0cb7b8daf6 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:57.825713 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:57.880065 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf31c41-d7a2-4956-a63b-db0cb7b8daf6 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:57.914256 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6132791f-e30c-4b0a-9943-fee216a8f8a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:57.914887 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6132791f-e30c-4b0a-9943-fee216a8f8a9 None admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:57.915168 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6132791f-e30c-4b0a-9943-fee216a8f8a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:57.915441 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6132791f-e30c-4b0a-9943-fee216a8f8a9 None admin] PATH_INFO: `/v3/users` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:57.916083 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6132791f-e30c-4b0a-9943-fee216a8f8a9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:57.917496 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6132791f-e30c-4b0a-9943-fee216a8f8a9 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:57.946531 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 517/1024] 10.222.0.33 () {60 vars in 1132 bytes} [Tue Sep 20 22:11:57 2022] POST /identity/v3/users => generated 285 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 20 22:11:58.118160 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adeb8c4-cb56-490c-9edc-28b820b7b100 None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:58.118442 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adeb8c4-cb56-490c-9edc-28b820b7b100 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:58.118757 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adeb8c4-cb56-490c-9edc-28b820b7b100 None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:58.120313 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 508/1025] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:11:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:11:58.125650 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee983d7-b2a5-493f-8911-1a4537d855d3 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:58.125930 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee983d7-b2a5-493f-8911-1a4537d855d3 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:58.126200 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee983d7-b2a5-493f-8911-1a4537d855d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:58.146578 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-dee983d7-b2a5-493f-8911-1a4537d855d3 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:11:58.147708 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-dee983d7-b2a5-493f-8911-1a4537d855d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:11:58.217156 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 518/1026] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:11:58 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 20 22:11:58.505520 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adeb8c4-cb56-490c-9edc-28b820b7b100 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:58.619053 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adeb8c4-cb56-490c-9edc-28b820b7b100 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:58.663243 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00036d72-1d33-4131-b50b-92f3e4e04014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:58.664227 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00036d72-1d33-4131-b50b-92f3e4e04014 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:58.664653 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00036d72-1d33-4131-b50b-92f3e4e04014 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:58.665082 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00036d72-1d33-4131-b50b-92f3e4e04014 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:58.675474 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00036d72-1d33-4131-b50b-92f3e4e04014 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 22:11:58.681293 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-00036d72-1d33-4131-b50b-92f3e4e04014 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 20 22:11:58.681293 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:58.681293 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:58.681293 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:58.681293 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:58.681293 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:58.681293 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:58.681293 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:58.681293 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:58.681293 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:58.681293 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:58.681293 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:58.681293 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 22:11:58.681293 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 22:11:58.681293 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 22:11:58.681293 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 22:11:58.682426 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 22:11:58.682426 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 22:11:58.682426 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 22:11:58.682426 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 22:11:58.682426 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:58.682426 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:58.682426 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:58.682426 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:58.682426 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:58.682426 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:58.682426 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:58.682426 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:58.682426 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:58.682426 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:58.682426 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:58.682426 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:58.683482 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:58.683482 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:58.683482 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:58.683482 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:58.683482 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 22:11:58.683482 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 22:11:58.683482 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 22:11:58.683482 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 22:11:58.683482 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 22:11:58.683482 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 22:11:58.683482 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 20 22:11:58.683482 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:11:58.684269 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208afa94-270a-494e-9871-adcd926713b6 None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:58.684269 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208afa94-270a-494e-9871-adcd926713b6 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:58.684269 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208afa94-270a-494e-9871-adcd926713b6 None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:58.684269 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 519/1027] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:11:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 20 22:11:58.686299 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 509/1028] 10.222.0.33 () {56 vars in 1120 bytes} [Tue Sep 20 22:11:58 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:58.688260 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770b9de1-f2b0-4991-8492-5244cde014ab None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:58.688621 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770b9de1-f2b0-4991-8492-5244cde014ab None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:58.688973 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770b9de1-f2b0-4991-8492-5244cde014ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:58.691716 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00036d72-1d33-4131-b50b-92f3e4e04014 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:58.707086 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-770b9de1-f2b0-4991-8492-5244cde014ab None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:11:58.708358 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-770b9de1-f2b0-4991-8492-5244cde014ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:11:58.726346 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:58.735993 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:58.781201 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 520/1029] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:11:58 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 20 22:11:58.802952 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00036d72-1d33-4131-b50b-92f3e4e04014 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:58.837354 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e658a5b5-5f50-4a44-bd90-0bcc78f7d906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:58.837955 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e658a5b5-5f50-4a44-bd90-0bcc78f7d906 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:58.838233 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e658a5b5-5f50-4a44-bd90-0bcc78f7d906 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:58.838501 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e658a5b5-5f50-4a44-bd90-0bcc78f7d906 None admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:58.839182 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e658a5b5-5f50-4a44-bd90-0bcc78f7d906 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:58.839482 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e658a5b5-5f50-4a44-bd90-0bcc78f7d906 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:58.840836 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e658a5b5-5f50-4a44-bd90-0bcc78f7d906 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:58.849505 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 510/1030] 10.222.0.33 () {56 vars in 1115 bytes} [Tue Sep 20 22:11:58 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 22:11:58.855145 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770b9de1-f2b0-4991-8492-5244cde014ab None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:58.962406 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770b9de1-f2b0-4991-8492-5244cde014ab None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:59.000116 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39e2d78-72e5-498f-8dae-e05840d44347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:59.000985 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e2d78-72e5-498f-8dae-e05840d44347 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:59.001437 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e2d78-72e5-498f-8dae-e05840d44347 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:59.001857 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e2d78-72e5-498f-8dae-e05840d44347 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:59.012311 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39e2d78-72e5-498f-8dae-e05840d44347 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:59.013893 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39e2d78-72e5-498f-8dae-e05840d44347 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:59.028197 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-c39e2d78-72e5-498f-8dae-e05840d44347 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:11:59.028197 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:59.028197 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:59.028197 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:59.028197 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:59.028197 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:59.028197 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:59.028197 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:59.028197 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:59.028197 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:59.028197 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:59.028197 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:59.028197 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 22:11:59.028197 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 22:11:59.028197 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 22:11:59.028197 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 22:11:59.029305 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:59.029305 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:59.029305 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:59.029305 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:59.029305 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:59.029305 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:59.029305 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:59.029305 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:59.029305 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:59.029305 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:59.029305 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:59.029305 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:59.029305 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:59.029305 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:59.029305 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:59.029305 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:59.029305 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 22:11:59.030421 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 22:11:59.030421 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:11:59.030421 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:11:59.031986 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 521/1031] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 20 22:11:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:11:59.037979 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e658a5b5-5f50-4a44-bd90-0bcc78f7d906 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:59.063031 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39e2d78-72e5-498f-8dae-e05840d44347 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:59.078854 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:59.139099 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:59.149493 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e658a5b5-5f50-4a44-bd90-0bcc78f7d906 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:59.177335 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39e2d78-72e5-498f-8dae-e05840d44347 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:59.184539 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb0e6e5-7ba7-441d-8261-71cfb729721d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:59.185153 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb0e6e5-7ba7-441d-8261-71cfb729721d None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:59.185430 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb0e6e5-7ba7-441d-8261-71cfb729721d None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:59.185699 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb0e6e5-7ba7-441d-8261-71cfb729721d None admin] PATH_INFO: `/v3/domains` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:59.186331 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb0e6e5-7ba7-441d-8261-71cfb729721d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:59.186653 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb0e6e5-7ba7-441d-8261-71cfb729721d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:59.188008 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb0e6e5-7ba7-441d-8261-71cfb729721d None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:59.201561 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 511/1032] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 20 22:11:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:59.207530 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb0e6e5-7ba7-441d-8261-71cfb729721d None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:59.213109 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272a6015-0e66-4e38-a62f-54673f2cc704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:59.213746 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272a6015-0e66-4e38-a62f-54673f2cc704 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:59.214020 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272a6015-0e66-4e38-a62f-54673f2cc704 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:59.214291 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272a6015-0e66-4e38-a62f-54673f2cc704 None admin] PATH_INFO: `/v3/services/image` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:59.214905 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272a6015-0e66-4e38-a62f-54673f2cc704 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:59.216696 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272a6015-0e66-4e38-a62f-54673f2cc704 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:59.227143 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-272a6015-0e66-4e38-a62f-54673f2cc704 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 20 22:11:59.227143 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:59.227143 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 20 22:11:59.227143 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 20 22:11:59.227143 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 20 22:11:59.227143 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 20 22:11:59.227143 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 20 22:11:59.227143 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 20 22:11:59.227143 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 20 22:11:59.227143 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:11:59.227143 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 20 22:11:59.227143 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:11:59.227143 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:59.227143 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:59.227143 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:59.227143 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:59.227143 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:59.231709 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:59.231709 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:59.231709 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:59.231709 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:59.231709 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:59.231709 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:59.231709 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 20 22:11:59.231709 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 20 22:11:59.231709 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 20 22:11:59.231709 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 20 22:11:59.231709 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:59.231709 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:59.231709 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:59.231709 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:59.231709 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:59.231709 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:59.233022 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:59.233022 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:59.233022 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:59.233022 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:59.233022 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:59.233022 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:59.233022 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:59.233022 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:59.233022 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:59.233022 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:59.233022 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 20 22:11:59.233022 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 20 22:11:59.233022 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 20 22:11:59.233022 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:11:59.233022 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 522/1033] 10.222.0.33 () {56 vars in 1105 bytes} [Tue Sep 20 22:11:59 2022] GET /identity/v3/services/image => generated 86 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 20 22:11:59.235096 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272a6015-0e66-4e38-a62f-54673f2cc704 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:59.321498 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb0e6e5-7ba7-441d-8261-71cfb729721d None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:59.325992 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:59.351930 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272a6015-0e66-4e38-a62f-54673f2cc704 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:59.357893 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4d504f-b582-4192-8a49-76d2f33d771c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:59.358536 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4d504f-b582-4192-8a49-76d2f33d771c None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:59.358821 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4d504f-b582-4192-8a49-76d2f33d771c None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:59.359088 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4d504f-b582-4192-8a49-76d2f33d771c None admin] PATH_INFO: `/v3/users/nova` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:59.366133 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4d504f-b582-4192-8a49-76d2f33d771c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:59.367591 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4d504f-b582-4192-8a49-76d2f33d771c None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:59.378790 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-6f4d504f-b582-4192-8a49-76d2f33d771c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 20 22:11:59.378790 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:11:59.378790 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:11:59.378790 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:11:59.378790 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:11:59.378790 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:11:59.378790 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:11:59.378790 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:11:59.378790 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:11:59.378790 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:11:59.378790 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:11:59.378790 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:11:59.378790 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 20 22:11:59.378790 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 20 22:11:59.378790 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 20 22:11:59.378790 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 20 22:11:59.379746 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:11:59.379746 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:11:59.379746 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 20 22:11:59.379746 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 22:11:59.379746 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 20 22:11:59.379746 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 22:11:59.379746 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:11:59.379746 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:11:59.379746 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:11:59.379746 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:11:59.379746 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:11:59.379746 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:11:59.379746 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:11:59.379746 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:11:59.379746 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:11:59.379746 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:11:59.379746 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:11:59.379746 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:11:59.380704 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:11:59.380704 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:11:59.380704 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 20 22:11:59.380704 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 20 22:11:59.380704 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 20 22:11:59.380704 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 20 22:11:59.380704 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 20 22:11:59.380704 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 20 22:11:59.380704 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 20 22:11:59.380704 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:11:59.380704 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 512/1034] 10.222.0.33 () {56 vars in 1093 bytes} [Tue Sep 20 22:11:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 20 22:11:59.385539 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4d504f-b582-4192-8a49-76d2f33d771c None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:59.390827 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50e91a5-c05e-4785-b0f3-45788dd9f787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:59.391437 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50e91a5-c05e-4785-b0f3-45788dd9f787 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:59.391713 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50e91a5-c05e-4785-b0f3-45788dd9f787 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:59.391983 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50e91a5-c05e-4785-b0f3-45788dd9f787 None admin] PATH_INFO: `/v3/services` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:59.392606 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50e91a5-c05e-4785-b0f3-45788dd9f787 None admin] RBAC: Adding query filter params (name=image) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:59.392905 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50e91a5-c05e-4785-b0f3-45788dd9f787 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:59.394996 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50e91a5-c05e-4785-b0f3-45788dd9f787 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:59.400127 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:59.405861 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 523/1035] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 20 22:11:59 2022] GET /identity/v3/services?name=image => generated 122 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 22:11:59.406566 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50e91a5-c05e-4785-b0f3-45788dd9f787 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:59.484522 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4d504f-b582-4192-8a49-76d2f33d771c None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:59.509558 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50e91a5-c05e-4785-b0f3-45788dd9f787 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:59.517515 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b3ab3e-440e-443f-a707-3cba38334e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:59.518120 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b3ab3e-440e-443f-a707-3cba38334e5b None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:59.518394 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b3ab3e-440e-443f-a707-3cba38334e5b None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:59.518691 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b3ab3e-440e-443f-a707-3cba38334e5b None admin] PATH_INFO: `/v3/users` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:59.520032 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b3ab3e-440e-443f-a707-3cba38334e5b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:59.520335 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b3ab3e-440e-443f-a707-3cba38334e5b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:59.521742 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b3ab3e-440e-443f-a707-3cba38334e5b None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:59.538550 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 513/1036] 10.222.0.33 () {56 vars in 1133 bytes} [Tue Sep 20 22:11:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 22:11:59.544178 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b3ab3e-440e-443f-a707-3cba38334e5b None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:59.545917 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216e8e4c-d041-42d4-9c7e-fa80541e1a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:59.546482 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216e8e4c-d041-42d4-9c7e-fa80541e1a2c None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:59.546772 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216e8e4c-d041-42d4-9c7e-fa80541e1a2c None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:59.547046 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216e8e4c-d041-42d4-9c7e-fa80541e1a2c None admin] PATH_INFO: `/v3/services` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:59.547665 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216e8e4c-d041-42d4-9c7e-fa80541e1a2c None admin] RBAC: Adding query filter params (type=image) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:59.547968 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216e8e4c-d041-42d4-9c7e-fa80541e1a2c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:59.549342 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216e8e4c-d041-42d4-9c7e-fa80541e1a2c None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:59.554615 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 524/1037] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 20 22:11:59 2022] GET /identity/v3/services?type=image => generated 350 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:11:59.560120 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216e8e4c-d041-42d4-9c7e-fa80541e1a2c None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:59.569121 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:59.613639 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:59.646380 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b3ab3e-440e-443f-a707-3cba38334e5b None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:59.669381 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216e8e4c-d041-42d4-9c7e-fa80541e1a2c None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:59.681550 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8056ec8e-2fbe-470f-a9ab-80e82972ca18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:59.682159 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8056ec8e-2fbe-470f-a9ab-80e82972ca18 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:59.682436 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8056ec8e-2fbe-470f-a9ab-80e82972ca18 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:59.682742 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8056ec8e-2fbe-470f-a9ab-80e82972ca18 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:59.705227 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e00385-17c4-4828-924f-ffb506686386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:59.705838 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e00385-17c4-4828-924f-ffb506686386 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:59.706090 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e00385-17c4-4828-924f-ffb506686386 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:59.706356 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e00385-17c4-4828-924f-ffb506686386 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:59.707695 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e00385-17c4-4828-924f-ffb506686386 None admin] RBAC: Adding query filter params (interface=public, service_id=079e9a62b0f349d7a11320ff59f0fc9e, region_id=RegionOne) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:11:59.708001 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e00385-17c4-4828-924f-ffb506686386 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:59.709373 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e00385-17c4-4828-924f-ffb506686386 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:59.714797 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 525/1038] 10.222.0.33 () {56 vars in 1251 bytes} [Tue Sep 20 22:11:59 2022] GET /identity/v3/endpoints?service_id=079e9a62b0f349d7a11320ff59f0fc9e&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 22:11:59.720094 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e00385-17c4-4828-924f-ffb506686386 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:11:59.759482 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8056ec8e-2fbe-470f-a9ab-80e82972ca18 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:59.760939 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8056ec8e-2fbe-470f-a9ab-80e82972ca18 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:59.790643 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:59.825911 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e00385-17c4-4828-924f-ffb506686386 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:11:59.835874 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:11:59.860803 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916dd770-96a7-460e-8837-ebd61e0d3609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:11:59.861410 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916dd770-96a7-460e-8837-ebd61e0d3609 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:11:59.861687 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916dd770-96a7-460e-8837-ebd61e0d3609 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:11:59.861952 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916dd770-96a7-460e-8837-ebd61e0d3609 None admin] PATH_INFO: `/v3/services` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:11:59.862575 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916dd770-96a7-460e-8837-ebd61e0d3609 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:11:59.864499 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916dd770-96a7-460e-8837-ebd61e0d3609 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:11:59.871146 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 526/1039] 10.222.0.33 () {56 vars in 1087 bytes} [Tue Sep 20 22:11:59 2022] GET /identity/v3/services => generated 1957 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 20 22:11:59.874231 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 514/1040] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 20 22:11:59 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 20 22:11:59.880422 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916dd770-96a7-460e-8837-ebd61e0d3609 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:12:00.000029 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916dd770-96a7-460e-8837-ebd61e0d3609 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:12:00.037384 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112c911e-4d1d-4c59-8de9-d7b30c93e192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:12:00.038027 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112c911e-4d1d-4c59-8de9-d7b30c93e192 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:00.038302 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112c911e-4d1d-4c59-8de9-d7b30c93e192 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:00.038598 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112c911e-4d1d-4c59-8de9-d7b30c93e192 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:00.040667 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:12:00.052867 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112c911e-4d1d-4c59-8de9-d7b30c93e192 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:12:00.053580 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112c911e-4d1d-4c59-8de9-d7b30c93e192 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:12:00.070578 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-112c911e-4d1d-4c59-8de9-d7b30c93e192 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:12:00.070578 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:12:00.070578 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:12:00.070578 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:12:00.070578 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:12:00.070578 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:12:00.070578 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:12:00.070578 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:12:00.070578 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:12:00.070578 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:12:00.070578 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:12:00.070578 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:12:00.070578 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 22:12:00.070578 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 22:12:00.070578 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 22:12:00.070578 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 22:12:00.071771 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:12:00.071771 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:12:00.071771 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:12:00.071771 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:12:00.071771 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:12:00.071771 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:12:00.071771 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:12:00.071771 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:12:00.071771 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:12:00.071771 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:12:00.071771 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:12:00.071771 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:12:00.071771 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:12:00.071771 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:12:00.071771 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:12:00.071771 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:12:00.071771 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 22:12:00.072860 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 22:12:00.072860 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:12:00.072860 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:12:00.072860 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 527/1041] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 20 22:11:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:12:00.077936 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8056ec8e-2fbe-470f-a9ab-80e82972ca18 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:12:00.182432 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8056ec8e-2fbe-470f-a9ab-80e82972ca18 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:12:00.192033 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d8c0d-f898-4a7a-bb95-a9e284b3f78c None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:00.192315 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d8c0d-f898-4a7a-bb95-a9e284b3f78c None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:00.192579 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d8c0d-f898-4a7a-bb95-a9e284b3f78c None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:00.194279 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 528/1042] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:12:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 20 22:12:00.198878 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625ff43c-3054-4f01-9364-7d0194afbca6 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:00.199274 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625ff43c-3054-4f01-9364-7d0194afbca6 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:00.199642 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625ff43c-3054-4f01-9364-7d0194afbca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:00.219432 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e47d227-65d5-4f30-9f48-5dca1a25e983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:12:00.220040 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e47d227-65d5-4f30-9f48-5dca1a25e983 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:00.220313 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e47d227-65d5-4f30-9f48-5dca1a25e983 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:00.220577 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e47d227-65d5-4f30-9f48-5dca1a25e983 None admin] PATH_INFO: `/v3/domains` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:00.221205 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-625ff43c-3054-4f01-9364-7d0194afbca6 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:12:00.221310 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e47d227-65d5-4f30-9f48-5dca1a25e983 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:12:00.221503 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e47d227-65d5-4f30-9f48-5dca1a25e983 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:12:00.222706 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-625ff43c-3054-4f01-9364-7d0194afbca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:12:00.222913 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e47d227-65d5-4f30-9f48-5dca1a25e983 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:12:00.236171 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 515/1043] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 20 22:12:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:12:00.241616 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e47d227-65d5-4f30-9f48-5dca1a25e983 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:12:00.274474 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:12:00.306547 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 529/1044] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:12:00 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 20 22:12:00.356305 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e47d227-65d5-4f30-9f48-5dca1a25e983 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:12:00.390729 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf005f0e-f4e2-46b3-afad-0a8c6b87045a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:12:00.391365 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf005f0e-f4e2-46b3-afad-0a8c6b87045a None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:00.391646 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf005f0e-f4e2-46b3-afad-0a8c6b87045a None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:00.391919 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf005f0e-f4e2-46b3-afad-0a8c6b87045a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:00.399303 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf005f0e-f4e2-46b3-afad-0a8c6b87045a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:12:00.400748 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf005f0e-f4e2-46b3-afad-0a8c6b87045a None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:12:00.412072 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-cf005f0e-f4e2-46b3-afad-0a8c6b87045a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 22:12:00.412072 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:12:00.412072 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:12:00.412072 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:12:00.412072 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:12:00.412072 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:12:00.412072 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:12:00.412072 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:12:00.412072 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:12:00.412072 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:12:00.412072 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:12:00.412072 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:12:00.412072 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 20 22:12:00.412072 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 20 22:12:00.412072 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 20 22:12:00.412944 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 20 22:12:00.412944 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:12:00.412944 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:12:00.412944 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:12:00.412944 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:12:00.412944 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:12:00.412944 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:12:00.412944 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:12:00.412944 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:12:00.412944 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:12:00.412944 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:12:00.412944 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:12:00.412944 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:12:00.412944 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:12:00.412944 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:12:00.412944 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:12:00.412944 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:12:00.413853 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 20 22:12:00.413853 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 20 22:12:00.413853 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 20 22:12:00.413853 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 20 22:12:00.413853 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 20 22:12:00.413853 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 20 22:12:00.413853 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 22:12:00.413853 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:12:00.413853 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 516/1045] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Sep 20 22:12:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 20 22:12:00.419039 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625ff43c-3054-4f01-9364-7d0194afbca6 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:12:00.521265 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625ff43c-3054-4f01-9364-7d0194afbca6 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:12:00.537384 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:12:00.556559 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f33d77-4ec5-45bd-bccf-52339d29e7b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:12:00.557169 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f33d77-4ec5-45bd-bccf-52339d29e7b0 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:00.557446 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f33d77-4ec5-45bd-bccf-52339d29e7b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:00.557716 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f33d77-4ec5-45bd-bccf-52339d29e7b0 None admin] PATH_INFO: `/v3/projects` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:00.558397 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f33d77-4ec5-45bd-bccf-52339d29e7b0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:12:00.558729 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f33d77-4ec5-45bd-bccf-52339d29e7b0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:12:00.560148 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f33d77-4ec5-45bd-bccf-52339d29e7b0 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:12:00.576961 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 530/1046] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Sep 20 22:12:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 22:12:00.578698 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf005f0e-f4e2-46b3-afad-0a8c6b87045a None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:12:00.579935 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f33d77-4ec5-45bd-bccf-52339d29e7b0 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:12:00.682789 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:12:00.689701 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f33d77-4ec5-45bd-bccf-52339d29e7b0 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:12:00.695241 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf005f0e-f4e2-46b3-afad-0a8c6b87045a None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:12:00.725344 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5a884b-898b-4c47-9606-158220ddd22f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:12:00.726305 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a884b-898b-4c47-9606-158220ddd22f None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:00.726626 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a884b-898b-4c47-9606-158220ddd22f None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:00.727052 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a884b-898b-4c47-9606-158220ddd22f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:00.730623 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e3ecf5-8fa0-4131-b268-f324875784b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:12:00.731229 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e3ecf5-8fa0-4131-b268-f324875784b7 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:00.731508 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e3ecf5-8fa0-4131-b268-f324875784b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:00.731779 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e3ecf5-8fa0-4131-b268-f324875784b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:00.732544 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e3ecf5-8fa0-4131-b268-f324875784b7 None admin] RBAC: Adding query filter params (role.id=9fd7d9b8b5224290acc6e44595c9000b, scope.project.id=3ce415d02aa9489bae19cd514805fd8c, user.id=db7eed561e99452289a662ad326cf919) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:12:00.732797 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e3ecf5-8fa0-4131-b268-f324875784b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:12:00.734212 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e3ecf5-8fa0-4131-b268-f324875784b7 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:12:00.737329 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5a884b-898b-4c47-9606-158220ddd22f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 22:12:00.740502 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 517/1047] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Sep 20 22:12:00 2022] GET /identity/v3/role_assignments?user.id=db7eed561e99452289a662ad326cf919&scope.project.id=3ce415d02aa9489bae19cd514805fd8c&role.id=9fd7d9b8b5224290acc6e44595c9000b => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 22:12:00.743443 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-6b5a884b-898b-4c47-9606-158220ddd22f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 22:12:00.743443 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:12:00.743443 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:12:00.743443 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:12:00.743443 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:12:00.743443 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:12:00.743443 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:12:00.743443 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:12:00.743443 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:12:00.743443 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:12:00.743443 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:12:00.743443 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:12:00.743443 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 22:12:00.743443 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 22:12:00.743443 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 22:12:00.743443 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 22:12:00.744468 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 22:12:00.744468 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 22:12:00.744468 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 22:12:00.744468 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 22:12:00.744468 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:12:00.744468 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:12:00.744468 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:12:00.744468 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:12:00.744468 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:12:00.744468 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:12:00.744468 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:12:00.744468 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:12:00.744468 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:12:00.744468 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:12:00.744468 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:12:00.744468 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:12:00.745315 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:12:00.745315 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:12:00.745315 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:12:00.745315 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:12:00.745315 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 22:12:00.745315 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 22:12:00.745315 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 22:12:00.745315 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 22:12:00.745315 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 22:12:00.745315 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 22:12:00.745315 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 22:12:00.745315 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:12:00.745315 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 531/1048] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Sep 20 22:12:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:12:00.751178 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e3ecf5-8fa0-4131-b268-f324875784b7 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:12:00.863956 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e3ecf5-8fa0-4131-b268-f324875784b7 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:12:00.899932 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c056b7b-fc61-44c3-a86a-899630fad56e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:12:00.900556 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c056b7b-fc61-44c3-a86a-899630fad56e None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:00.900836 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c056b7b-fc61-44c3-a86a-899630fad56e None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:00.901107 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c056b7b-fc61-44c3-a86a-899630fad56e None admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:00.901778 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c056b7b-fc61-44c3-a86a-899630fad56e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:12:00.902085 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c056b7b-fc61-44c3-a86a-899630fad56e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:12:00.903486 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c056b7b-fc61-44c3-a86a-899630fad56e None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:12:00.913433 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 518/1049] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 20 22:12:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:12:00.919355 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5a884b-898b-4c47-9606-158220ddd22f None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:12:00.955956 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:12:01.022649 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5a884b-898b-4c47-9606-158220ddd22f None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:12:01.056728 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093755e4-a876-4399-afab-7fcd32e0e343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:12:01.057360 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093755e4-a876-4399-afab-7fcd32e0e343 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:01.057637 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093755e4-a876-4399-afab-7fcd32e0e343 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:01.057907 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093755e4-a876-4399-afab-7fcd32e0e343 None admin] PATH_INFO: `/v3/users/3efb42abfff6417b890081f9b842fe77` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:01.071267 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093755e4-a876-4399-afab-7fcd32e0e343 None admin] RBAC: Authorizing `identity:get_user(user_id=3efb42abfff6417b890081f9b842fe77)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:12:01.072697 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093755e4-a876-4399-afab-7fcd32e0e343 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:12:01.074475 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 532/1050] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Sep 20 22:12:00 2022] GET /identity/v3/users/3efb42abfff6417b890081f9b842fe77 => generated 285 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 22:12:01.080050 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c056b7b-fc61-44c3-a86a-899630fad56e None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:12:01.101222 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:12:01.186225 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c056b7b-fc61-44c3-a86a-899630fad56e None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:12:01.223453 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8e6875-6560-48e6-b64d-08609e7d33de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:12:01.223987 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8e6875-6560-48e6-b64d-08609e7d33de None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:01.224261 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8e6875-6560-48e6-b64d-08609e7d33de None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:01.224529 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8e6875-6560-48e6-b64d-08609e7d33de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:01.299278 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8e6875-6560-48e6-b64d-08609e7d33de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:12:01.301306 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8e6875-6560-48e6-b64d-08609e7d33de None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:12:01.319080 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:12:01.403970 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 519/1051] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 20 22:12:01 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 20 22:12:01.405498 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093755e4-a876-4399-afab-7fcd32e0e343 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:12:01.497674 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:12:01.506142 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093755e4-a876-4399-afab-7fcd32e0e343 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:12:01.541062 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616a0d19-0179-456c-a94f-d9140b9d75f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:12:01.542007 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a0d19-0179-456c-a94f-d9140b9d75f0 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:01.542428 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a0d19-0179-456c-a94f-d9140b9d75f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:01.542871 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a0d19-0179-456c-a94f-d9140b9d75f0 None admin] PATH_INFO: `/v3/projects/9c6891cc745e470f988813af154996ba` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:01.544125 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616a0d19-0179-456c-a94f-d9140b9d75f0 None admin] RBAC: Authorizing `identity:get_project(project_id=9c6891cc745e470f988813af154996ba)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:12:01.545683 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616a0d19-0179-456c-a94f-d9140b9d75f0 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:12:01.552814 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 533/1052] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Sep 20 22:12:01 2022] GET /identity/v3/projects/9c6891cc745e470f988813af154996ba => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 22:12:01.554402 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8e6875-6560-48e6-b64d-08609e7d33de None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:12:01.656573 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8e6875-6560-48e6-b64d-08609e7d33de None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:12:01.673105 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:12:01.693241 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb6a506-b5e1-4f8e-a9d8-b89b09dbe5ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:12:01.693845 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb6a506-b5e1-4f8e-a9d8-b89b09dbe5ba None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:01.694119 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb6a506-b5e1-4f8e-a9d8-b89b09dbe5ba None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:01.694384 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb6a506-b5e1-4f8e-a9d8-b89b09dbe5ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:01.695132 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb6a506-b5e1-4f8e-a9d8-b89b09dbe5ba None admin] RBAC: Adding query filter params (role.id=8a829170b29d42d6af589399e51edb0f, scope.project.id=9c6891cc745e470f988813af154996ba, user.id=3efb42abfff6417b890081f9b842fe77) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:12:01.695436 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb6a506-b5e1-4f8e-a9d8-b89b09dbe5ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:12:01.696847 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb6a506-b5e1-4f8e-a9d8-b89b09dbe5ba None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:12:01.702323 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 520/1053] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Sep 20 22:12:01 2022] GET /identity/v3/role_assignments?user.id=3efb42abfff6417b890081f9b842fe77&scope.project.id=9c6891cc745e470f988813af154996ba&role.id=8a829170b29d42d6af589399e51edb0f => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 22:12:02.053216 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120c6dca-d30c-4f49-bda7-a697b2a9cf84 None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:02.053999 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120c6dca-d30c-4f49-bda7-a697b2a9cf84 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:02.053999 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120c6dca-d30c-4f49-bda7-a697b2a9cf84 None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:02.055498 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 534/1054] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:12:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:12:02.060422 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b23781-af04-426b-8923-75e8241459a0 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:02.060711 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b23781-af04-426b-8923-75e8241459a0 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:02.060982 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b23781-af04-426b-8923-75e8241459a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:02.079330 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-44b23781-af04-426b-8923-75e8241459a0 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:12:02.080500 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-44b23781-af04-426b-8923-75e8241459a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:12:02.146661 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 521/1055] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:12:02 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 20 22:12:02.411507 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120c6dca-d30c-4f49-bda7-a697b2a9cf84 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:12:02.511252 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120c6dca-d30c-4f49-bda7-a697b2a9cf84 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:12:02.546587 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd50cf0d-a9ca-4e2b-bdbe-ebe6ec716b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:12:02.547243 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd50cf0d-a9ca-4e2b-bdbe-ebe6ec716b43 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:02.547520 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd50cf0d-a9ca-4e2b-bdbe-ebe6ec716b43 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:02.547789 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd50cf0d-a9ca-4e2b-bdbe-ebe6ec716b43 None admin] PATH_INFO: `/v3/services/image` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:02.548381 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd50cf0d-a9ca-4e2b-bdbe-ebe6ec716b43 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:12:02.549786 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd50cf0d-a9ca-4e2b-bdbe-ebe6ec716b43 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:12:02.559716 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-bd50cf0d-a9ca-4e2b-bdbe-ebe6ec716b43 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 20 22:12:02.559716 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:12:02.559716 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 20 22:12:02.559716 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 20 22:12:02.559716 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 20 22:12:02.559716 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 20 22:12:02.559716 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 20 22:12:02.559716 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 20 22:12:02.559716 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 20 22:12:02.559716 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:12:02.559716 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 20 22:12:02.559716 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:12:02.559716 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:12:02.559716 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:12:02.559716 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:12:02.559716 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:12:02.559716 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:12:02.560753 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:12:02.560753 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:12:02.560753 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:12:02.560753 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:12:02.560753 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:12:02.560753 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:12:02.560753 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 20 22:12:02.560753 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 20 22:12:02.560753 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 20 22:12:02.560753 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 20 22:12:02.560753 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:12:02.560753 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:12:02.560753 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:12:02.560753 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:12:02.560753 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:12:02.560753 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:12:02.561627 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:12:02.561627 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:12:02.561627 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:12:02.561627 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:12:02.561627 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:12:02.561627 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:12:02.561627 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:12:02.561627 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:12:02.561627 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:12:02.561627 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:12:02.561627 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 20 22:12:02.561627 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 20 22:12:02.561627 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 20 22:12:02.561627 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:12:02.569505 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 535/1056] 10.222.0.33 () {56 vars in 1105 bytes} [Tue Sep 20 22:12:02 2022] GET /identity/v3/services/image => generated 86 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:12:02.569667 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b23781-af04-426b-8923-75e8241459a0 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:12:02.666911 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b23781-af04-426b-8923-75e8241459a0 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:12:02.677340 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:12:02.701829 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25150353-02de-4cc1-a237-8e9fa1ccc4fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:12:02.702434 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25150353-02de-4cc1-a237-8e9fa1ccc4fa None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:02.702738 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25150353-02de-4cc1-a237-8e9fa1ccc4fa None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:02.703008 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25150353-02de-4cc1-a237-8e9fa1ccc4fa None admin] PATH_INFO: `/v3/services` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:02.703631 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25150353-02de-4cc1-a237-8e9fa1ccc4fa None admin] RBAC: Adding query filter params (name=image) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:12:02.703929 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25150353-02de-4cc1-a237-8e9fa1ccc4fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:12:02.705276 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25150353-02de-4cc1-a237-8e9fa1ccc4fa None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:12:02.714561 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 522/1057] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 20 22:12:02 2022] GET /identity/v3/services?name=image => generated 122 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:12:02.716654 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd50cf0d-a9ca-4e2b-bdbe-ebe6ec716b43 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:12:02.745671 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:12:02.825338 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd50cf0d-a9ca-4e2b-bdbe-ebe6ec716b43 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:12:02.858042 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08822ce0-7dd6-4298-8be2-9d05203acf73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:12:02.858672 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08822ce0-7dd6-4298-8be2-9d05203acf73 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:02.858953 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08822ce0-7dd6-4298-8be2-9d05203acf73 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:02.859222 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08822ce0-7dd6-4298-8be2-9d05203acf73 None admin] PATH_INFO: `/v3/services` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:02.859846 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08822ce0-7dd6-4298-8be2-9d05203acf73 None admin] RBAC: Adding query filter params (type=image) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:12:02.860146 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08822ce0-7dd6-4298-8be2-9d05203acf73 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:12:02.861512 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08822ce0-7dd6-4298-8be2-9d05203acf73 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:12:02.871319 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 536/1058] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 20 22:12:02 2022] GET /identity/v3/services?type=image => generated 350 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:12:02.872600 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25150353-02de-4cc1-a237-8e9fa1ccc4fa None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:12:02.909349 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9dbbb1-b11d-4819-a866-9d347742c356 None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:02.909657 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9dbbb1-b11d-4819-a866-9d347742c356 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:02.909929 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9dbbb1-b11d-4819-a866-9d347742c356 None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:02.911430 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 537/1059] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:12:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 20 22:12:02.916227 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e240cbd7-2011-4244-b99e-228ad52cdc62 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:02.916521 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e240cbd7-2011-4244-b99e-228ad52cdc62 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:02.916777 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e240cbd7-2011-4244-b99e-228ad52cdc62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:02.935824 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-e240cbd7-2011-4244-b99e-228ad52cdc62 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:12:02.936934 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-e240cbd7-2011-4244-b99e-228ad52cdc62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:12:02.979454 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25150353-02de-4cc1-a237-8e9fa1ccc4fa None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:12:03.008130 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 538/1060] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:12:02 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 20 22:12:03.016081 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c803149-14f7-4aae-a2e8-5f05ad27b8c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:12:03.016566 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c803149-14f7-4aae-a2e8-5f05ad27b8c0 None admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:03.016845 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c803149-14f7-4aae-a2e8-5f05ad27b8c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:03.017115 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c803149-14f7-4aae-a2e8-5f05ad27b8c0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:03.017783 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c803149-14f7-4aae-a2e8-5f05ad27b8c0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:12:03.019716 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c803149-14f7-4aae-a2e8-5f05ad27b8c0 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:12:03.046541 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 523/1061] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 20 22:12:02 2022] POST /identity/v3/endpoints => generated 327 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 20 22:12:03.275632 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e240cbd7-2011-4244-b99e-228ad52cdc62 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:12:03.304207 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:12:03.382249 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e240cbd7-2011-4244-b99e-228ad52cdc62 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:12:03.421768 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eb142a-d026-48f2-b37c-49595a453ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:12:03.422395 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eb142a-d026-48f2-b37c-49595a453ef9 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:03.422701 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eb142a-d026-48f2-b37c-49595a453ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:03.422970 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eb142a-d026-48f2-b37c-49595a453ef9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:03.433257 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71eb142a-d026-48f2-b37c-49595a453ef9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 22:12:03.437989 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-71eb142a-d026-48f2-b37c-49595a453ef9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 20 22:12:03.437989 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:12:03.437989 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:12:03.437989 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:12:03.437989 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:12:03.437989 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:12:03.437989 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:12:03.437989 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:12:03.437989 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:12:03.437989 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:12:03.437989 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:12:03.437989 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:12:03.437989 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 22:12:03.437989 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 22:12:03.437989 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 22:12:03.437989 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 22:12:03.438927 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 22:12:03.438927 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 22:12:03.438927 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 22:12:03.438927 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 22:12:03.438927 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:12:03.438927 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:12:03.438927 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:12:03.438927 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:12:03.438927 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:12:03.438927 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:12:03.438927 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:12:03.438927 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:12:03.438927 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:12:03.438927 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:12:03.438927 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:12:03.438927 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:12:03.439767 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:12:03.439767 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:12:03.439767 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:12:03.439767 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:12:03.439767 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 22:12:03.439767 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 22:12:03.439767 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 22:12:03.439767 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 22:12:03.439767 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 22:12:03.439767 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 22:12:03.439767 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 20 22:12:03.439767 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:12:03.441518 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 539/1062] 10.222.0.33 () {56 vars in 1120 bytes} [Tue Sep 20 22:12:03 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:12:03.445760 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c803149-14f7-4aae-a2e8-5f05ad27b8c0 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:12:03.476851 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:12:03.549969 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c803149-14f7-4aae-a2e8-5f05ad27b8c0 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:12:03.586099 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a9e813-2219-42e2-afca-ffe8e448cb42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:12:03.586732 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a9e813-2219-42e2-afca-ffe8e448cb42 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:03.587012 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a9e813-2219-42e2-afca-ffe8e448cb42 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:03.587284 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a9e813-2219-42e2-afca-ffe8e448cb42 None admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:03.587947 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a9e813-2219-42e2-afca-ffe8e448cb42 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:12:03.588252 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a9e813-2219-42e2-afca-ffe8e448cb42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:12:03.589616 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a9e813-2219-42e2-afca-ffe8e448cb42 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:12:03.597815 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 524/1063] 10.222.0.33 () {56 vars in 1115 bytes} [Tue Sep 20 22:12:03 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:12:03.603271 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eb142a-d026-48f2-b37c-49595a453ef9 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:12:03.680014 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:12:03.704060 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eb142a-d026-48f2-b37c-49595a453ef9 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:12:03.741742 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de43d38e-9e8b-4161-b0fe-cfa42968f84e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:12:03.742384 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de43d38e-9e8b-4161-b0fe-cfa42968f84e None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:03.742710 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de43d38e-9e8b-4161-b0fe-cfa42968f84e None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:03.743073 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de43d38e-9e8b-4161-b0fe-cfa42968f84e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:03.754277 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de43d38e-9e8b-4161-b0fe-cfa42968f84e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:12:03.755745 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de43d38e-9e8b-4161-b0fe-cfa42968f84e None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:12:03.770374 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-de43d38e-9e8b-4161-b0fe-cfa42968f84e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:12:03.770374 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:12:03.770374 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:12:03.770374 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:12:03.770374 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:12:03.770374 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:12:03.770374 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:12:03.770374 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:12:03.770374 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:12:03.770374 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:12:03.770374 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:12:03.770374 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:12:03.770374 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 22:12:03.770374 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 22:12:03.770374 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 22:12:03.770374 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 22:12:03.771391 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:12:03.771391 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:12:03.771391 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:12:03.771391 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:12:03.771391 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:12:03.771391 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:12:03.771391 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:12:03.771391 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:12:03.771391 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:12:03.771391 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:12:03.771391 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:12:03.771391 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:12:03.771391 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:12:03.771391 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:12:03.771391 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:12:03.771391 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:12:03.771391 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 22:12:03.772308 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 22:12:03.772308 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:12:03.772308 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:12:03.774653 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 540/1064] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 20 22:12:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:12:03.777255 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a9e813-2219-42e2-afca-ffe8e448cb42 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:12:03.831708 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e8b48a-766e-46f1-a5d8-d71b060e1508 None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:03.831915 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e8b48a-766e-46f1-a5d8-d71b060e1508 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:03.832188 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e8b48a-766e-46f1-a5d8-d71b060e1508 None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:03.833649 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 541/1065] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:12:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 20 22:12:03.838445 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9d19e7-a8dd-429b-a6c4-1442e874ea0c None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:03.838765 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9d19e7-a8dd-429b-a6c4-1442e874ea0c None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:03.839038 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9d19e7-a8dd-429b-a6c4-1442e874ea0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:03.858961 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-6c9d19e7-a8dd-429b-a6c4-1442e874ea0c None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:12:03.860393 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-6c9d19e7-a8dd-429b-a6c4-1442e874ea0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:12:03.875063 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:12:03.885942 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a9e813-2219-42e2-afca-ffe8e448cb42 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:12:03.920008 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea45393f-02ee-4f7b-b268-9013849e3f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:12:03.920620 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea45393f-02ee-4f7b-b268-9013849e3f38 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:03.920897 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea45393f-02ee-4f7b-b268-9013849e3f38 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:03.921161 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea45393f-02ee-4f7b-b268-9013849e3f38 None admin] PATH_INFO: `/v3/domains` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:03.921805 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea45393f-02ee-4f7b-b268-9013849e3f38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:12:03.922098 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea45393f-02ee-4f7b-b268-9013849e3f38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:12:03.923497 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea45393f-02ee-4f7b-b268-9013849e3f38 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:12:03.937075 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 542/1066] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:12:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 20 22:12:03.939697 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 525/1067] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 20 22:12:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:12:03.946062 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9d19e7-a8dd-429b-a6c4-1442e874ea0c None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:12:04.005573 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:12:04.047210 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9d19e7-a8dd-429b-a6c4-1442e874ea0c None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:12:04.081530 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18cf742-deb2-4197-b9cf-d18cdb5ff0f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:12:04.082207 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18cf742-deb2-4197-b9cf-d18cdb5ff0f5 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:04.082433 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18cf742-deb2-4197-b9cf-d18cdb5ff0f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:04.082730 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18cf742-deb2-4197-b9cf-d18cdb5ff0f5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:04.089496 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18cf742-deb2-4197-b9cf-d18cdb5ff0f5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:12:04.090955 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18cf742-deb2-4197-b9cf-d18cdb5ff0f5 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:12:04.102651 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-b18cf742-deb2-4197-b9cf-d18cdb5ff0f5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 20 22:12:04.102651 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:12:04.102651 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:12:04.102651 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:12:04.102651 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:12:04.102651 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:12:04.102651 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:12:04.102651 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:12:04.102651 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:12:04.102651 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:12:04.102651 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:12:04.102651 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:12:04.102651 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 20 22:12:04.102651 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 20 22:12:04.102651 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 20 22:12:04.102651 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 20 22:12:04.103591 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:12:04.103591 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:12:04.103591 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 20 22:12:04.103591 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 22:12:04.103591 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 20 22:12:04.103591 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 22:12:04.103591 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:12:04.103591 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:12:04.103591 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:12:04.103591 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:12:04.103591 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:12:04.103591 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:12:04.103591 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:12:04.103591 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:12:04.103591 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:12:04.103591 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:12:04.103591 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:12:04.103591 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:12:04.109315 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:12:04.109315 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:12:04.109315 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 20 22:12:04.109315 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 20 22:12:04.109315 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 20 22:12:04.109315 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 20 22:12:04.109315 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 20 22:12:04.109315 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 20 22:12:04.109315 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 20 22:12:04.109315 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:12:04.109315 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 543/1068] 10.222.0.33 () {56 vars in 1093 bytes} [Tue Sep 20 22:12:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:12:04.109934 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea45393f-02ee-4f7b-b268-9013849e3f38 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:12:04.203953 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18cf742-deb2-4197-b9cf-d18cdb5ff0f5 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:12:04.216602 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea45393f-02ee-4f7b-b268-9013849e3f38 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:12:04.252384 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cbd9cc-40b5-4063-b621-7c58ae7ee4f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:12:04.252997 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cbd9cc-40b5-4063-b621-7c58ae7ee4f4 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:04.253985 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cbd9cc-40b5-4063-b621-7c58ae7ee4f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:04.254416 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cbd9cc-40b5-4063-b621-7c58ae7ee4f4 None admin] PATH_INFO: `/v3/users` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:04.255121 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cbd9cc-40b5-4063-b621-7c58ae7ee4f4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:12:04.255417 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cbd9cc-40b5-4063-b621-7c58ae7ee4f4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:12:04.256851 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cbd9cc-40b5-4063-b621-7c58ae7ee4f4 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:12:04.279965 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 526/1069] 10.222.0.33 () {56 vars in 1133 bytes} [Tue Sep 20 22:12:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:12:04.281022 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cbd9cc-40b5-4063-b621-7c58ae7ee4f4 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:12:04.297188 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:12:04.337235 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18cf742-deb2-4197-b9cf-d18cdb5ff0f5 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:12:04.357355 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:12:04.376976 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e85dd3-bc96-4615-b289-2f09e2c38fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:12:04.377716 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e85dd3-bc96-4615-b289-2f09e2c38fa0 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:04.377998 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e85dd3-bc96-4615-b289-2f09e2c38fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:04.378482 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e85dd3-bc96-4615-b289-2f09e2c38fa0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:04.386714 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cbd9cc-40b5-4063-b621-7c58ae7ee4f4 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:12:04.389999 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e85dd3-bc96-4615-b289-2f09e2c38fa0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 22:12:04.395973 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-b6e85dd3-bc96-4615-b289-2f09e2c38fa0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 22:12:04.395973 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:12:04.395973 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:12:04.395973 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:12:04.395973 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:12:04.395973 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:12:04.395973 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:12:04.395973 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:12:04.395973 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:12:04.395973 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:12:04.395973 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:12:04.395973 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:12:04.395973 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 22:12:04.395973 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 22:12:04.395973 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 22:12:04.395973 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 22:12:04.396909 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 22:12:04.396909 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 22:12:04.396909 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 22:12:04.396909 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 22:12:04.396909 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:12:04.396909 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:12:04.396909 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:12:04.396909 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:12:04.396909 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:12:04.396909 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:12:04.396909 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:12:04.396909 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:12:04.396909 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:12:04.396909 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:12:04.396909 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:12:04.396909 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:12:04.397914 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:12:04.397914 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:12:04.397914 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:12:04.397914 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:12:04.397914 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 22:12:04.397914 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 22:12:04.397914 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 22:12:04.397914 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 22:12:04.397914 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 22:12:04.397914 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 22:12:04.397914 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 22:12:04.397914 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:12:04.397914 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 544/1070] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Sep 20 22:12:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 20 22:12:04.403097 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e85dd3-bc96-4615-b289-2f09e2c38fa0 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:12:04.424779 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ac6ef0-367d-4b26-bd7d-910e05730f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:12:04.425440 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ac6ef0-367d-4b26-bd7d-910e05730f80 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:04.425723 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ac6ef0-367d-4b26-bd7d-910e05730f80 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:04.425999 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ac6ef0-367d-4b26-bd7d-910e05730f80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:04.436162 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ac6ef0-367d-4b26-bd7d-910e05730f80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:12:04.437606 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ac6ef0-367d-4b26-bd7d-910e05730f80 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:12:04.451910 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-b1ac6ef0-367d-4b26-bd7d-910e05730f80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:12:04.451910 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:12:04.451910 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:12:04.451910 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:12:04.451910 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:12:04.451910 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:12:04.451910 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:12:04.451910 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:12:04.451910 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:12:04.451910 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:12:04.451910 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:12:04.451910 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:12:04.451910 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 22:12:04.451910 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 22:12:04.451910 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 22:12:04.451910 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 22:12:04.452860 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:12:04.452860 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:12:04.452860 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:12:04.452860 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:12:04.452860 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:12:04.452860 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:12:04.452860 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:12:04.452860 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:12:04.452860 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:12:04.452860 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:12:04.452860 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:12:04.452860 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:12:04.452860 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:12:04.452860 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:12:04.452860 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:12:04.452860 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:12:04.452860 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 22:12:04.459226 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 22:12:04.459226 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:12:04.459226 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:12:04.459226 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 527/1071] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 20 22:12:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 20 22:12:04.461208 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ac6ef0-367d-4b26-bd7d-910e05730f80 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:12:04.516610 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e85dd3-bc96-4615-b289-2f09e2c38fa0 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:12:04.521572 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:12:04.555615 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2a14f0-eba3-4acc-aeeb-8f977e985957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:12:04.556573 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a14f0-eba3-4acc-aeeb-8f977e985957 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:04.557129 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a14f0-eba3-4acc-aeeb-8f977e985957 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:04.557411 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a14f0-eba3-4acc-aeeb-8f977e985957 None admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:04.558073 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2a14f0-eba3-4acc-aeeb-8f977e985957 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:12:04.558379 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2a14f0-eba3-4acc-aeeb-8f977e985957 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:12:04.559774 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2a14f0-eba3-4acc-aeeb-8f977e985957 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:12:04.559876 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ac6ef0-367d-4b26-bd7d-910e05730f80 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:12:04.569830 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 545/1072] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 20 22:12:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 22:12:04.575338 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2a14f0-eba3-4acc-aeeb-8f977e985957 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:12:04.595458 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f5ab5c-9168-4896-a9b8-381fb2c3fab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:12:04.596006 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f5ab5c-9168-4896-a9b8-381fb2c3fab7 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:04.596285 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f5ab5c-9168-4896-a9b8-381fb2c3fab7 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:04.596554 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f5ab5c-9168-4896-a9b8-381fb2c3fab7 None admin] PATH_INFO: `/v3/domains` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:04.597801 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f5ab5c-9168-4896-a9b8-381fb2c3fab7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:12:04.598106 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f5ab5c-9168-4896-a9b8-381fb2c3fab7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:12:04.599501 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f5ab5c-9168-4896-a9b8-381fb2c3fab7 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:12:04.617953 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 528/1073] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 20 22:12:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 22:12:04.619011 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f5ab5c-9168-4896-a9b8-381fb2c3fab7 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:12:04.627052 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:12:04.693970 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2a14f0-eba3-4acc-aeeb-8f977e985957 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:12:04.724717 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f5ab5c-9168-4896-a9b8-381fb2c3fab7 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:12:04.731670 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e01ce4-1b34-49a2-9597-3de4fb37e4dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:12:04.732301 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e01ce4-1b34-49a2-9597-3de4fb37e4dd None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:04.732580 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e01ce4-1b34-49a2-9597-3de4fb37e4dd None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:04.732852 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e01ce4-1b34-49a2-9597-3de4fb37e4dd None admin] PATH_INFO: `/v3/users/3efb42abfff6417b890081f9b842fe77` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:04.734118 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e01ce4-1b34-49a2-9597-3de4fb37e4dd None admin] RBAC: Authorizing `identity:get_user(user_id=3efb42abfff6417b890081f9b842fe77)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:12:04.735720 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e01ce4-1b34-49a2-9597-3de4fb37e4dd None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:12:04.737562 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 546/1074] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Sep 20 22:12:04 2022] GET /identity/v3/users/3efb42abfff6417b890081f9b842fe77 => generated 285 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 22:12:04.743087 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e01ce4-1b34-49a2-9597-3de4fb37e4dd None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:12:04.747691 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:12:04.762055 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0928c195-1a8f-4e2c-9ccc-cdddafebabda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:12:04.762720 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0928c195-1a8f-4e2c-9ccc-cdddafebabda None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:04.763002 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0928c195-1a8f-4e2c-9ccc-cdddafebabda None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:04.763271 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0928c195-1a8f-4e2c-9ccc-cdddafebabda None admin] PATH_INFO: `/v3/projects/service` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:04.770907 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0928c195-1a8f-4e2c-9ccc-cdddafebabda None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:12:04.772350 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0928c195-1a8f-4e2c-9ccc-cdddafebabda None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:12:04.783540 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-0928c195-1a8f-4e2c-9ccc-cdddafebabda None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 22:12:04.783540 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:12:04.783540 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:12:04.783540 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:12:04.783540 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:12:04.783540 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:12:04.783540 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:12:04.783540 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:12:04.783540 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:12:04.783540 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:12:04.783540 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:12:04.783540 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:12:04.783540 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 20 22:12:04.783540 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 20 22:12:04.783540 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 20 22:12:04.789735 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 20 22:12:04.789735 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:12:04.789735 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:12:04.789735 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:12:04.789735 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:12:04.789735 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:12:04.789735 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:12:04.789735 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:12:04.789735 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:12:04.789735 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:12:04.789735 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:12:04.789735 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:12:04.789735 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:12:04.789735 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:12:04.789735 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:12:04.789735 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:12:04.789735 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:12:04.790664 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 20 22:12:04.790664 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 20 22:12:04.790664 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 20 22:12:04.790664 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 20 22:12:04.790664 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 20 22:12:04.790664 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 20 22:12:04.790664 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 22:12:04.790664 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:12:04.790664 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 529/1075] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Sep 20 22:12:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:12:04.790664 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0928c195-1a8f-4e2c-9ccc-cdddafebabda None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:12:04.859174 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e01ce4-1b34-49a2-9597-3de4fb37e4dd None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:12:04.870659 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:12:04.893252 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0928c195-1a8f-4e2c-9ccc-cdddafebabda None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:12:04.905271 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ca0efb-af7f-44df-939e-94468b628637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:12:04.906318 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ca0efb-af7f-44df-939e-94468b628637 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:04.906642 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ca0efb-af7f-44df-939e-94468b628637 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:04.906920 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ca0efb-af7f-44df-939e-94468b628637 None admin] PATH_INFO: `/v3/projects/9c6891cc745e470f988813af154996ba` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:04.908080 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ca0efb-af7f-44df-939e-94468b628637 None admin] RBAC: Authorizing `identity:get_project(project_id=9c6891cc745e470f988813af154996ba)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:12:04.910013 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ca0efb-af7f-44df-939e-94468b628637 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:12:04.916442 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 547/1076] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Sep 20 22:12:04 2022] GET /identity/v3/projects/9c6891cc745e470f988813af154996ba => generated 311 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:12:04.917451 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ca0efb-af7f-44df-939e-94468b628637 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:12:04.936524 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8910d17-5cca-4a32-bbb4-56ee199176c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:12:04.937129 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8910d17-5cca-4a32-bbb4-56ee199176c3 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:04.937405 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8910d17-5cca-4a32-bbb4-56ee199176c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:04.937672 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8910d17-5cca-4a32-bbb4-56ee199176c3 None admin] PATH_INFO: `/v3/projects` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:04.938388 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8910d17-5cca-4a32-bbb4-56ee199176c3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:12:04.938681 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8910d17-5cca-4a32-bbb4-56ee199176c3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:12:04.940207 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8910d17-5cca-4a32-bbb4-56ee199176c3 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:12:04.954187 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 530/1077] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Sep 20 22:12:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 22:12:04.960098 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8910d17-5cca-4a32-bbb4-56ee199176c3 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:12:05.009197 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:12:05.044417 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ca0efb-af7f-44df-939e-94468b628637 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:12:05.069835 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8910d17-5cca-4a32-bbb4-56ee199176c3 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:12:05.084895 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de75f33-b685-42ee-8667-0015bf44341a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:12:05.085554 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de75f33-b685-42ee-8667-0015bf44341a None admin] REQUEST_METHOD: `PUT` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:05.085834 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de75f33-b685-42ee-8667-0015bf44341a None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:05.086108 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de75f33-b685-42ee-8667-0015bf44341a None admin] PATH_INFO: `/v3/projects/9c6891cc745e470f988813af154996ba/users/3efb42abfff6417b890081f9b842fe77/roles/8a829170b29d42d6af589399e51edb0f` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:05.088089 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de75f33-b685-42ee-8667-0015bf44341a None admin] RBAC: Authorizing `identity:create_grant(project_id=9c6891cc745e470f988813af154996ba, user_id=3efb42abfff6417b890081f9b842fe77, role_id=8a829170b29d42d6af589399e51edb0f)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:12:05.089504 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de75f33-b685-42ee-8667-0015bf44341a None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:12:05.104141 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 548/1078] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Sep 20 22:12:04 2022] PUT /identity/v3/projects/9c6891cc745e470f988813af154996ba/users/3efb42abfff6417b890081f9b842fe77/roles/8a829170b29d42d6af589399e51edb0f => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:12:05.108993 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cb400a-1a39-490f-9095-a987ad59292c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:12:05.110018 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cb400a-1a39-490f-9095-a987ad59292c None admin] REQUEST_METHOD: `PUT` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:05.110479 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cb400a-1a39-490f-9095-a987ad59292c None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:05.110962 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cb400a-1a39-490f-9095-a987ad59292c None admin] PATH_INFO: `/v3/projects/3ce415d02aa9489bae19cd514805fd8c/users/db7eed561e99452289a662ad326cf919/roles/9fd7d9b8b5224290acc6e44595c9000b` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:05.114218 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cb400a-1a39-490f-9095-a987ad59292c None admin] RBAC: Authorizing `identity:create_grant(project_id=3ce415d02aa9489bae19cd514805fd8c, user_id=db7eed561e99452289a662ad326cf919, role_id=9fd7d9b8b5224290acc6e44595c9000b)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:12:05.116058 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cb400a-1a39-490f-9095-a987ad59292c None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:12:05.134526 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 531/1079] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Sep 20 22:12:04 2022] PUT /identity/v3/projects/3ce415d02aa9489bae19cd514805fd8c/users/db7eed561e99452289a662ad326cf919/roles/9fd7d9b8b5224290acc6e44595c9000b => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 22:12:05.251660 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b2260-698d-450c-aa17-3d146d2cd8fd None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:05.252034 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b2260-698d-450c-aa17-3d146d2cd8fd None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:05.252209 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b2260-698d-450c-aa17-3d146d2cd8fd None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:05.254422 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 549/1080] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:12:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:12:05.260423 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdacd9f6-8c8c-4c39-8a2e-9dcc539e7157 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:05.260741 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdacd9f6-8c8c-4c39-8a2e-9dcc539e7157 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:05.260987 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdacd9f6-8c8c-4c39-8a2e-9dcc539e7157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:05.283219 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-bdacd9f6-8c8c-4c39-8a2e-9dcc539e7157 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:12:05.284507 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-bdacd9f6-8c8c-4c39-8a2e-9dcc539e7157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:12:05.363996 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 532/1081] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:12:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 20 22:12:05.632191 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78b2260-698d-450c-aa17-3d146d2cd8fd None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:12:05.670243 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:12:05.739627 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78b2260-698d-450c-aa17-3d146d2cd8fd None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:12:05.772814 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb3b630-dec1-4970-826d-029649955ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:12:05.773418 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb3b630-dec1-4970-826d-029649955ce4 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:05.773700 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb3b630-dec1-4970-826d-029649955ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:05.773974 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb3b630-dec1-4970-826d-029649955ce4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:05.841678 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb3b630-dec1-4970-826d-029649955ce4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:12:05.843169 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb3b630-dec1-4970-826d-029649955ce4 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:12:05.876946 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:12:05.944447 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 550/1082] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 20 22:12:05 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 20 22:12:05.950004 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdacd9f6-8c8c-4c39-8a2e-9dcc539e7157 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:12:05.981359 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:12:06.057490 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdacd9f6-8c8c-4c39-8a2e-9dcc539e7157 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:12:06.091052 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88517b4f-b225-4c25-9569-48cf4a5663f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:12:06.091681 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88517b4f-b225-4c25-9569-48cf4a5663f3 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:06.091964 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88517b4f-b225-4c25-9569-48cf4a5663f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:06.092233 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88517b4f-b225-4c25-9569-48cf4a5663f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:06.102703 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88517b4f-b225-4c25-9569-48cf4a5663f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:12:06.104146 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88517b4f-b225-4c25-9569-48cf4a5663f3 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:12:06.118306 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-88517b4f-b225-4c25-9569-48cf4a5663f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:12:06.118306 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:12:06.118306 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:12:06.118306 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:12:06.118306 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:12:06.118306 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:12:06.118306 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:12:06.118306 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:12:06.118306 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:12:06.118306 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:12:06.118306 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:12:06.118306 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:12:06.118306 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 22:12:06.118306 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 22:12:06.118306 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 22:12:06.118306 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 22:12:06.119369 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:12:06.119369 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:12:06.119369 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:12:06.119369 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:12:06.119369 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:12:06.119369 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:12:06.119369 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:12:06.119369 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:12:06.119369 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:12:06.119369 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:12:06.119369 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:12:06.119369 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:12:06.119369 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:12:06.119369 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:12:06.119369 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:12:06.119369 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:12:06.119369 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 22:12:06.120812 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 22:12:06.120812 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:12:06.120812 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:12:06.122843 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 533/1083] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 20 22:12:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:12:06.125410 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb3b630-dec1-4970-826d-029649955ce4 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:12:06.224729 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb3b630-dec1-4970-826d-029649955ce4 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:12:06.258153 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9c0fdc-f16c-4d32-b396-ea3869e424ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:12:06.258971 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9c0fdc-f16c-4d32-b396-ea3869e424ca None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:06.259261 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9c0fdc-f16c-4d32-b396-ea3869e424ca None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:06.259529 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9c0fdc-f16c-4d32-b396-ea3869e424ca None admin] PATH_INFO: `/v3/domains` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:06.260164 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9c0fdc-f16c-4d32-b396-ea3869e424ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:12:06.260466 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9c0fdc-f16c-4d32-b396-ea3869e424ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:12:06.261872 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9c0fdc-f16c-4d32-b396-ea3869e424ca None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:12:06.264412 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:12:06.282536 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 551/1084] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 20 22:12:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:12:07.306500 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9ca0d4-08f2-4f4c-b9e4-929f090d7983 None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:07.307012 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9ca0d4-08f2-4f4c-b9e4-929f090d7983 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:07.307104 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9ca0d4-08f2-4f4c-b9e4-929f090d7983 None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:07.308532 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 534/1085] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:12:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:12:07.311795 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ffb755-dd4a-4dfb-bda9-e28d20464712 None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:07.312183 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ffb755-dd4a-4dfb-bda9-e28d20464712 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:07.312407 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ffb755-dd4a-4dfb-bda9-e28d20464712 None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:07.313618 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90286646-d759-48c4-a490-0ef434870faf None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:07.313730 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 552/1086] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:12:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:12:07.313904 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90286646-d759-48c4-a490-0ef434870faf None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:07.314179 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90286646-d759-48c4-a490-0ef434870faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:07.319233 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e2cea1-dac1-44f9-8433-ea501446efc2 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:07.319521 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e2cea1-dac1-44f9-8433-ea501446efc2 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:07.319797 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e2cea1-dac1-44f9-8433-ea501446efc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:07.332852 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-90286646-d759-48c4-a490-0ef434870faf None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:12:07.334025 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-90286646-d759-48c4-a490-0ef434870faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:12:07.337327 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-00e2cea1-dac1-44f9-8433-ea501446efc2 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:12:07.338482 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-00e2cea1-dac1-44f9-8433-ea501446efc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:12:07.400740 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 535/1087] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:12:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 20 22:12:07.406535 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 553/1088] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:12:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 20 22:12:07.669844 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90286646-d759-48c4-a490-0ef434870faf None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:12:07.670076 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e2cea1-dac1-44f9-8433-ea501446efc2 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:12:07.685844 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:12:07.766872 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e2cea1-dac1-44f9-8433-ea501446efc2 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:12:07.769703 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90286646-d759-48c4-a490-0ef434870faf None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:12:07.791772 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:12:07.801381 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456a179e-52dd-4211-9b78-616f1e267bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:12:07.802008 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456a179e-52dd-4211-9b78-616f1e267bf0 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:07.802285 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456a179e-52dd-4211-9b78-616f1e267bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:07.802576 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456a179e-52dd-4211-9b78-616f1e267bf0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:07.804397 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb2b593-b74c-4e98-82f4-c65bb36fa4c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:12:07.805020 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb2b593-b74c-4e98-82f4-c65bb36fa4c2 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:07.805297 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb2b593-b74c-4e98-82f4-c65bb36fa4c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:07.805560 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb2b593-b74c-4e98-82f4-c65bb36fa4c2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:07.812762 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456a179e-52dd-4211-9b78-616f1e267bf0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 22:12:07.815333 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb2b593-b74c-4e98-82f4-c65bb36fa4c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 22:12:07.817501 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-456a179e-52dd-4211-9b78-616f1e267bf0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 20 22:12:07.817501 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:12:07.817501 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:12:07.817501 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:12:07.817501 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:12:07.817501 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:12:07.817501 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:12:07.817501 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:12:07.817501 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:12:07.817501 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:12:07.817501 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:12:07.817501 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:12:07.817501 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 22:12:07.817501 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 22:12:07.817501 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 22:12:07.817501 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 22:12:07.818688 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 22:12:07.818688 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 22:12:07.818688 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 22:12:07.818688 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 22:12:07.818688 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:12:07.818688 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:12:07.818688 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:12:07.818688 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:12:07.818688 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:12:07.818688 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:12:07.818688 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:12:07.818688 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:12:07.818688 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:12:07.818688 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:12:07.818688 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:12:07.818688 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:12:07.819605 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:12:07.819605 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:12:07.819605 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:12:07.819605 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:12:07.819605 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 22:12:07.819605 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 22:12:07.819605 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 22:12:07.819605 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 22:12:07.819605 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 22:12:07.819605 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 22:12:07.819605 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 20 22:12:07.819605 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:12:07.819605 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 554/1089] 10.222.0.33 () {56 vars in 1120 bytes} [Tue Sep 20 22:12:07 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 20 22:12:07.820347 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-dbb2b593-b74c-4e98-82f4-c65bb36fa4c2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 22:12:07.820347 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:12:07.820347 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:12:07.820347 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:12:07.820347 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:12:07.820347 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:12:07.820347 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:12:07.820347 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:12:07.820347 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:12:07.820347 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:12:07.820347 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:12:07.820347 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:12:07.820347 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 22:12:07.820347 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 22:12:07.820347 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 22:12:07.820347 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 22:12:07.821212 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 22:12:07.821212 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 22:12:07.821212 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 22:12:07.821212 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 22:12:07.821212 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:12:07.821212 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:12:07.821212 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:12:07.821212 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:12:07.821212 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:12:07.821212 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:12:07.821212 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:12:07.821212 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:12:07.821212 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:12:07.821212 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:12:07.821212 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:12:07.821212 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:12:07.822038 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:12:07.822038 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:12:07.822038 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:12:07.822038 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:12:07.822038 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 22:12:07.822038 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 22:12:07.822038 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 22:12:07.822038 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 22:12:07.822038 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 22:12:07.822038 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 22:12:07.822038 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 22:12:07.822038 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:12:07.822038 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 536/1090] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Sep 20 22:12:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:12:07.824834 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456a179e-52dd-4211-9b78-616f1e267bf0 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:12:07.826814 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb2b593-b74c-4e98-82f4-c65bb36fa4c2 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:12:07.900085 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:12:07.921313 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456a179e-52dd-4211-9b78-616f1e267bf0 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:12:07.924588 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb2b593-b74c-4e98-82f4-c65bb36fa4c2 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:12:07.955765 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7483a0d-1c0b-4759-a135-f75119f4d5f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:12:07.956377 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7483a0d-1c0b-4759-a135-f75119f4d5f1 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:07.956651 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7483a0d-1c0b-4759-a135-f75119f4d5f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:07.956922 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7483a0d-1c0b-4759-a135-f75119f4d5f1 None admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:07.957578 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7483a0d-1c0b-4759-a135-f75119f4d5f1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:12:07.957888 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7483a0d-1c0b-4759-a135-f75119f4d5f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:12:07.959264 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7483a0d-1c0b-4759-a135-f75119f4d5f1 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:12:07.960886 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59b1d7b-ea4c-4176-8bdf-d6ba954542e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:12:07.961494 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59b1d7b-ea4c-4176-8bdf-d6ba954542e2 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:07.961770 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59b1d7b-ea4c-4176-8bdf-d6ba954542e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:07.962062 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59b1d7b-ea4c-4176-8bdf-d6ba954542e2 None admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:07.962749 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59b1d7b-ea4c-4176-8bdf-d6ba954542e2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:12:07.963057 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59b1d7b-ea4c-4176-8bdf-d6ba954542e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:12:07.964397 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59b1d7b-ea4c-4176-8bdf-d6ba954542e2 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:12:07.967281 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 555/1091] 10.222.0.33 () {56 vars in 1115 bytes} [Tue Sep 20 22:12:07 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 22:12:07.973423 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 537/1092] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 20 22:12:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 22:12:07.974154 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7483a0d-1c0b-4759-a135-f75119f4d5f1 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:12:07.979047 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59b1d7b-ea4c-4176-8bdf-d6ba954542e2 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:12:08.021783 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:12:08.072230 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7483a0d-1c0b-4759-a135-f75119f4d5f1 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:12:08.076933 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59b1d7b-ea4c-4176-8bdf-d6ba954542e2 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:12:08.105730 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e706346-f968-4654-8825-7373977f31c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:12:08.106350 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e706346-f968-4654-8825-7373977f31c1 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:08.106662 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e706346-f968-4654-8825-7373977f31c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:08.106932 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e706346-f968-4654-8825-7373977f31c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:08.111236 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b582301f-5b92-4a8c-ad31-17cd6bdcb4e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:12:08.111856 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b582301f-5b92-4a8c-ad31-17cd6bdcb4e9 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:08.112135 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b582301f-5b92-4a8c-ad31-17cd6bdcb4e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:08.112407 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b582301f-5b92-4a8c-ad31-17cd6bdcb4e9 None admin] PATH_INFO: `/v3/users/3efb42abfff6417b890081f9b842fe77` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:08.113517 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b582301f-5b92-4a8c-ad31-17cd6bdcb4e9 None admin] RBAC: Authorizing `identity:get_user(user_id=3efb42abfff6417b890081f9b842fe77)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:12:08.114971 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b582301f-5b92-4a8c-ad31-17cd6bdcb4e9 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:12:08.116694 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 538/1093] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Sep 20 22:12:07 2022] GET /identity/v3/users/3efb42abfff6417b890081f9b842fe77 => generated 285 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 22:12:08.117674 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e706346-f968-4654-8825-7373977f31c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:12:08.119132 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e706346-f968-4654-8825-7373977f31c1 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:12:08.122317 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b582301f-5b92-4a8c-ad31-17cd6bdcb4e9 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:12:08.125708 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:12:08.133928 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-1e706346-f968-4654-8825-7373977f31c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:12:08.133928 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:12:08.133928 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:12:08.133928 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:12:08.133928 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:12:08.133928 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:12:08.133928 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:12:08.133928 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:12:08.133928 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:12:08.133928 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:12:08.133928 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:12:08.133928 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:12:08.133928 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 22:12:08.133928 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 22:12:08.133928 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 22:12:08.133928 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 22:12:08.135056 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:12:08.135056 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:12:08.135056 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:12:08.135056 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:12:08.135056 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:12:08.135056 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:12:08.135056 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:12:08.135056 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:12:08.135056 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:12:08.135056 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:12:08.135056 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:12:08.135056 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:12:08.135056 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:12:08.135056 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:12:08.135056 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:12:08.135056 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:12:08.135056 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 22:12:08.136367 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 22:12:08.136367 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:12:08.136367 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:12:08.136367 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 556/1094] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 20 22:12:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 20 22:12:08.140569 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e706346-f968-4654-8825-7373977f31c1 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:12:08.221063 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b582301f-5b92-4a8c-ad31-17cd6bdcb4e9 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:12:08.240172 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:12:08.243140 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e706346-f968-4654-8825-7373977f31c1 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:12:08.256762 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6f5757-b732-4a2a-b5ba-cd025e2d0534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:12:08.257376 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6f5757-b732-4a2a-b5ba-cd025e2d0534 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:08.257659 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6f5757-b732-4a2a-b5ba-cd025e2d0534 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:08.257924 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6f5757-b732-4a2a-b5ba-cd025e2d0534 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:08.276953 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96880a4-cd61-40a6-9b27-fe01370d04a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:12:08.277556 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96880a4-cd61-40a6-9b27-fe01370d04a5 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:08.277831 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96880a4-cd61-40a6-9b27-fe01370d04a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:08.278096 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96880a4-cd61-40a6-9b27-fe01370d04a5 None admin] PATH_INFO: `/v3/domains` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:08.278821 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96880a4-cd61-40a6-9b27-fe01370d04a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:12:08.279123 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96880a4-cd61-40a6-9b27-fe01370d04a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:12:08.280472 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96880a4-cd61-40a6-9b27-fe01370d04a5 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:12:08.292891 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 557/1095] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 20 22:12:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 22:12:08.298306 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96880a4-cd61-40a6-9b27-fe01370d04a5 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:12:08.339263 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6f5757-b732-4a2a-b5ba-cd025e2d0534 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:12:08.340707 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6f5757-b732-4a2a-b5ba-cd025e2d0534 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:12:08.343291 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:12:08.397088 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96880a4-cd61-40a6-9b27-fe01370d04a5 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:12:08.431356 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e22c6d-acac-44e4-9a75-7fe33aacdfa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:12:08.431974 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e22c6d-acac-44e4-9a75-7fe33aacdfa5 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:08.432248 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e22c6d-acac-44e4-9a75-7fe33aacdfa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:08.432516 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e22c6d-acac-44e4-9a75-7fe33aacdfa5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:08.436914 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 539/1096] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 20 22:12:08 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 20 22:12:08.439321 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e22c6d-acac-44e4-9a75-7fe33aacdfa5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:12:08.441318 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e22c6d-acac-44e4-9a75-7fe33aacdfa5 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:12:08.443216 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6f5757-b732-4a2a-b5ba-cd025e2d0534 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:12:08.452713 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-d1e22c6d-acac-44e4-9a75-7fe33aacdfa5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 20 22:12:08.452713 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:12:08.452713 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:12:08.452713 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:12:08.452713 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:12:08.452713 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:12:08.452713 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:12:08.452713 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:12:08.452713 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:12:08.452713 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:12:08.452713 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:12:08.452713 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:12:08.452713 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 20 22:12:08.452713 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 20 22:12:08.452713 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 20 22:12:08.452713 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 20 22:12:08.453802 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:12:08.453802 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:12:08.453802 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 20 22:12:08.453802 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 22:12:08.453802 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 20 22:12:08.453802 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 22:12:08.453802 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:12:08.453802 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:12:08.453802 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:12:08.453802 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:12:08.453802 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:12:08.453802 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:12:08.453802 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:12:08.453802 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:12:08.453802 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:12:08.453802 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:12:08.453802 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:12:08.453802 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:12:08.454802 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:12:08.454802 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:12:08.454802 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 20 22:12:08.454802 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 20 22:12:08.454802 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 20 22:12:08.454802 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 20 22:12:08.454802 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 20 22:12:08.454802 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 20 22:12:08.454802 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 20 22:12:08.454802 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:12:08.454802 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 558/1097] 10.222.0.33 () {56 vars in 1093 bytes} [Tue Sep 20 22:12:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 20 22:12:08.459994 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e22c6d-acac-44e4-9a75-7fe33aacdfa5 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:12:08.481504 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:12:08.542982 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6f5757-b732-4a2a-b5ba-cd025e2d0534 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:12:08.545222 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:12:08.560387 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e22c6d-acac-44e4-9a75-7fe33aacdfa5 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:12:08.577476 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f879ddc4-1e2d-44a5-aad5-206a9175128a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:12:08.578100 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f879ddc4-1e2d-44a5-aad5-206a9175128a None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:08.578376 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f879ddc4-1e2d-44a5-aad5-206a9175128a None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:08.578674 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f879ddc4-1e2d-44a5-aad5-206a9175128a None admin] PATH_INFO: `/v3/projects/9c6891cc745e470f988813af154996ba` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:08.579774 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f879ddc4-1e2d-44a5-aad5-206a9175128a None admin] RBAC: Authorizing `identity:get_project(project_id=9c6891cc745e470f988813af154996ba)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:12:08.581817 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f879ddc4-1e2d-44a5-aad5-206a9175128a None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:12:08.583931 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 540/1098] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Sep 20 22:12:08 2022] GET /identity/v3/projects/9c6891cc745e470f988813af154996ba => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:12:08.589871 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f879ddc4-1e2d-44a5-aad5-206a9175128a None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:12:08.594622 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b6d578-ce05-4a88-89d2-fe3493f55feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:12:08.595227 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b6d578-ce05-4a88-89d2-fe3493f55feb None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:08.595505 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b6d578-ce05-4a88-89d2-fe3493f55feb None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:08.595777 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b6d578-ce05-4a88-89d2-fe3493f55feb None admin] PATH_INFO: `/v3/users` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:08.596496 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b6d578-ce05-4a88-89d2-fe3493f55feb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:12:08.596839 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b6d578-ce05-4a88-89d2-fe3493f55feb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:12:08.598245 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b6d578-ce05-4a88-89d2-fe3493f55feb None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:12:08.615059 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 559/1099] 10.222.0.33 () {56 vars in 1133 bytes} [Tue Sep 20 22:12:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 22:12:08.620532 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b6d578-ce05-4a88-89d2-fe3493f55feb None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:12:08.686635 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f879ddc4-1e2d-44a5-aad5-206a9175128a None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:12:08.698203 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:12:08.719906 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b6d578-ce05-4a88-89d2-fe3493f55feb None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:12:08.721746 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5799c9b-ca4b-4a70-ac0e-e56fd13d1ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:12:08.722345 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5799c9b-ca4b-4a70-ac0e-e56fd13d1ae7 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:08.722652 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5799c9b-ca4b-4a70-ac0e-e56fd13d1ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:08.722923 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5799c9b-ca4b-4a70-ac0e-e56fd13d1ae7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:08.723634 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5799c9b-ca4b-4a70-ac0e-e56fd13d1ae7 None admin] RBAC: Adding query filter params (role.id=8a829170b29d42d6af589399e51edb0f, scope.project.id=9c6891cc745e470f988813af154996ba, user.id=3efb42abfff6417b890081f9b842fe77) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:12:08.723938 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5799c9b-ca4b-4a70-ac0e-e56fd13d1ae7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:12:08.725350 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5799c9b-ca4b-4a70-ac0e-e56fd13d1ae7 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:12:08.731111 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 541/1100] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Sep 20 22:12:08 2022] GET /identity/v3/role_assignments?user.id=3efb42abfff6417b890081f9b842fe77&scope.project.id=9c6891cc745e470f988813af154996ba&role.id=8a829170b29d42d6af589399e51edb0f => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 22:12:08.758416 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9093d74-9ee0-4217-9c0a-275a1fa6462d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:12:08.758980 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9093d74-9ee0-4217-9c0a-275a1fa6462d None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:08.759257 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9093d74-9ee0-4217-9c0a-275a1fa6462d None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:08.759525 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9093d74-9ee0-4217-9c0a-275a1fa6462d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:08.830306 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9093d74-9ee0-4217-9c0a-275a1fa6462d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:12:08.831843 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9093d74-9ee0-4217-9c0a-275a1fa6462d None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:12:08.909449 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:12:08.932039 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 560/1101] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 20 22:12:08 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 20 22:12:08.938098 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5799c9b-ca4b-4a70-ac0e-e56fd13d1ae7 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:12:08.974196 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:12:09.041931 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5799c9b-ca4b-4a70-ac0e-e56fd13d1ae7 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:12:09.075572 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a978d0-f2ad-4e73-adb7-45f8ae1085af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:12:09.076194 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a978d0-f2ad-4e73-adb7-45f8ae1085af None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:09.076472 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a978d0-f2ad-4e73-adb7-45f8ae1085af None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:09.076745 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a978d0-f2ad-4e73-adb7-45f8ae1085af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:09.087725 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a978d0-f2ad-4e73-adb7-45f8ae1085af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:12:09.089234 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a978d0-f2ad-4e73-adb7-45f8ae1085af None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:12:09.103625 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-f9a978d0-f2ad-4e73-adb7-45f8ae1085af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:12:09.103625 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:12:09.103625 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:12:09.103625 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:12:09.103625 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:12:09.103625 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:12:09.103625 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:12:09.103625 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:12:09.103625 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:12:09.103625 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:12:09.103625 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:12:09.103625 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:12:09.103625 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 22:12:09.103625 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 22:12:09.103625 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 22:12:09.103625 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 22:12:09.104639 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:12:09.104639 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:12:09.104639 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:12:09.104639 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:12:09.104639 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:12:09.104639 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:12:09.104639 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:12:09.104639 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:12:09.104639 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:12:09.104639 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:12:09.104639 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:12:09.104639 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:12:09.104639 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:12:09.104639 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:12:09.104639 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:12:09.104639 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:12:09.104639 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 22:12:09.105541 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 22:12:09.105541 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:12:09.105541 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:12:09.105541 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 542/1102] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 20 22:12:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:12:09.110356 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9093d74-9ee0-4217-9c0a-275a1fa6462d None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:12:09.205642 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9093d74-9ee0-4217-9c0a-275a1fa6462d None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:12:09.238924 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e9967a-9ccc-469b-964f-21f536d99783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:12:09.239537 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e9967a-9ccc-469b-964f-21f536d99783 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:09.239818 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e9967a-9ccc-469b-964f-21f536d99783 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:09.240090 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e9967a-9ccc-469b-964f-21f536d99783 None admin] PATH_INFO: `/v3/domains` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:09.240733 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e9967a-9ccc-469b-964f-21f536d99783 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:12:09.241061 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e9967a-9ccc-469b-964f-21f536d99783 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:12:09.242414 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e9967a-9ccc-469b-964f-21f536d99783 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:12:09.254086 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 561/1103] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 20 22:12:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:12:09.259709 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a978d0-f2ad-4e73-adb7-45f8ae1085af None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:12:09.349387 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:12:09.361848 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a978d0-f2ad-4e73-adb7-45f8ae1085af None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:12:09.395074 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e764cc74-b157-4808-a4dc-deabbbdeee3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:12:09.395702 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e764cc74-b157-4808-a4dc-deabbbdeee3c None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:09.395979 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e764cc74-b157-4808-a4dc-deabbbdeee3c None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:09.396249 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e764cc74-b157-4808-a4dc-deabbbdeee3c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:09.402774 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e764cc74-b157-4808-a4dc-deabbbdeee3c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:12:09.404203 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e764cc74-b157-4808-a4dc-deabbbdeee3c None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:12:09.415112 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-e764cc74-b157-4808-a4dc-deabbbdeee3c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 22:12:09.415112 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:12:09.415112 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:12:09.415112 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:12:09.415112 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:12:09.415112 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:12:09.415112 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:12:09.415112 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:12:09.415112 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:12:09.415112 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:12:09.415112 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:12:09.415112 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:12:09.415112 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 20 22:12:09.415112 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 20 22:12:09.415112 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 20 22:12:09.416164 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 20 22:12:09.416164 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:12:09.416164 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:12:09.416164 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:12:09.416164 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:12:09.416164 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:12:09.416164 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:12:09.416164 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:12:09.416164 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:12:09.416164 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:12:09.416164 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:12:09.416164 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:12:09.416164 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:12:09.416164 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:12:09.416164 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:12:09.416164 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:12:09.416164 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:12:09.417251 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 20 22:12:09.417251 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 20 22:12:09.417251 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 20 22:12:09.417251 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 20 22:12:09.417251 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 20 22:12:09.417251 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 20 22:12:09.417251 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 22:12:09.417251 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:12:09.418651 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 543/1104] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Sep 20 22:12:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:12:09.421942 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e9967a-9ccc-469b-964f-21f536d99783 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:12:09.462963 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:12:09.521825 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e9967a-9ccc-469b-964f-21f536d99783 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:12:09.554172 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e672e81a-137a-45d9-b992-d7a7ab922c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:12:09.554738 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e672e81a-137a-45d9-b992-d7a7ab922c9c None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:09.555014 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e672e81a-137a-45d9-b992-d7a7ab922c9c None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:09.555284 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e672e81a-137a-45d9-b992-d7a7ab922c9c None admin] PATH_INFO: `/v3/projects` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:09.555957 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e672e81a-137a-45d9-b992-d7a7ab922c9c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:12:09.556258 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e672e81a-137a-45d9-b992-d7a7ab922c9c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:12:09.557650 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e672e81a-137a-45d9-b992-d7a7ab922c9c None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:12:09.569734 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 562/1105] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Sep 20 22:12:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:12:09.575683 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e764cc74-b157-4808-a4dc-deabbbdeee3c None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:12:09.677816 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e764cc74-b157-4808-a4dc-deabbbdeee3c None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:12:09.710195 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b06ed0-6008-4fda-95ef-20f6f3114415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:12:09.710817 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b06ed0-6008-4fda-95ef-20f6f3114415 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:09.711093 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b06ed0-6008-4fda-95ef-20f6f3114415 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:09.711360 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b06ed0-6008-4fda-95ef-20f6f3114415 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:09.712074 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b06ed0-6008-4fda-95ef-20f6f3114415 None admin] RBAC: Adding query filter params (role.id=9fd7d9b8b5224290acc6e44595c9000b, scope.project.id=3ce415d02aa9489bae19cd514805fd8c, user.id=db7eed561e99452289a662ad326cf919) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:12:09.712375 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b06ed0-6008-4fda-95ef-20f6f3114415 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:12:09.713783 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b06ed0-6008-4fda-95ef-20f6f3114415 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:12:09.719361 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 544/1106] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Sep 20 22:12:09 2022] GET /identity/v3/role_assignments?user.id=db7eed561e99452289a662ad326cf919&scope.project.id=3ce415d02aa9489bae19cd514805fd8c&role.id=9fd7d9b8b5224290acc6e44595c9000b => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:12:10.899370 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1d6637-1e5e-40d4-95f8-f8a04dbd63ed None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:10.899895 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1d6637-1e5e-40d4-95f8-f8a04dbd63ed None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:10.899895 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1d6637-1e5e-40d4-95f8-f8a04dbd63ed None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:10.901255 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 563/1107] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:12:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:12:10.906402 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723c2560-e314-498c-a1ed-64341f6bdf15 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:10.906867 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723c2560-e314-498c-a1ed-64341f6bdf15 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:10.906983 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723c2560-e314-498c-a1ed-64341f6bdf15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:10.925663 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-723c2560-e314-498c-a1ed-64341f6bdf15 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:12:10.926857 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-723c2560-e314-498c-a1ed-64341f6bdf15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:12:10.934215 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:12:10.992372 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 545/1108] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:12:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 20 22:12:11.262936 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1d6637-1e5e-40d4-95f8-f8a04dbd63ed None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:12:11.356004 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:12:11.360581 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1d6637-1e5e-40d4-95f8-f8a04dbd63ed None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:12:11.393576 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5688e6-a66c-4252-bfff-65ef7fc66b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:12:11.394186 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5688e6-a66c-4252-bfff-65ef7fc66b00 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:11.394498 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5688e6-a66c-4252-bfff-65ef7fc66b00 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:11.394798 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5688e6-a66c-4252-bfff-65ef7fc66b00 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:11.395889 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5688e6-a66c-4252-bfff-65ef7fc66b00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:12:11.397292 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5688e6-a66c-4252-bfff-65ef7fc66b00 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:12:11.398857 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 564/1109] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 20 22:12:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:12:11.404615 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723c2560-e314-498c-a1ed-64341f6bdf15 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:12:11.499750 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723c2560-e314-498c-a1ed-64341f6bdf15 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:12:11.531701 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838c9f2d-f953-4e34-906c-19cd5092ff81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:12:11.532247 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838c9f2d-f953-4e34-906c-19cd5092ff81 None admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:11.532552 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838c9f2d-f953-4e34-906c-19cd5092ff81 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:11.532818 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838c9f2d-f953-4e34-906c-19cd5092ff81 None admin] PATH_INFO: `/v3/users` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:11.533454 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838c9f2d-f953-4e34-906c-19cd5092ff81 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:12:11.535402 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838c9f2d-f953-4e34-906c-19cd5092ff81 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:12:11.551796 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:12:11.558893 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 546/1110] 10.222.0.33 () {60 vars in 1132 bytes} [Tue Sep 20 22:12:11 2022] POST /identity/v3/users => generated 286 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:12:13.700458 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816b9bc5-f49d-4927-ac25-f81e0fd3b029 None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:13.701004 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816b9bc5-f49d-4927-ac25-f81e0fd3b029 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:13.701004 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816b9bc5-f49d-4927-ac25-f81e0fd3b029 None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:13.702317 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 565/1111] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:12:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:12:13.708097 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495c21b2-1abe-4a47-b1be-802c43191784 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:13.708541 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495c21b2-1abe-4a47-b1be-802c43191784 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:13.708677 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495c21b2-1abe-4a47-b1be-802c43191784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:13.726300 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-495c21b2-1abe-4a47-b1be-802c43191784 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:12:13.727510 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-495c21b2-1abe-4a47-b1be-802c43191784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:12:13.790525 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 547/1112] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:12:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 20 22:12:14.056847 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816b9bc5-f49d-4927-ac25-f81e0fd3b029 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:12:14.154495 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816b9bc5-f49d-4927-ac25-f81e0fd3b029 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:12:14.187150 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a589f0c0-7fcd-41ff-8f83-453f57da3544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:12:14.187758 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a589f0c0-7fcd-41ff-8f83-453f57da3544 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:14.188034 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a589f0c0-7fcd-41ff-8f83-453f57da3544 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:14.188304 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a589f0c0-7fcd-41ff-8f83-453f57da3544 None admin] PATH_INFO: `/v3/roles/4e75d58a1e0e4fffa940914b1e5f46de` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:14.189899 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a589f0c0-7fcd-41ff-8f83-453f57da3544 None admin] RBAC: Authorizing `identity:get_role(role_id=4e75d58a1e0e4fffa940914b1e5f46de)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:12:14.191966 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a589f0c0-7fcd-41ff-8f83-453f57da3544 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:12:14.193257 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 566/1113] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Sep 20 22:12:14 2022] GET /identity/v3/roles/4e75d58a1e0e4fffa940914b1e5f46de => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:12:14.198916 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495c21b2-1abe-4a47-b1be-802c43191784 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:12:14.294005 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495c21b2-1abe-4a47-b1be-802c43191784 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:12:14.322652 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:12:14.330646 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caf5b6c-56ad-4b6c-a3e2-1b635ccc983c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:12:14.331317 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caf5b6c-56ad-4b6c-a3e2-1b635ccc983c None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:14.331595 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caf5b6c-56ad-4b6c-a3e2-1b635ccc983c None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:14.331864 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caf5b6c-56ad-4b6c-a3e2-1b635ccc983c None admin] PATH_INFO: `/v3/users/7de6937e8f2c45608cfbf0d7b3440fc8` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:14.344437 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caf5b6c-56ad-4b6c-a3e2-1b635ccc983c None admin] RBAC: Authorizing `identity:get_user(user_id=7de6937e8f2c45608cfbf0d7b3440fc8)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:12:14.345864 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caf5b6c-56ad-4b6c-a3e2-1b635ccc983c None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:12:14.347519 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 548/1114] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Sep 20 22:12:14 2022] GET /identity/v3/users/7de6937e8f2c45608cfbf0d7b3440fc8 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:12:14.353366 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a589f0c0-7fcd-41ff-8f83-453f57da3544 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:12:14.386665 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:12:14.450046 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a589f0c0-7fcd-41ff-8f83-453f57da3544 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:12:14.482587 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6ff318-c4f7-4211-91b9-4ef6e097a57d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:12:14.483179 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6ff318-c4f7-4211-91b9-4ef6e097a57d None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:14.483460 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6ff318-c4f7-4211-91b9-4ef6e097a57d None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:14.483733 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6ff318-c4f7-4211-91b9-4ef6e097a57d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:14.547844 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6ff318-c4f7-4211-91b9-4ef6e097a57d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:12:14.550464 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6ff318-c4f7-4211-91b9-4ef6e097a57d None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:12:14.583021 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:12:14.647119 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 567/1115] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 20 22:12:14 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 20 22:12:14.652978 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caf5b6c-56ad-4b6c-a3e2-1b635ccc983c None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:12:14.753861 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caf5b6c-56ad-4b6c-a3e2-1b635ccc983c None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:12:14.786629 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6ad573-5347-44a8-b2c2-1e9bd40ccf04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:12:14.787253 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6ad573-5347-44a8-b2c2-1e9bd40ccf04 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:14.787534 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6ad573-5347-44a8-b2c2-1e9bd40ccf04 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:14.787806 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6ad573-5347-44a8-b2c2-1e9bd40ccf04 None admin] PATH_INFO: `/v3/projects/9c6891cc745e470f988813af154996ba` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:14.788908 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6ad573-5347-44a8-b2c2-1e9bd40ccf04 None admin] RBAC: Authorizing `identity:get_project(project_id=9c6891cc745e470f988813af154996ba)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:12:14.790333 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6ad573-5347-44a8-b2c2-1e9bd40ccf04 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:12:14.791977 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 549/1116] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Sep 20 22:12:14 2022] GET /identity/v3/projects/9c6891cc745e470f988813af154996ba => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:12:14.798060 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6ff318-c4f7-4211-91b9-4ef6e097a57d None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:12:14.892866 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6ff318-c4f7-4211-91b9-4ef6e097a57d None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:12:14.925478 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd596d6-f990-4868-b24c-2b94b0e0fea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:12:14.926054 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd596d6-f990-4868-b24c-2b94b0e0fea8 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:14.926325 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd596d6-f990-4868-b24c-2b94b0e0fea8 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:14.926624 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd596d6-f990-4868-b24c-2b94b0e0fea8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:14.927330 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd596d6-f990-4868-b24c-2b94b0e0fea8 None admin] RBAC: Adding query filter params (role.id=4e75d58a1e0e4fffa940914b1e5f46de, scope.project.id=9c6891cc745e470f988813af154996ba, user.id=7de6937e8f2c45608cfbf0d7b3440fc8) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:12:14.927633 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd596d6-f990-4868-b24c-2b94b0e0fea8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:12:14.929283 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd596d6-f990-4868-b24c-2b94b0e0fea8 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:12:14.930994 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:12:14.935441 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 568/1117] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Sep 20 22:12:14 2022] GET /identity/v3/role_assignments?user.id=7de6937e8f2c45608cfbf0d7b3440fc8&scope.project.id=9c6891cc745e470f988813af154996ba&role.id=4e75d58a1e0e4fffa940914b1e5f46de => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:12:17.032842 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e204cc-690d-4740-84e8-9ac9d2883d2d None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:17.033367 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e204cc-690d-4740-84e8-9ac9d2883d2d None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:17.033367 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e204cc-690d-4740-84e8-9ac9d2883d2d None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:17.035347 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 550/1118] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:12:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:12:17.042094 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3adac1-587a-4b0d-b79f-0123ce36ddca None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:17.042539 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3adac1-587a-4b0d-b79f-0123ce36ddca None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:17.042677 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3adac1-587a-4b0d-b79f-0123ce36ddca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:17.061314 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-6b3adac1-587a-4b0d-b79f-0123ce36ddca None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:12:17.062482 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-6b3adac1-587a-4b0d-b79f-0123ce36ddca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:12:17.125887 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 569/1119] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:12:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 20 22:12:17.396600 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e204cc-690d-4740-84e8-9ac9d2883d2d None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:12:17.451696 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:12:17.495523 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e204cc-690d-4740-84e8-9ac9d2883d2d None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:12:17.528373 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a77e0f5-2efb-4800-afa3-2610e868a74a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:12:17.528987 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a77e0f5-2efb-4800-afa3-2610e868a74a None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:17.529265 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a77e0f5-2efb-4800-afa3-2610e868a74a None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:17.529533 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a77e0f5-2efb-4800-afa3-2610e868a74a None admin] PATH_INFO: `/v3/roles/4e75d58a1e0e4fffa940914b1e5f46de` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:17.530933 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a77e0f5-2efb-4800-afa3-2610e868a74a None admin] RBAC: Authorizing `identity:get_role(role_id=4e75d58a1e0e4fffa940914b1e5f46de)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:12:17.532291 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a77e0f5-2efb-4800-afa3-2610e868a74a None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:12:17.533576 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 551/1120] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Sep 20 22:12:17 2022] GET /identity/v3/roles/4e75d58a1e0e4fffa940914b1e5f46de => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:12:17.539342 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3adac1-587a-4b0d-b79f-0123ce36ddca None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:12:17.633897 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3adac1-587a-4b0d-b79f-0123ce36ddca None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:12:17.659112 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:12:17.667024 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee982dd-ab7e-43f8-9f53-f93f6766db4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:12:17.667643 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee982dd-ab7e-43f8-9f53-f93f6766db4d None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:17.667917 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee982dd-ab7e-43f8-9f53-f93f6766db4d None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:17.668183 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee982dd-ab7e-43f8-9f53-f93f6766db4d None admin] PATH_INFO: `/v3/users/7de6937e8f2c45608cfbf0d7b3440fc8` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:17.669273 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee982dd-ab7e-43f8-9f53-f93f6766db4d None admin] RBAC: Authorizing `identity:get_user(user_id=7de6937e8f2c45608cfbf0d7b3440fc8)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:12:17.670715 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee982dd-ab7e-43f8-9f53-f93f6766db4d None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:12:17.672251 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 570/1121] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Sep 20 22:12:17 2022] GET /identity/v3/users/7de6937e8f2c45608cfbf0d7b3440fc8 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:12:17.678054 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a77e0f5-2efb-4800-afa3-2610e868a74a None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:12:17.775371 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a77e0f5-2efb-4800-afa3-2610e868a74a None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:12:17.796500 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:12:17.808975 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56b0ddb-0e34-404d-b600-25acb30fdee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:12:17.809598 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56b0ddb-0e34-404d-b600-25acb30fdee0 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:17.809879 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56b0ddb-0e34-404d-b600-25acb30fdee0 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:17.810149 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56b0ddb-0e34-404d-b600-25acb30fdee0 None admin] PATH_INFO: `/v3/projects/9c6891cc745e470f988813af154996ba` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:17.811283 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56b0ddb-0e34-404d-b600-25acb30fdee0 None admin] RBAC: Authorizing `identity:get_project(project_id=9c6891cc745e470f988813af154996ba)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:12:17.812708 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56b0ddb-0e34-404d-b600-25acb30fdee0 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:12:17.814317 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 552/1122] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Sep 20 22:12:17 2022] GET /identity/v3/projects/9c6891cc745e470f988813af154996ba => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:12:17.820779 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee982dd-ab7e-43f8-9f53-f93f6766db4d None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:12:17.917739 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee982dd-ab7e-43f8-9f53-f93f6766db4d None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:12:17.950665 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43554f36-3165-45df-8f08-6aa7db6c07f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:12:17.951305 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43554f36-3165-45df-8f08-6aa7db6c07f5 None admin] REQUEST_METHOD: `PUT` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:17.951582 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43554f36-3165-45df-8f08-6aa7db6c07f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:17.951851 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43554f36-3165-45df-8f08-6aa7db6c07f5 None admin] PATH_INFO: `/v3/projects/9c6891cc745e470f988813af154996ba/users/7de6937e8f2c45608cfbf0d7b3440fc8/roles/4e75d58a1e0e4fffa940914b1e5f46de` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:17.953947 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43554f36-3165-45df-8f08-6aa7db6c07f5 None admin] RBAC: Authorizing `identity:create_grant(project_id=9c6891cc745e470f988813af154996ba, user_id=7de6937e8f2c45608cfbf0d7b3440fc8, role_id=4e75d58a1e0e4fffa940914b1e5f46de)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:12:17.955390 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43554f36-3165-45df-8f08-6aa7db6c07f5 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:12:17.967122 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 571/1123] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Sep 20 22:12:17 2022] PUT /identity/v3/projects/9c6891cc745e470f988813af154996ba/users/7de6937e8f2c45608cfbf0d7b3440fc8/roles/4e75d58a1e0e4fffa940914b1e5f46de => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:12:20.089270 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ec627-46ce-4511-8b4b-2caaa362ab66 None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:20.089830 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ec627-46ce-4511-8b4b-2caaa362ab66 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:20.089830 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ec627-46ce-4511-8b4b-2caaa362ab66 None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:20.091186 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 553/1124] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:12:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:12:20.096931 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dae4fc2-dc40-4075-9cf4-51dfe9609386 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:20.097321 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dae4fc2-dc40-4075-9cf4-51dfe9609386 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:20.097473 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dae4fc2-dc40-4075-9cf4-51dfe9609386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:20.115186 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-3dae4fc2-dc40-4075-9cf4-51dfe9609386 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:12:20.116359 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-3dae4fc2-dc40-4075-9cf4-51dfe9609386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:12:20.164797 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:12:20.181994 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 572/1125] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:12:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 20 22:12:20.469527 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653ec627-46ce-4511-8b4b-2caaa362ab66 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:12:20.567925 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653ec627-46ce-4511-8b4b-2caaa362ab66 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:12:20.600992 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a757ec-4c83-46f5-93ee-d0b33fcd2ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:12:20.601607 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a757ec-4c83-46f5-93ee-d0b33fcd2ae8 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:20.601885 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a757ec-4c83-46f5-93ee-d0b33fcd2ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:20.602156 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a757ec-4c83-46f5-93ee-d0b33fcd2ae8 None admin] PATH_INFO: `/v3/roles/4e75d58a1e0e4fffa940914b1e5f46de` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:20.603562 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a757ec-4c83-46f5-93ee-d0b33fcd2ae8 None admin] RBAC: Authorizing `identity:get_role(role_id=4e75d58a1e0e4fffa940914b1e5f46de)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:12:20.604923 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a757ec-4c83-46f5-93ee-d0b33fcd2ae8 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:12:20.606227 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 554/1126] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Sep 20 22:12:20 2022] GET /identity/v3/roles/4e75d58a1e0e4fffa940914b1e5f46de => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:12:20.612065 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dae4fc2-dc40-4075-9cf4-51dfe9609386 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:12:20.706518 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dae4fc2-dc40-4075-9cf4-51dfe9609386 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:12:20.737968 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8b1230-fbf8-4810-800f-4d96015c76de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:12:20.738539 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b1230-fbf8-4810-800f-4d96015c76de None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:20.738823 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b1230-fbf8-4810-800f-4d96015c76de None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:20.739093 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b1230-fbf8-4810-800f-4d96015c76de None admin] PATH_INFO: `/v3/users/7de6937e8f2c45608cfbf0d7b3440fc8` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:20.740179 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8b1230-fbf8-4810-800f-4d96015c76de None admin] RBAC: Authorizing `identity:get_user(user_id=7de6937e8f2c45608cfbf0d7b3440fc8)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:12:20.741579 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8b1230-fbf8-4810-800f-4d96015c76de None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:12:20.743132 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 573/1127] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Sep 20 22:12:20 2022] GET /identity/v3/users/7de6937e8f2c45608cfbf0d7b3440fc8 => generated 286 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:12:20.748844 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a757ec-4c83-46f5-93ee-d0b33fcd2ae8 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:12:20.807896 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:12:20.849946 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a757ec-4c83-46f5-93ee-d0b33fcd2ae8 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:12:20.882814 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19cc364-9325-4648-a56d-4a0197112d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:12:20.883418 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19cc364-9325-4648-a56d-4a0197112d10 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:20.883696 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19cc364-9325-4648-a56d-4a0197112d10 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:20.883965 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19cc364-9325-4648-a56d-4a0197112d10 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:20.948031 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19cc364-9325-4648-a56d-4a0197112d10 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:12:20.949460 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19cc364-9325-4648-a56d-4a0197112d10 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:12:21.003407 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:12:21.047818 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 555/1128] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 20 22:12:20 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 20 22:12:21.055408 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8b1230-fbf8-4810-800f-4d96015c76de None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:12:21.109690 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:12:21.153505 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8b1230-fbf8-4810-800f-4d96015c76de None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:12:21.186817 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3830ad-97ff-4b1f-8523-455f52ecdd2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:12:21.187428 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3830ad-97ff-4b1f-8523-455f52ecdd2c None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:21.187701 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3830ad-97ff-4b1f-8523-455f52ecdd2c None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:21.187969 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3830ad-97ff-4b1f-8523-455f52ecdd2c None admin] PATH_INFO: `/v3/projects/9c6891cc745e470f988813af154996ba` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:21.189048 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3830ad-97ff-4b1f-8523-455f52ecdd2c None admin] RBAC: Authorizing `identity:get_project(project_id=9c6891cc745e470f988813af154996ba)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:12:21.190493 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3830ad-97ff-4b1f-8523-455f52ecdd2c None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:12:21.192110 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 574/1129] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Sep 20 22:12:21 2022] GET /identity/v3/projects/9c6891cc745e470f988813af154996ba => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:12:21.198266 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19cc364-9325-4648-a56d-4a0197112d10 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:12:21.293258 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19cc364-9325-4648-a56d-4a0197112d10 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:12:21.326546 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9822942-71cc-4847-980b-4493e22845f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:12:21.327145 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9822942-71cc-4847-980b-4493e22845f6 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:21.327424 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9822942-71cc-4847-980b-4493e22845f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:21.327693 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9822942-71cc-4847-980b-4493e22845f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:21.328432 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9822942-71cc-4847-980b-4493e22845f6 None admin] RBAC: Adding query filter params (role.id=4e75d58a1e0e4fffa940914b1e5f46de, scope.project.id=9c6891cc745e470f988813af154996ba, user.id=7de6937e8f2c45608cfbf0d7b3440fc8) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:12:21.328737 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9822942-71cc-4847-980b-4493e22845f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:12:21.330148 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9822942-71cc-4847-980b-4493e22845f6 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:12:21.335849 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 556/1130] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Sep 20 22:12:21 2022] GET /identity/v3/role_assignments?user.id=7de6937e8f2c45608cfbf0d7b3440fc8&scope.project.id=9c6891cc745e470f988813af154996ba&role.id=4e75d58a1e0e4fffa940914b1e5f46de => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:12:23.490068 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921049d2-e67e-4439-ab5f-8a23cfb4fdf0 None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:23.490593 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921049d2-e67e-4439-ab5f-8a23cfb4fdf0 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:23.490700 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921049d2-e67e-4439-ab5f-8a23cfb4fdf0 None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:23.491956 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 575/1131] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:12:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:12:23.497111 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598e4955-4f21-40be-936c-fbd9c202dc52 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:23.497527 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598e4955-4f21-40be-936c-fbd9c202dc52 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:23.497653 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598e4955-4f21-40be-936c-fbd9c202dc52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:23.515846 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-598e4955-4f21-40be-936c-fbd9c202dc52 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:12:23.517015 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-598e4955-4f21-40be-936c-fbd9c202dc52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:12:23.533347 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:12:23.582363 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 557/1132] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:12:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 20 22:12:23.853574 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921049d2-e67e-4439-ab5f-8a23cfb4fdf0 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:12:23.953498 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921049d2-e67e-4439-ab5f-8a23cfb4fdf0 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:12:23.975221 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:12:23.987173 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf81c144-49ba-4dda-9a62-5e2ecba2b65e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:12:23.987797 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf81c144-49ba-4dda-9a62-5e2ecba2b65e None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:23.988070 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf81c144-49ba-4dda-9a62-5e2ecba2b65e None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:23.988335 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf81c144-49ba-4dda-9a62-5e2ecba2b65e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:23.989431 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf81c144-49ba-4dda-9a62-5e2ecba2b65e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:12:23.990870 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf81c144-49ba-4dda-9a62-5e2ecba2b65e None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:12:23.992430 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 576/1133] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 20 22:12:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:12:23.998322 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598e4955-4f21-40be-936c-fbd9c202dc52 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:12:24.097708 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598e4955-4f21-40be-936c-fbd9c202dc52 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:12:24.130464 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0af819-7895-4a52-9454-31cb2dc1c3b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:12:24.131031 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0af819-7895-4a52-9454-31cb2dc1c3b9 None admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:24.131304 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0af819-7895-4a52-9454-31cb2dc1c3b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:24.131568 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0af819-7895-4a52-9454-31cb2dc1c3b9 None admin] PATH_INFO: `/v3/projects` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:24.132274 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0af819-7895-4a52-9454-31cb2dc1c3b9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:12:24.133817 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0af819-7895-4a52-9454-31cb2dc1c3b9 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:12:24.160332 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 558/1134] 10.222.0.33 () {60 vars in 1141 bytes} [Tue Sep 20 22:12:23 2022] POST /identity/v3/projects => generated 311 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:12:26.318977 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3129a7-be80-4971-b9ce-7a1f26cad0c2 None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:26.319406 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3129a7-be80-4971-b9ce-7a1f26cad0c2 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:26.319523 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3129a7-be80-4971-b9ce-7a1f26cad0c2 None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:26.320842 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 577/1135] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:12:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:12:26.325972 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e28a2f0-bdb4-4d6c-871b-f0d4e336ec65 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:26.326365 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e28a2f0-bdb4-4d6c-871b-f0d4e336ec65 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:26.326596 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e28a2f0-bdb4-4d6c-871b-f0d4e336ec65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:26.334175 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:12:26.346766 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-4e28a2f0-bdb4-4d6c-871b-f0d4e336ec65 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:12:26.348559 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-4e28a2f0-bdb4-4d6c-871b-f0d4e336ec65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:12:26.412410 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 559/1136] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:12:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 20 22:12:26.677261 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3129a7-be80-4971-b9ce-7a1f26cad0c2 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:12:26.774264 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3129a7-be80-4971-b9ce-7a1f26cad0c2 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:12:26.806415 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f04039f-0d68-4e3b-93ae-3c61f7d21eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:12:26.807043 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f04039f-0d68-4e3b-93ae-3c61f7d21eed None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:26.807318 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f04039f-0d68-4e3b-93ae-3c61f7d21eed None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:26.807584 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f04039f-0d68-4e3b-93ae-3c61f7d21eed None admin] PATH_INFO: `/v3/domains/default` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:26.808670 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f04039f-0d68-4e3b-93ae-3c61f7d21eed None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:12:26.810071 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f04039f-0d68-4e3b-93ae-3c61f7d21eed None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:12:26.811613 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 578/1137] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 20 22:12:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:12:26.817770 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e28a2f0-bdb4-4d6c-871b-f0d4e336ec65 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:12:26.912539 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e28a2f0-bdb4-4d6c-871b-f0d4e336ec65 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:12:26.946566 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d03c59-74bc-419f-af1e-ee3d910dc2b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:12:26.947409 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d03c59-74bc-419f-af1e-ee3d910dc2b3 None admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:26.947725 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d03c59-74bc-419f-af1e-ee3d910dc2b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:26.948068 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d03c59-74bc-419f-af1e-ee3d910dc2b3 None admin] PATH_INFO: `/v3/users` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:26.948808 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d03c59-74bc-419f-af1e-ee3d910dc2b3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:12:26.950774 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d03c59-74bc-419f-af1e-ee3d910dc2b3 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:12:26.958644 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:12:26.971381 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 560/1138] 10.222.0.33 () {60 vars in 1132 bytes} [Tue Sep 20 22:12:26 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:12:29.126162 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55671289-9425-4226-8680-05f7cf30f4a3 None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:29.126731 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55671289-9425-4226-8680-05f7cf30f4a3 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:29.126731 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55671289-9425-4226-8680-05f7cf30f4a3 None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:29.128692 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 579/1139] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:12:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:12:29.133974 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e231c5-6385-4449-8dfc-e13647b0318f None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:29.134386 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e231c5-6385-4449-8dfc-e13647b0318f None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:29.134536 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e231c5-6385-4449-8dfc-e13647b0318f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:29.152140 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-58e231c5-6385-4449-8dfc-e13647b0318f None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:12:29.153307 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-58e231c5-6385-4449-8dfc-e13647b0318f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:12:29.216803 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 561/1140] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:12:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 20 22:12:29.483090 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55671289-9425-4226-8680-05f7cf30f4a3 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:12:29.540286 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:12:29.581008 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55671289-9425-4226-8680-05f7cf30f4a3 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:12:29.619201 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc05118-d5aa-4728-93af-884f10d55b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:12:29.619849 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc05118-d5aa-4728-93af-884f10d55b21 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:29.620124 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc05118-d5aa-4728-93af-884f10d55b21 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:29.620393 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc05118-d5aa-4728-93af-884f10d55b21 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:29.630194 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc05118-d5aa-4728-93af-884f10d55b21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 22:12:29.634900 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-2bc05118-d5aa-4728-93af-884f10d55b21 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 22:12:29.634900 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:12:29.634900 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:12:29.634900 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:12:29.634900 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:12:29.634900 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:12:29.634900 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:12:29.634900 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:12:29.634900 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:12:29.634900 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:12:29.634900 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:12:29.634900 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:12:29.634900 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 22:12:29.634900 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 22:12:29.634900 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 22:12:29.634900 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 22:12:29.635985 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 22:12:29.635985 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 22:12:29.635985 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 22:12:29.635985 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 22:12:29.635985 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:12:29.635985 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:12:29.635985 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:12:29.635985 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:12:29.635985 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:12:29.635985 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:12:29.635985 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:12:29.635985 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:12:29.635985 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:12:29.635985 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:12:29.635985 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:12:29.635985 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:12:29.637264 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:12:29.637264 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:12:29.637264 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:12:29.637264 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:12:29.637264 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 22:12:29.637264 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 22:12:29.637264 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 22:12:29.637264 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 22:12:29.637264 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 22:12:29.637264 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 22:12:29.637264 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 22:12:29.637264 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:12:29.637264 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 580/1141] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Sep 20 22:12:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:12:29.642002 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e231c5-6385-4449-8dfc-e13647b0318f None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:12:29.738239 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e231c5-6385-4449-8dfc-e13647b0318f None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:12:29.757430 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:12:29.772038 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8db90cd-9049-4c06-ac50-ebad2868d30a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:12:29.772638 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db90cd-9049-4c06-ac50-ebad2868d30a None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:29.772917 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db90cd-9049-4c06-ac50-ebad2868d30a None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:29.773184 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db90cd-9049-4c06-ac50-ebad2868d30a None admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:29.773840 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8db90cd-9049-4c06-ac50-ebad2868d30a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:12:29.774141 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8db90cd-9049-4c06-ac50-ebad2868d30a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:12:29.775535 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8db90cd-9049-4c06-ac50-ebad2868d30a None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:12:29.783883 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 562/1142] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 20 22:12:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:12:29.789630 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc05118-d5aa-4728-93af-884f10d55b21 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:12:29.885270 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc05118-d5aa-4728-93af-884f10d55b21 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:12:29.902101 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:12:29.918902 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597848a2-cfb8-4ac5-a53a-51bc11417272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:12:29.919518 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597848a2-cfb8-4ac5-a53a-51bc11417272 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:29.919796 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597848a2-cfb8-4ac5-a53a-51bc11417272 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:29.920066 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597848a2-cfb8-4ac5-a53a-51bc11417272 None admin] PATH_INFO: `/v3/users/747f9f4f189e41a1b9c946b5ff8ada1c` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:29.933100 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597848a2-cfb8-4ac5-a53a-51bc11417272 None admin] RBAC: Authorizing `identity:get_user(user_id=747f9f4f189e41a1b9c946b5ff8ada1c)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:12:29.934549 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597848a2-cfb8-4ac5-a53a-51bc11417272 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:12:29.936155 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 581/1143] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Sep 20 22:12:29 2022] GET /identity/v3/users/747f9f4f189e41a1b9c946b5ff8ada1c => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:12:29.941929 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8db90cd-9049-4c06-ac50-ebad2868d30a None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:12:30.038442 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8db90cd-9049-4c06-ac50-ebad2868d30a None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:12:30.070060 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8929b8-4222-4861-bdad-5c7f37cb588b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:12:30.070684 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8929b8-4222-4861-bdad-5c7f37cb588b None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:30.070965 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8929b8-4222-4861-bdad-5c7f37cb588b None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:30.071238 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8929b8-4222-4861-bdad-5c7f37cb588b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:30.121295 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:12:30.139171 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8929b8-4222-4861-bdad-5c7f37cb588b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:12:30.140608 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8929b8-4222-4861-bdad-5c7f37cb588b None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:12:30.235035 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 563/1144] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 20 22:12:29 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 20 22:12:30.241463 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597848a2-cfb8-4ac5-a53a-51bc11417272 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:12:30.340188 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597848a2-cfb8-4ac5-a53a-51bc11417272 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:12:30.372071 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bf1733-8650-4a16-834b-6b8e755425a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:12:30.372685 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bf1733-8650-4a16-834b-6b8e755425a3 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:30.372961 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bf1733-8650-4a16-834b-6b8e755425a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:30.373234 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bf1733-8650-4a16-834b-6b8e755425a3 None admin] PATH_INFO: `/v3/projects/03de1ab9a2084291b60d0cb31caed054` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:30.374326 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bf1733-8650-4a16-834b-6b8e755425a3 None admin] RBAC: Authorizing `identity:get_project(project_id=03de1ab9a2084291b60d0cb31caed054)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:12:30.375772 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bf1733-8650-4a16-834b-6b8e755425a3 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:12:30.377893 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 582/1145] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Sep 20 22:12:30 2022] GET /identity/v3/projects/03de1ab9a2084291b60d0cb31caed054 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:12:30.384128 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8929b8-4222-4861-bdad-5c7f37cb588b None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:12:30.463565 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:12:30.481165 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8929b8-4222-4861-bdad-5c7f37cb588b None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:12:30.514480 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eb158d-ec9e-43d8-b7d1-f88fc7c92a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:12:30.515101 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eb158d-ec9e-43d8-b7d1-f88fc7c92a3e None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:30.515385 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eb158d-ec9e-43d8-b7d1-f88fc7c92a3e None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:30.515653 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eb158d-ec9e-43d8-b7d1-f88fc7c92a3e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:30.516359 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8eb158d-ec9e-43d8-b7d1-f88fc7c92a3e None admin] RBAC: Adding query filter params (role.id=8a829170b29d42d6af589399e51edb0f, scope.project.id=03de1ab9a2084291b60d0cb31caed054, user.id=747f9f4f189e41a1b9c946b5ff8ada1c) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:12:30.516663 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8eb158d-ec9e-43d8-b7d1-f88fc7c92a3e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:12:30.518741 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8eb158d-ec9e-43d8-b7d1-f88fc7c92a3e None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:12:30.523924 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 564/1146] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Sep 20 22:12:30 2022] GET /identity/v3/role_assignments?user.id=747f9f4f189e41a1b9c946b5ff8ada1c&scope.project.id=03de1ab9a2084291b60d0cb31caed054&role.id=8a829170b29d42d6af589399e51edb0f => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:12:32.623221 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8458974c-bc7a-405f-9fea-b01fc5f29773 None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:32.623723 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8458974c-bc7a-405f-9fea-b01fc5f29773 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:32.623812 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8458974c-bc7a-405f-9fea-b01fc5f29773 None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:32.625088 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 583/1147] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:12:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:12:32.630324 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e2adbc-1a6a-4425-a622-a95a4f6c724a None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:32.630751 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e2adbc-1a6a-4425-a622-a95a4f6c724a None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:32.630903 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e2adbc-1a6a-4425-a622-a95a4f6c724a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:32.648473 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-63e2adbc-1a6a-4425-a622-a95a4f6c724a None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:12:32.649645 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-63e2adbc-1a6a-4425-a622-a95a4f6c724a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:12:32.713807 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 565/1148] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:12:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 20 22:12:32.983874 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8458974c-bc7a-405f-9fea-b01fc5f29773 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:12:33.029401 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:12:33.082528 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8458974c-bc7a-405f-9fea-b01fc5f29773 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:12:33.118457 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040ec637-b71e-4935-91e3-6c50ca13d61e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:12:33.119110 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ec637-b71e-4935-91e3-6c50ca13d61e None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:33.119391 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ec637-b71e-4935-91e3-6c50ca13d61e None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:33.119665 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ec637-b71e-4935-91e3-6c50ca13d61e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:33.129436 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040ec637-b71e-4935-91e3-6c50ca13d61e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 22:12:33.134171 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-040ec637-b71e-4935-91e3-6c50ca13d61e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 22:12:33.134171 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:12:33.134171 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:12:33.134171 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:12:33.134171 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:12:33.134171 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:12:33.134171 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:12:33.134171 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:12:33.134171 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:12:33.134171 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:12:33.134171 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:12:33.134171 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:12:33.134171 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 22:12:33.134171 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 22:12:33.134171 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 22:12:33.134171 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 22:12:33.135282 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 22:12:33.135282 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 22:12:33.135282 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 22:12:33.135282 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 22:12:33.135282 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:12:33.135282 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:12:33.135282 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:12:33.135282 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:12:33.135282 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:12:33.135282 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:12:33.135282 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:12:33.135282 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:12:33.135282 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:12:33.135282 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:12:33.135282 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:12:33.135282 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:12:33.136297 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:12:33.136297 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:12:33.136297 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:12:33.136297 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:12:33.136297 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 22:12:33.136297 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 22:12:33.136297 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 22:12:33.136297 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 22:12:33.136297 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 22:12:33.136297 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 22:12:33.136297 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 22:12:33.136297 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:12:33.136297 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 584/1149] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Sep 20 22:12:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:12:33.141461 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e2adbc-1a6a-4425-a622-a95a4f6c724a None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:12:33.216182 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:12:33.238562 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e2adbc-1a6a-4425-a622-a95a4f6c724a None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:12:33.271941 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc899fa-746f-4f74-aa7b-3187ac1aec4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:12:33.272542 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc899fa-746f-4f74-aa7b-3187ac1aec4a None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:33.272819 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc899fa-746f-4f74-aa7b-3187ac1aec4a None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:33.273086 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc899fa-746f-4f74-aa7b-3187ac1aec4a None admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:33.273739 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc899fa-746f-4f74-aa7b-3187ac1aec4a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:12:33.274039 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc899fa-746f-4f74-aa7b-3187ac1aec4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:12:33.275421 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc899fa-746f-4f74-aa7b-3187ac1aec4a None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:12:33.283238 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 566/1150] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 20 22:12:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:12:33.289065 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040ec637-b71e-4935-91e3-6c50ca13d61e None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:12:33.384904 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040ec637-b71e-4935-91e3-6c50ca13d61e None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:12:33.387137 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:12:33.417697 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9f49b6-ceb7-43e5-9fe9-e213485e46be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:12:33.418306 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9f49b6-ceb7-43e5-9fe9-e213485e46be None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:33.418606 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9f49b6-ceb7-43e5-9fe9-e213485e46be None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:33.418878 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9f49b6-ceb7-43e5-9fe9-e213485e46be None admin] PATH_INFO: `/v3/users/747f9f4f189e41a1b9c946b5ff8ada1c` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:33.419967 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9f49b6-ceb7-43e5-9fe9-e213485e46be None admin] RBAC: Authorizing `identity:get_user(user_id=747f9f4f189e41a1b9c946b5ff8ada1c)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:12:33.421376 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9f49b6-ceb7-43e5-9fe9-e213485e46be None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:12:33.422957 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 585/1151] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Sep 20 22:12:33 2022] GET /identity/v3/users/747f9f4f189e41a1b9c946b5ff8ada1c => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:12:33.428976 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc899fa-746f-4f74-aa7b-3187ac1aec4a None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:12:33.526228 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc899fa-746f-4f74-aa7b-3187ac1aec4a None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:12:33.558377 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f978ebce-fdd2-4c60-aa23-38b281eb2f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:12:33.559017 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f978ebce-fdd2-4c60-aa23-38b281eb2f2b None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:33.559293 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f978ebce-fdd2-4c60-aa23-38b281eb2f2b None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:33.559561 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f978ebce-fdd2-4c60-aa23-38b281eb2f2b None admin] PATH_INFO: `/v3/projects/03de1ab9a2084291b60d0cb31caed054` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:33.560648 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f978ebce-fdd2-4c60-aa23-38b281eb2f2b None admin] RBAC: Authorizing `identity:get_project(project_id=03de1ab9a2084291b60d0cb31caed054)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:12:33.562056 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f978ebce-fdd2-4c60-aa23-38b281eb2f2b None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:12:33.563768 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 567/1152] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Sep 20 22:12:33 2022] GET /identity/v3/projects/03de1ab9a2084291b60d0cb31caed054 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:12:33.570466 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9f49b6-ceb7-43e5-9fe9-e213485e46be None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:12:33.664536 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9f49b6-ceb7-43e5-9fe9-e213485e46be None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:12:33.697554 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0039370a-7a9f-4bfc-846d-d392d795347e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:12:33.698188 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0039370a-7a9f-4bfc-846d-d392d795347e None admin] REQUEST_METHOD: `PUT` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:33.698464 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0039370a-7a9f-4bfc-846d-d392d795347e None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:33.698767 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0039370a-7a9f-4bfc-846d-d392d795347e None admin] PATH_INFO: `/v3/projects/03de1ab9a2084291b60d0cb31caed054/users/747f9f4f189e41a1b9c946b5ff8ada1c/roles/8a829170b29d42d6af589399e51edb0f` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:33.700631 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0039370a-7a9f-4bfc-846d-d392d795347e None admin] RBAC: Authorizing `identity:create_grant(project_id=03de1ab9a2084291b60d0cb31caed054, user_id=747f9f4f189e41a1b9c946b5ff8ada1c, role_id=8a829170b29d42d6af589399e51edb0f)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:12:33.702028 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0039370a-7a9f-4bfc-846d-d392d795347e None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:12:33.714488 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 586/1153] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Sep 20 22:12:33 2022] PUT /identity/v3/projects/03de1ab9a2084291b60d0cb31caed054/users/747f9f4f189e41a1b9c946b5ff8ada1c/roles/8a829170b29d42d6af589399e51edb0f => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 22:12:35.851070 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154f49c1-482c-4217-858b-379265a602b5 None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:35.851660 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154f49c1-482c-4217-858b-379265a602b5 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:35.851660 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154f49c1-482c-4217-858b-379265a602b5 None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:35.852956 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 568/1154] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:12:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:12:35.858167 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31527926-be7e-4016-a37d-c2224aed54fc None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:35.858620 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31527926-be7e-4016-a37d-c2224aed54fc None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:35.858747 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31527926-be7e-4016-a37d-c2224aed54fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:35.876854 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-31527926-be7e-4016-a37d-c2224aed54fc None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:12:35.878633 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-31527926-be7e-4016-a37d-c2224aed54fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:12:35.902885 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:12:35.943947 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 587/1155] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:12:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 20 22:12:36.225336 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154f49c1-482c-4217-858b-379265a602b5 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:12:36.234666 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:12:36.326717 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154f49c1-482c-4217-858b-379265a602b5 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:12:36.359180 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fba2807-0ccc-43a5-9ec8-ca074eb4de24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:12:36.359797 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fba2807-0ccc-43a5-9ec8-ca074eb4de24 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:36.360070 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fba2807-0ccc-43a5-9ec8-ca074eb4de24 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:36.360334 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fba2807-0ccc-43a5-9ec8-ca074eb4de24 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:36.370619 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fba2807-0ccc-43a5-9ec8-ca074eb4de24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 22:12:36.375329 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-5fba2807-0ccc-43a5-9ec8-ca074eb4de24 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 22:12:36.375329 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:12:36.375329 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:12:36.375329 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:12:36.375329 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:12:36.375329 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:12:36.375329 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:12:36.375329 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:12:36.375329 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:12:36.375329 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:12:36.375329 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:12:36.375329 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:12:36.375329 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 22:12:36.375329 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 22:12:36.375329 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 22:12:36.375329 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 22:12:36.376491 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 22:12:36.376491 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 22:12:36.376491 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 22:12:36.376491 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 22:12:36.376491 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:12:36.376491 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:12:36.376491 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:12:36.376491 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:12:36.376491 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:12:36.376491 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:12:36.376491 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:12:36.376491 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:12:36.376491 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:12:36.376491 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:12:36.376491 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:12:36.376491 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:12:36.377404 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:12:36.377404 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:12:36.377404 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:12:36.377404 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:12:36.377404 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 22:12:36.377404 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 22:12:36.377404 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 22:12:36.377404 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 22:12:36.377404 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 22:12:36.377404 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 22:12:36.377404 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 22:12:36.377404 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:12:36.377404 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 569/1156] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Sep 20 22:12:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:12:36.382418 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31527926-be7e-4016-a37d-c2224aed54fc None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:12:36.475719 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31527926-be7e-4016-a37d-c2224aed54fc None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:12:36.508102 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ba017a-7ea7-4804-840a-a74776ed8c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:12:36.508691 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba017a-7ea7-4804-840a-a74776ed8c9a None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:36.508963 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba017a-7ea7-4804-840a-a74776ed8c9a None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:36.509226 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba017a-7ea7-4804-840a-a74776ed8c9a None admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:36.509876 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ba017a-7ea7-4804-840a-a74776ed8c9a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:12:36.510172 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ba017a-7ea7-4804-840a-a74776ed8c9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:12:36.511529 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ba017a-7ea7-4804-840a-a74776ed8c9a None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:12:36.519596 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 588/1157] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 20 22:12:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:12:36.525416 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fba2807-0ccc-43a5-9ec8-ca074eb4de24 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:12:36.589349 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:12:36.623909 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fba2807-0ccc-43a5-9ec8-ca074eb4de24 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:12:36.658604 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4956d4a4-6a43-4353-b0cb-5329f16d1070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:12:36.659770 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4956d4a4-6a43-4353-b0cb-5329f16d1070 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:36.660044 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4956d4a4-6a43-4353-b0cb-5329f16d1070 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:36.660309 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4956d4a4-6a43-4353-b0cb-5329f16d1070 None admin] PATH_INFO: `/v3/users/747f9f4f189e41a1b9c946b5ff8ada1c` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:36.661409 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4956d4a4-6a43-4353-b0cb-5329f16d1070 None admin] RBAC: Authorizing `identity:get_user(user_id=747f9f4f189e41a1b9c946b5ff8ada1c)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:12:36.662858 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4956d4a4-6a43-4353-b0cb-5329f16d1070 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:12:36.664403 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 570/1158] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Sep 20 22:12:36 2022] GET /identity/v3/users/747f9f4f189e41a1b9c946b5ff8ada1c => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:12:36.670122 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ba017a-7ea7-4804-840a-a74776ed8c9a None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:12:36.694941 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:12:36.766267 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ba017a-7ea7-4804-840a-a74776ed8c9a None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:12:36.799076 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad50a1ca-d04d-4325-a158-4535b3d4c23d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:12:36.799704 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad50a1ca-d04d-4325-a158-4535b3d4c23d None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:36.799980 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad50a1ca-d04d-4325-a158-4535b3d4c23d None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:36.800248 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad50a1ca-d04d-4325-a158-4535b3d4c23d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:36.864058 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad50a1ca-d04d-4325-a158-4535b3d4c23d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:12:36.865477 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad50a1ca-d04d-4325-a158-4535b3d4c23d None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:12:36.888017 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:12:36.960372 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 589/1159] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 20 22:12:36 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 20 22:12:36.966376 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4956d4a4-6a43-4353-b0cb-5329f16d1070 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:12:37.063892 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4956d4a4-6a43-4353-b0cb-5329f16d1070 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:12:37.098919 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1f5980-bacc-43b1-8cb8-7a88ffa4e06f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:12:37.099540 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1f5980-bacc-43b1-8cb8-7a88ffa4e06f None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:37.099820 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1f5980-bacc-43b1-8cb8-7a88ffa4e06f None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:37.100091 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1f5980-bacc-43b1-8cb8-7a88ffa4e06f None admin] PATH_INFO: `/v3/projects/03de1ab9a2084291b60d0cb31caed054` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:37.101232 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1f5980-bacc-43b1-8cb8-7a88ffa4e06f None admin] RBAC: Authorizing `identity:get_project(project_id=03de1ab9a2084291b60d0cb31caed054)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:12:37.102679 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1f5980-bacc-43b1-8cb8-7a88ffa4e06f None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:12:37.104301 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 571/1160] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Sep 20 22:12:36 2022] GET /identity/v3/projects/03de1ab9a2084291b60d0cb31caed054 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:12:37.110638 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad50a1ca-d04d-4325-a158-4535b3d4c23d None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:12:37.204832 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad50a1ca-d04d-4325-a158-4535b3d4c23d None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:12:37.227275 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:12:37.238569 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265be499-f736-4b94-afcb-e59d4fb223af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:12:37.239161 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265be499-f736-4b94-afcb-e59d4fb223af None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:37.239434 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265be499-f736-4b94-afcb-e59d4fb223af None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:37.239700 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265be499-f736-4b94-afcb-e59d4fb223af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:37.240405 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265be499-f736-4b94-afcb-e59d4fb223af None admin] RBAC: Adding query filter params (role.id=8a829170b29d42d6af589399e51edb0f, scope.project.id=03de1ab9a2084291b60d0cb31caed054, user.id=747f9f4f189e41a1b9c946b5ff8ada1c) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:12:37.240706 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265be499-f736-4b94-afcb-e59d4fb223af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:12:37.242098 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265be499-f736-4b94-afcb-e59d4fb223af None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:12:37.247594 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 590/1161] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Sep 20 22:12:37 2022] GET /identity/v3/role_assignments?user.id=747f9f4f189e41a1b9c946b5ff8ada1c&scope.project.id=03de1ab9a2084291b60d0cb31caed054&role.id=8a829170b29d42d6af589399e51edb0f => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:12:39.379654 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a7d6ad-5953-498a-91e4-51bbfd3e7755 None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:39.380157 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a7d6ad-5953-498a-91e4-51bbfd3e7755 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:39.380256 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a7d6ad-5953-498a-91e4-51bbfd3e7755 None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:39.381516 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 572/1162] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:12:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:12:39.386771 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1179b03-b205-4bb9-aa8e-e692562ec23e None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:39.387176 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1179b03-b205-4bb9-aa8e-e692562ec23e None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:39.387318 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1179b03-b205-4bb9-aa8e-e692562ec23e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:39.404893 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-c1179b03-b205-4bb9-aa8e-e692562ec23e None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:12:39.406055 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-c1179b03-b205-4bb9-aa8e-e692562ec23e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:12:39.469545 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 591/1163] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:12:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 20 22:12:39.730314 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a7d6ad-5953-498a-91e4-51bbfd3e7755 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:12:39.733220 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:12:39.829175 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a7d6ad-5953-498a-91e4-51bbfd3e7755 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:12:39.862772 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94521af-b86f-40d6-a6d8-42fbc5c75a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:12:39.863364 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94521af-b86f-40d6-a6d8-42fbc5c75a13 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:39.863641 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94521af-b86f-40d6-a6d8-42fbc5c75a13 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:39.863914 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94521af-b86f-40d6-a6d8-42fbc5c75a13 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:39.928664 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94521af-b86f-40d6-a6d8-42fbc5c75a13 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:12:39.930097 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94521af-b86f-40d6-a6d8-42fbc5c75a13 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:12:39.931921 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:12:40.027379 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 573/1164] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 20 22:12:39 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 20 22:12:40.033211 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1179b03-b205-4bb9-aa8e-e692562ec23e None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:12:40.127036 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1179b03-b205-4bb9-aa8e-e692562ec23e None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:12:40.144475 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:12:40.160921 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc90767f-e4fc-4f27-acbd-7758c0f707aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:12:40.161538 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc90767f-e4fc-4f27-acbd-7758c0f707aa None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:40.161813 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc90767f-e4fc-4f27-acbd-7758c0f707aa None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:40.162081 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc90767f-e4fc-4f27-acbd-7758c0f707aa None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:40.168412 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc90767f-e4fc-4f27-acbd-7758c0f707aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:12:40.169826 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc90767f-e4fc-4f27-acbd-7758c0f707aa None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:12:40.181791 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-cc90767f-e4fc-4f27-acbd-7758c0f707aa None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 20 22:12:40.181791 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:12:40.181791 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 20 22:12:40.181791 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 20 22:12:40.181791 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 20 22:12:40.181791 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 20 22:12:40.181791 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 20 22:12:40.181791 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 20 22:12:40.181791 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 20 22:12:40.181791 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:12:40.181791 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 20 22:12:40.181791 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:12:40.181791 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:12:40.181791 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:12:40.181791 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:12:40.181791 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:12:40.181791 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:12:40.183103 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:12:40.183103 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:12:40.183103 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:12:40.183103 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:12:40.183103 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:12:40.183103 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:12:40.183103 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 22:12:40.183103 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 22:12:40.183103 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 22:12:40.183103 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 22:12:40.183103 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:12:40.183103 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:12:40.183103 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:12:40.183103 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:12:40.183103 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:12:40.183103 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:12:40.184142 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:12:40.184142 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:12:40.184142 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:12:40.184142 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:12:40.184142 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:12:40.184142 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:12:40.184142 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:12:40.184142 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:12:40.184142 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:12:40.184142 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:12:40.184142 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 20 22:12:40.184142 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 22:12:40.184142 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 20 22:12:40.184142 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:12:40.184142 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 592/1165] 10.222.0.33 () {56 vars in 1117 bytes} [Tue Sep 20 22:12:40 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:12:40.188775 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94521af-b86f-40d6-a6d8-42fbc5c75a13 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:12:40.284326 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94521af-b86f-40d6-a6d8-42fbc5c75a13 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:12:40.285746 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:12:40.320183 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293995e9-990e-487b-aae1-87f9ca8f5c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:12:40.320787 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293995e9-990e-487b-aae1-87f9ca8f5c5f None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:40.321066 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293995e9-990e-487b-aae1-87f9ca8f5c5f None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:40.321337 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293995e9-990e-487b-aae1-87f9ca8f5c5f None admin] PATH_INFO: `/v3/domains` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:40.321973 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293995e9-990e-487b-aae1-87f9ca8f5c5f None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:12:40.322273 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293995e9-990e-487b-aae1-87f9ca8f5c5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:12:40.323682 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293995e9-990e-487b-aae1-87f9ca8f5c5f None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:12:40.330784 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 574/1166] 10.222.0.33 () {56 vars in 1115 bytes} [Tue Sep 20 22:12:40 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:12:42.428317 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a93c48-49d8-43dd-ab7b-ee30a8a444af None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:42.428856 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a93c48-49d8-43dd-ab7b-ee30a8a444af None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:42.428856 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a93c48-49d8-43dd-ab7b-ee30a8a444af None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:42.430185 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 593/1167] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:12:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:12:42.435278 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c14a42-353c-40cb-b1a7-1d45e58503bc None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:42.435704 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c14a42-353c-40cb-b1a7-1d45e58503bc None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:42.435833 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c14a42-353c-40cb-b1a7-1d45e58503bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:42.454108 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-d1c14a42-353c-40cb-b1a7-1d45e58503bc None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:12:42.456041 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-d1c14a42-353c-40cb-b1a7-1d45e58503bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:12:42.520303 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 575/1168] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:12:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 20 22:12:42.785209 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a93c48-49d8-43dd-ab7b-ee30a8a444af None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:12:42.886174 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a93c48-49d8-43dd-ab7b-ee30a8a444af None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:12:42.918829 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fe4da3-6703-47aa-9d7c-e3d80dd6ccff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:12:42.919423 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fe4da3-6703-47aa-9d7c-e3d80dd6ccff None admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:42.919702 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fe4da3-6703-47aa-9d7c-e3d80dd6ccff None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:42.919974 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fe4da3-6703-47aa-9d7c-e3d80dd6ccff None admin] PATH_INFO: `/v3/domains` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:42.920634 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fe4da3-6703-47aa-9d7c-e3d80dd6ccff None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:12:42.921984 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fe4da3-6703-47aa-9d7c-e3d80dd6ccff None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:12:42.938469 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 594/1169] 10.222.0.33 () {60 vars in 1138 bytes} [Tue Sep 20 22:12:42 2022] POST /identity/v3/domains => generated 267 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:12:45.081202 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f683d72f-f5d4-43f0-9726-0174263f2256 None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:45.081745 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f683d72f-f5d4-43f0-9726-0174263f2256 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:45.081745 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f683d72f-f5d4-43f0-9726-0174263f2256 None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:45.083098 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 576/1170] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:12:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:12:45.088468 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a16db9-13e2-43b5-a65b-7cbc850e1161 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:45.088882 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a16db9-13e2-43b5-a65b-7cbc850e1161 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:45.089007 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a16db9-13e2-43b5-a65b-7cbc850e1161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:45.106578 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-e3a16db9-13e2-43b5-a65b-7cbc850e1161 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:12:45.107742 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-e3a16db9-13e2-43b5-a65b-7cbc850e1161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:12:45.136509 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:12:45.175338 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 595/1171] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:12:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 20 22:12:45.443466 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f683d72f-f5d4-43f0-9726-0174263f2256 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:12:45.535564 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:12:45.542728 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f683d72f-f5d4-43f0-9726-0174263f2256 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:12:45.574947 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb931035-1842-4c01-8165-750550eabb9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:12:45.575555 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb931035-1842-4c01-8165-750550eabb9d None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:45.575829 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb931035-1842-4c01-8165-750550eabb9d None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:45.576095 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb931035-1842-4c01-8165-750550eabb9d None admin] PATH_INFO: `/v3/domains/5f1625c5e03e4a8eb0088e6650d35f10` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:45.586521 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb931035-1842-4c01-8165-750550eabb9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=5f1625c5e03e4a8eb0088e6650d35f10)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:12:45.587955 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb931035-1842-4c01-8165-750550eabb9d None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:12:45.589487 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 577/1172] 10.222.0.33 () {56 vars in 1183 bytes} [Tue Sep 20 22:12:45 2022] GET /identity/v3/domains/5f1625c5e03e4a8eb0088e6650d35f10 => generated 267 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:12:45.595162 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a16db9-13e2-43b5-a65b-7cbc850e1161 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:12:45.689824 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a16db9-13e2-43b5-a65b-7cbc850e1161 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:12:45.722773 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f293ba-2b39-4329-9766-637b788f160a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:12:45.723309 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f293ba-2b39-4329-9766-637b788f160a None admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:45.723590 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f293ba-2b39-4329-9766-637b788f160a None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:45.723860 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f293ba-2b39-4329-9766-637b788f160a None admin] PATH_INFO: `/v3/projects` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:45.724513 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f293ba-2b39-4329-9766-637b788f160a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:12:45.725922 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f293ba-2b39-4329-9766-637b788f160a None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:12:45.751098 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 596/1173] 10.222.0.33 () {60 vars in 1141 bytes} [Tue Sep 20 22:12:45 2022] POST /identity/v3/projects => generated 361 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 20 22:12:47.894150 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bee768-3f2a-4388-93ad-8260c5c950fc None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:47.894730 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bee768-3f2a-4388-93ad-8260c5c950fc None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:47.894730 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bee768-3f2a-4388-93ad-8260c5c950fc None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:47.896047 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 578/1174] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:12:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:12:47.901367 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503f327b-1ea0-48ff-99a2-1c55458b1fde None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:47.901796 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503f327b-1ea0-48ff-99a2-1c55458b1fde None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:47.901898 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503f327b-1ea0-48ff-99a2-1c55458b1fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:47.919848 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-503f327b-1ea0-48ff-99a2-1c55458b1fde None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:12:47.921021 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-503f327b-1ea0-48ff-99a2-1c55458b1fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:12:47.935254 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:12:47.985699 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 597/1175] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:12:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 20 22:12:48.253389 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bee768-3f2a-4388-93ad-8260c5c950fc None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:12:48.355492 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bee768-3f2a-4388-93ad-8260c5c950fc None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:12:48.387615 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b322e2c-4264-4c51-8e5a-0ffffac2b8cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:12:48.388237 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b322e2c-4264-4c51-8e5a-0ffffac2b8cc None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:48.388512 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b322e2c-4264-4c51-8e5a-0ffffac2b8cc None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:48.388779 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b322e2c-4264-4c51-8e5a-0ffffac2b8cc None admin] PATH_INFO: `/v3/domains/5f1625c5e03e4a8eb0088e6650d35f10` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:48.389867 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b322e2c-4264-4c51-8e5a-0ffffac2b8cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=5f1625c5e03e4a8eb0088e6650d35f10)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:12:48.391308 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b322e2c-4264-4c51-8e5a-0ffffac2b8cc None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:12:48.392880 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 579/1176] 10.222.0.33 () {56 vars in 1183 bytes} [Tue Sep 20 22:12:48 2022] GET /identity/v3/domains/5f1625c5e03e4a8eb0088e6650d35f10 => generated 267 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:12:48.398665 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503f327b-1ea0-48ff-99a2-1c55458b1fde None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:12:48.492802 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503f327b-1ea0-48ff-99a2-1c55458b1fde None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:12:48.525408 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5086b1ed-1ce0-4400-af57-8113ca0f47f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:12:48.525942 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5086b1ed-1ce0-4400-af57-8113ca0f47f8 None admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:48.526221 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5086b1ed-1ce0-4400-af57-8113ca0f47f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:48.526493 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5086b1ed-1ce0-4400-af57-8113ca0f47f8 None admin] PATH_INFO: `/v3/users` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:48.527149 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5086b1ed-1ce0-4400-af57-8113ca0f47f8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:12:48.528547 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5086b1ed-1ce0-4400-af57-8113ca0f47f8 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:12:48.548393 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 598/1177] 10.222.0.33 () {60 vars in 1132 bytes} [Tue Sep 20 22:12:48 2022] POST /identity/v3/users => generated 311 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:12:50.710160 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb88ae6-61c9-4f73-b8ce-67a63820a7c9 None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:50.710736 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb88ae6-61c9-4f73-b8ce-67a63820a7c9 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:50.710736 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb88ae6-61c9-4f73-b8ce-67a63820a7c9 None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:50.712086 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 580/1178] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:12:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:12:50.717340 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de189d41-c00a-4ff0-8579-b8fb18fe2381 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:50.717754 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de189d41-c00a-4ff0-8579-b8fb18fe2381 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:50.717896 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de189d41-c00a-4ff0-8579-b8fb18fe2381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:50.730496 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:12:50.736130 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-de189d41-c00a-4ff0-8579-b8fb18fe2381 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:12:50.737534 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-de189d41-c00a-4ff0-8579-b8fb18fe2381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:12:50.801622 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 599/1179] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:12:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 20 22:12:51.072567 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb88ae6-61c9-4f73-b8ce-67a63820a7c9 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:12:51.098042 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:12:51.173719 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb88ae6-61c9-4f73-b8ce-67a63820a7c9 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:12:51.208776 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d9565c-8cba-4685-9325-f9ef6ed86ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:12:51.209397 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d9565c-8cba-4685-9325-f9ef6ed86ba7 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:51.209674 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d9565c-8cba-4685-9325-f9ef6ed86ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:51.209941 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d9565c-8cba-4685-9325-f9ef6ed86ba7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:51.219868 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d9565c-8cba-4685-9325-f9ef6ed86ba7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 22:12:51.224588 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-e7d9565c-8cba-4685-9325-f9ef6ed86ba7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 22:12:51.224588 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:12:51.224588 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:12:51.224588 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:12:51.224588 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:12:51.224588 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:12:51.224588 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:12:51.224588 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:12:51.224588 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:12:51.224588 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:12:51.224588 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:12:51.224588 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:12:51.224588 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 22:12:51.224588 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 22:12:51.224588 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 22:12:51.224588 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 22:12:51.225689 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 22:12:51.225689 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 22:12:51.225689 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 22:12:51.225689 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 22:12:51.225689 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:12:51.225689 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:12:51.225689 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:12:51.225689 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:12:51.225689 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:12:51.225689 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:12:51.225689 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:12:51.225689 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:12:51.225689 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:12:51.225689 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:12:51.225689 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:12:51.225689 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:12:51.226576 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:12:51.226576 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:12:51.226576 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:12:51.226576 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:12:51.226576 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 22:12:51.226576 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 22:12:51.226576 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 22:12:51.226576 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 22:12:51.226576 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 22:12:51.226576 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 22:12:51.226576 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 22:12:51.226576 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:12:51.226576 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 581/1180] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Sep 20 22:12:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:12:51.231722 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de189d41-c00a-4ff0-8579-b8fb18fe2381 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:12:51.332841 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de189d41-c00a-4ff0-8579-b8fb18fe2381 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:12:51.364615 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c8d921-03a4-4dbe-b2f0-203c381367f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:12:51.365215 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c8d921-03a4-4dbe-b2f0-203c381367f8 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:51.365494 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c8d921-03a4-4dbe-b2f0-203c381367f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:51.365767 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c8d921-03a4-4dbe-b2f0-203c381367f8 None admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:51.366422 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c8d921-03a4-4dbe-b2f0-203c381367f8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:12:51.366752 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c8d921-03a4-4dbe-b2f0-203c381367f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:12:51.368110 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c8d921-03a4-4dbe-b2f0-203c381367f8 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:12:51.370205 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:12:51.377562 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 600/1181] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 20 22:12:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:12:51.383591 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d9565c-8cba-4685-9325-f9ef6ed86ba7 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:12:51.465414 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:12:51.480520 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d9565c-8cba-4685-9325-f9ef6ed86ba7 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:12:51.513188 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0f12de-33eb-47db-bd9c-78747a4d9817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:12:51.513803 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f12de-33eb-47db-bd9c-78747a4d9817 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:51.514082 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f12de-33eb-47db-bd9c-78747a4d9817 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:51.514354 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f12de-33eb-47db-bd9c-78747a4d9817 None admin] PATH_INFO: `/v3/users/f7184e4fcf8b4722ade2795b2ce09d00` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:51.527427 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0f12de-33eb-47db-bd9c-78747a4d9817 None admin] RBAC: Authorizing `identity:get_user(user_id=f7184e4fcf8b4722ade2795b2ce09d00)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:12:51.528851 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0f12de-33eb-47db-bd9c-78747a4d9817 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:12:51.530414 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 582/1182] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Sep 20 22:12:51 2022] GET /identity/v3/users/f7184e4fcf8b4722ade2795b2ce09d00 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:12:51.536088 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c8d921-03a4-4dbe-b2f0-203c381367f8 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:12:51.632887 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c8d921-03a4-4dbe-b2f0-203c381367f8 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:12:51.664465 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02d952c-68d5-44f2-9f85-b30a8a98928c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:12:51.665054 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d952c-68d5-44f2-9f85-b30a8a98928c None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:51.665340 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d952c-68d5-44f2-9f85-b30a8a98928c None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:51.665614 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d952c-68d5-44f2-9f85-b30a8a98928c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:51.726970 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:12:51.731041 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02d952c-68d5-44f2-9f85-b30a8a98928c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:12:51.732471 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02d952c-68d5-44f2-9f85-b30a8a98928c None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:12:51.826876 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 601/1183] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 20 22:12:51 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 20 22:12:51.832744 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0f12de-33eb-47db-bd9c-78747a4d9817 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:12:51.929531 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0f12de-33eb-47db-bd9c-78747a4d9817 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:12:51.962857 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ee4bb9-6547-44f3-adee-e7f410254658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:12:51.963475 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ee4bb9-6547-44f3-adee-e7f410254658 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:51.963751 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ee4bb9-6547-44f3-adee-e7f410254658 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:51.964018 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ee4bb9-6547-44f3-adee-e7f410254658 None admin] PATH_INFO: `/v3/projects/dec2faf8eba04931bf9b1ce8015acd9a` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:51.965113 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ee4bb9-6547-44f3-adee-e7f410254658 None admin] RBAC: Authorizing `identity:get_project(project_id=dec2faf8eba04931bf9b1ce8015acd9a)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:12:51.966546 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ee4bb9-6547-44f3-adee-e7f410254658 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:12:51.968168 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 583/1184] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Sep 20 22:12:51 2022] GET /identity/v3/projects/dec2faf8eba04931bf9b1ce8015acd9a => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:12:51.974707 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02d952c-68d5-44f2-9f85-b30a8a98928c None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:12:52.066358 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:12:52.070297 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02d952c-68d5-44f2-9f85-b30a8a98928c None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:12:52.103328 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa1f933-df0f-482c-986d-e8414d90683b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:12:52.103918 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa1f933-df0f-482c-986d-e8414d90683b None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:52.104194 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa1f933-df0f-482c-986d-e8414d90683b None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:52.104462 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa1f933-df0f-482c-986d-e8414d90683b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:52.105171 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa1f933-df0f-482c-986d-e8414d90683b None admin] RBAC: Adding query filter params (role.id=8a829170b29d42d6af589399e51edb0f, scope.project.id=dec2faf8eba04931bf9b1ce8015acd9a, user.id=f7184e4fcf8b4722ade2795b2ce09d00) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:12:52.105476 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa1f933-df0f-482c-986d-e8414d90683b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:12:52.106904 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa1f933-df0f-482c-986d-e8414d90683b None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:12:52.112662 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 602/1185] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Sep 20 22:12:51 2022] GET /identity/v3/role_assignments?user.id=f7184e4fcf8b4722ade2795b2ce09d00&scope.project.id=dec2faf8eba04931bf9b1ce8015acd9a&role.id=8a829170b29d42d6af589399e51edb0f => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:12:54.214797 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2095ae0-c3ce-4a6a-9c62-849377016fe3 None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:54.215353 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2095ae0-c3ce-4a6a-9c62-849377016fe3 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:54.215353 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2095ae0-c3ce-4a6a-9c62-849377016fe3 None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:54.216681 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 584/1186] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:12:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:12:54.222270 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c776ae04-3543-4a83-9000-384e3837461d None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:54.222717 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c776ae04-3543-4a83-9000-384e3837461d None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:54.222842 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c776ae04-3543-4a83-9000-384e3837461d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:54.241809 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-c776ae04-3543-4a83-9000-384e3837461d None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:12:54.243039 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-c776ae04-3543-4a83-9000-384e3837461d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:12:54.310340 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 603/1187] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:12:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 20 22:12:54.577012 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2095ae0-c3ce-4a6a-9c62-849377016fe3 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:12:54.589726 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:12:54.675397 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2095ae0-c3ce-4a6a-9c62-849377016fe3 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:12:54.707952 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cd308a-3a67-429f-864c-795075d0c660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:12:54.708556 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cd308a-3a67-429f-864c-795075d0c660 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:54.708830 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cd308a-3a67-429f-864c-795075d0c660 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:54.709096 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cd308a-3a67-429f-864c-795075d0c660 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:54.718768 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cd308a-3a67-429f-864c-795075d0c660 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 22:12:54.724003 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-07cd308a-3a67-429f-864c-795075d0c660 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 22:12:54.724003 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:12:54.724003 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:12:54.724003 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:12:54.724003 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:12:54.724003 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:12:54.724003 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:12:54.724003 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:12:54.724003 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:12:54.724003 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:12:54.724003 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:12:54.724003 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:12:54.724003 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 22:12:54.724003 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 22:12:54.724003 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 22:12:54.724003 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 22:12:54.725089 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 22:12:54.725089 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 22:12:54.725089 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 22:12:54.725089 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 22:12:54.725089 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:12:54.725089 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:12:54.725089 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:12:54.725089 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:12:54.725089 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:12:54.725089 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:12:54.725089 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:12:54.725089 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:12:54.725089 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:12:54.725089 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:12:54.725089 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:12:54.725089 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:12:54.725953 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:12:54.725953 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:12:54.725953 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:12:54.725953 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:12:54.725953 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 22:12:54.725953 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 22:12:54.725953 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 22:12:54.725953 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 22:12:54.725953 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 22:12:54.725953 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 22:12:54.725953 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 22:12:54.725953 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:12:54.725953 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 585/1188] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Sep 20 22:12:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:12:54.731075 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c776ae04-3543-4a83-9000-384e3837461d None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:12:54.818752 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:12:54.827759 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c776ae04-3543-4a83-9000-384e3837461d None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:12:54.859716 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f36cdf-97fc-4b0e-9cd9-e28628f269c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:12:54.860307 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f36cdf-97fc-4b0e-9cd9-e28628f269c7 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:54.860585 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f36cdf-97fc-4b0e-9cd9-e28628f269c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:54.861384 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f36cdf-97fc-4b0e-9cd9-e28628f269c7 None admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:54.862033 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f36cdf-97fc-4b0e-9cd9-e28628f269c7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:12:54.862332 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f36cdf-97fc-4b0e-9cd9-e28628f269c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:12:54.863704 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f36cdf-97fc-4b0e-9cd9-e28628f269c7 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:12:54.871397 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 604/1189] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 20 22:12:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:12:54.877781 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cd308a-3a67-429f-864c-795075d0c660 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:12:54.945286 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:12:54.976312 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cd308a-3a67-429f-864c-795075d0c660 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:12:55.009188 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6608852-89c7-41d6-9a41-8f97f6e45a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:12:55.009798 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6608852-89c7-41d6-9a41-8f97f6e45a7f None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:55.010074 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6608852-89c7-41d6-9a41-8f97f6e45a7f None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:55.010342 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6608852-89c7-41d6-9a41-8f97f6e45a7f None admin] PATH_INFO: `/v3/users/f7184e4fcf8b4722ade2795b2ce09d00` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:55.011465 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6608852-89c7-41d6-9a41-8f97f6e45a7f None admin] RBAC: Authorizing `identity:get_user(user_id=f7184e4fcf8b4722ade2795b2ce09d00)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:12:55.012884 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6608852-89c7-41d6-9a41-8f97f6e45a7f None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:12:55.014464 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 586/1190] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Sep 20 22:12:54 2022] GET /identity/v3/users/f7184e4fcf8b4722ade2795b2ce09d00 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 22:12:55.020085 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f36cdf-97fc-4b0e-9cd9-e28628f269c7 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:12:55.117219 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f36cdf-97fc-4b0e-9cd9-e28628f269c7 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:12:55.148819 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dee679-e2b6-4358-b144-9286f6bb7253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:12:55.149427 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dee679-e2b6-4358-b144-9286f6bb7253 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:55.149706 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dee679-e2b6-4358-b144-9286f6bb7253 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:55.149978 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dee679-e2b6-4358-b144-9286f6bb7253 None admin] PATH_INFO: `/v3/projects/dec2faf8eba04931bf9b1ce8015acd9a` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:55.151100 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dee679-e2b6-4358-b144-9286f6bb7253 None admin] RBAC: Authorizing `identity:get_project(project_id=dec2faf8eba04931bf9b1ce8015acd9a)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:12:55.152511 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dee679-e2b6-4358-b144-9286f6bb7253 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:12:55.154102 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 605/1191] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Sep 20 22:12:55 2022] GET /identity/v3/projects/dec2faf8eba04931bf9b1ce8015acd9a => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 22:12:55.160350 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6608852-89c7-41d6-9a41-8f97f6e45a7f None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:12:55.258098 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6608852-89c7-41d6-9a41-8f97f6e45a7f None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:12:55.291902 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d19478f-7e80-4cd8-970b-4ff122a18fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:12:55.292569 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d19478f-7e80-4cd8-970b-4ff122a18fcb None admin] REQUEST_METHOD: `PUT` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:55.292846 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d19478f-7e80-4cd8-970b-4ff122a18fcb None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:55.293118 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d19478f-7e80-4cd8-970b-4ff122a18fcb None admin] PATH_INFO: `/v3/projects/dec2faf8eba04931bf9b1ce8015acd9a/users/f7184e4fcf8b4722ade2795b2ce09d00/roles/8a829170b29d42d6af589399e51edb0f` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:55.295070 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d19478f-7e80-4cd8-970b-4ff122a18fcb None admin] RBAC: Authorizing `identity:create_grant(project_id=dec2faf8eba04931bf9b1ce8015acd9a, user_id=f7184e4fcf8b4722ade2795b2ce09d00, role_id=8a829170b29d42d6af589399e51edb0f)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:12:55.296518 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d19478f-7e80-4cd8-970b-4ff122a18fcb None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:12:55.304840 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:12:55.311521 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 587/1192] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Sep 20 22:12:55 2022] PUT /identity/v3/projects/dec2faf8eba04931bf9b1ce8015acd9a/users/f7184e4fcf8b4722ade2795b2ce09d00/roles/8a829170b29d42d6af589399e51edb0f => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 22:12:57.407324 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7dd900-4bc2-49c8-a565-6bc437b920a0 None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:57.408376 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7dd900-4bc2-49c8-a565-6bc437b920a0 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:57.408477 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7dd900-4bc2-49c8-a565-6bc437b920a0 None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:57.409813 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 606/1193] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:12:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:12:57.414907 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcca274-445f-4d9d-aef2-68a58d5cf758 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:57.415381 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcca274-445f-4d9d-aef2-68a58d5cf758 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:57.415482 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcca274-445f-4d9d-aef2-68a58d5cf758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:57.434373 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-abcca274-445f-4d9d-aef2-68a58d5cf758 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:12:57.435575 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-abcca274-445f-4d9d-aef2-68a58d5cf758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:12:57.508839 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 588/1194] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:12:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 20 22:12:57.775646 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7dd900-4bc2-49c8-a565-6bc437b920a0 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:12:57.800211 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:12:57.874305 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7dd900-4bc2-49c8-a565-6bc437b920a0 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:12:57.906042 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d3efe0-d899-4315-9716-687444f74a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:12:57.906682 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d3efe0-d899-4315-9716-687444f74a0b None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:57.906963 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d3efe0-d899-4315-9716-687444f74a0b None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:57.907233 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d3efe0-d899-4315-9716-687444f74a0b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:57.917868 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d3efe0-d899-4315-9716-687444f74a0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 22:12:57.922606 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-46d3efe0-d899-4315-9716-687444f74a0b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 22:12:57.922606 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:12:57.922606 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:12:57.922606 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:12:57.922606 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:12:57.922606 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:12:57.922606 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:12:57.922606 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:12:57.922606 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:12:57.922606 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:12:57.922606 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:12:57.922606 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:12:57.922606 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 22:12:57.922606 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 22:12:57.922606 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 22:12:57.922606 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 22:12:57.923748 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 22:12:57.923748 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 22:12:57.923748 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 22:12:57.923748 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 22:12:57.923748 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:12:57.923748 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:12:57.923748 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:12:57.923748 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:12:57.923748 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:12:57.923748 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:12:57.923748 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:12:57.923748 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:12:57.923748 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:12:57.923748 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:12:57.923748 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:12:57.923748 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:12:57.924601 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:12:57.924601 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:12:57.924601 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:12:57.924601 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:12:57.924601 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 22:12:57.924601 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 22:12:57.924601 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 22:12:57.924601 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 22:12:57.924601 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 22:12:57.924601 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 22:12:57.924601 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 22:12:57.924601 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:12:57.924601 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 607/1195] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Sep 20 22:12:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:12:57.929783 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcca274-445f-4d9d-aef2-68a58d5cf758 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:12:58.025551 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcca274-445f-4d9d-aef2-68a58d5cf758 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:12:58.050466 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:12:58.058925 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4561d82a-ad54-4349-a09e-c4dddc92872b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:12:58.059533 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4561d82a-ad54-4349-a09e-c4dddc92872b None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:58.059813 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4561d82a-ad54-4349-a09e-c4dddc92872b None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:58.060082 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4561d82a-ad54-4349-a09e-c4dddc92872b None admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:58.060742 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4561d82a-ad54-4349-a09e-c4dddc92872b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:12:58.061043 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4561d82a-ad54-4349-a09e-c4dddc92872b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:12:58.062404 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4561d82a-ad54-4349-a09e-c4dddc92872b None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:12:58.071130 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 589/1196] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 20 22:12:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:12:58.076868 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d3efe0-d899-4315-9716-687444f74a0b None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:12:58.155296 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:12:58.172741 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d3efe0-d899-4315-9716-687444f74a0b None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:12:58.205404 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7de31a-d0f8-4f72-aade-80657e07c161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:12:58.206015 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7de31a-d0f8-4f72-aade-80657e07c161 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:58.206295 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7de31a-d0f8-4f72-aade-80657e07c161 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:58.206595 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7de31a-d0f8-4f72-aade-80657e07c161 None admin] PATH_INFO: `/v3/users/f7184e4fcf8b4722ade2795b2ce09d00` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:58.207695 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7de31a-d0f8-4f72-aade-80657e07c161 None admin] RBAC: Authorizing `identity:get_user(user_id=f7184e4fcf8b4722ade2795b2ce09d00)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:12:58.209101 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7de31a-d0f8-4f72-aade-80657e07c161 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:12:58.210648 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 608/1197] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Sep 20 22:12:58 2022] GET /identity/v3/users/f7184e4fcf8b4722ade2795b2ce09d00 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:12:58.216236 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4561d82a-ad54-4349-a09e-c4dddc92872b None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:12:58.312992 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4561d82a-ad54-4349-a09e-c4dddc92872b None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:12:58.345268 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcdfd2f-1465-4310-a1bb-b09e3bfe886e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:12:58.345862 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcdfd2f-1465-4310-a1bb-b09e3bfe886e None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:58.346141 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcdfd2f-1465-4310-a1bb-b09e3bfe886e None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:58.346412 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcdfd2f-1465-4310-a1bb-b09e3bfe886e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:58.401088 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:12:58.411616 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcdfd2f-1465-4310-a1bb-b09e3bfe886e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:12:58.413051 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcdfd2f-1465-4310-a1bb-b09e3bfe886e None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:12:58.511819 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 590/1198] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 20 22:12:58 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 20 22:12:58.517915 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7de31a-d0f8-4f72-aade-80657e07c161 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:12:58.614179 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7de31a-d0f8-4f72-aade-80657e07c161 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:12:58.646264 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6269cc9-0a1b-4f3a-96f8-1c7d140232e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:12:58.646903 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6269cc9-0a1b-4f3a-96f8-1c7d140232e8 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:58.647181 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6269cc9-0a1b-4f3a-96f8-1c7d140232e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:58.647453 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6269cc9-0a1b-4f3a-96f8-1c7d140232e8 None admin] PATH_INFO: `/v3/projects/dec2faf8eba04931bf9b1ce8015acd9a` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:58.648551 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6269cc9-0a1b-4f3a-96f8-1c7d140232e8 None admin] RBAC: Authorizing `identity:get_project(project_id=dec2faf8eba04931bf9b1ce8015acd9a)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:12:58.649961 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6269cc9-0a1b-4f3a-96f8-1c7d140232e8 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:12:58.651576 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 609/1199] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Sep 20 22:12:58 2022] GET /identity/v3/projects/dec2faf8eba04931bf9b1ce8015acd9a => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:12:58.658055 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcdfd2f-1465-4310-a1bb-b09e3bfe886e None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:12:58.744484 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:12:58.754382 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcdfd2f-1465-4310-a1bb-b09e3bfe886e None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:12:58.787146 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a106335-e60e-44e3-9590-c89ffcc83646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:12:58.787737 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a106335-e60e-44e3-9590-c89ffcc83646 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:12:58.788017 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a106335-e60e-44e3-9590-c89ffcc83646 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:12:58.788286 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a106335-e60e-44e3-9590-c89ffcc83646 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:12:58.788992 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a106335-e60e-44e3-9590-c89ffcc83646 None admin] RBAC: Adding query filter params (role.id=8a829170b29d42d6af589399e51edb0f, scope.project.id=dec2faf8eba04931bf9b1ce8015acd9a, user.id=f7184e4fcf8b4722ade2795b2ce09d00) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:12:58.789295 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a106335-e60e-44e3-9590-c89ffcc83646 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:12:58.790723 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a106335-e60e-44e3-9590-c89ffcc83646 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:12:58.796278 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 591/1200] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Sep 20 22:12:58 2022] GET /identity/v3/role_assignments?user.id=f7184e4fcf8b4722ade2795b2ce09d00&scope.project.id=dec2faf8eba04931bf9b1ce8015acd9a&role.id=8a829170b29d42d6af589399e51edb0f => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:13:08.642332 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=91 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:13:08.793763 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=23 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:13:54.383011 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d872fb53-ab0e-4c03-84d8-29907ca87c2a None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:13:54.383587 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d872fb53-ab0e-4c03-84d8-29907ca87c2a None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:13:54.385520 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d872fb53-ab0e-4c03-84d8-29907ca87c2a None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:13:54.385520 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 610/1201] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:13:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:13:54.391936 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafc9e7c-298c-4068-8bc9-470766353f6a None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:13:54.392550 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafc9e7c-298c-4068-8bc9-470766353f6a None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:13:54.392550 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafc9e7c-298c-4068-8bc9-470766353f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:13:54.412603 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-eafc9e7c-298c-4068-8bc9-470766353f6a None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:13:54.413966 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-eafc9e7c-298c-4068-8bc9-470766353f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:13:54.518956 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 592/1202] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:13:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 20 22:13:54.814668 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d872fb53-ab0e-4c03-84d8-29907ca87c2a None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:13:54.927740 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d872fb53-ab0e-4c03-84d8-29907ca87c2a None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:13:54.965423 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d6c46f-566c-410c-aac2-e1c0be6ccff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:13:54.967226 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d6c46f-566c-410c-aac2-e1c0be6ccff6 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:13:54.967226 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d6c46f-566c-410c-aac2-e1c0be6ccff6 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:13:54.967226 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d6c46f-566c-410c-aac2-e1c0be6ccff6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:13:54.984592 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d6c46f-566c-410c-aac2-e1c0be6ccff6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:13:54.986101 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d6c46f-566c-410c-aac2-e1c0be6ccff6 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:13:55.002800 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-b3d6c46f-566c-410c-aac2-e1c0be6ccff6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:13:55.002800 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:13:55.002800 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:13:55.002800 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:13:55.002800 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:13:55.002800 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:13:55.002800 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:13:55.002800 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:13:55.002800 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:13:55.002800 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:13:55.002800 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:13:55.002800 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:13:55.002800 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 22:13:55.002800 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 22:13:55.002800 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 22:13:55.002800 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 22:13:55.003923 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:13:55.003923 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:13:55.003923 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:13:55.003923 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:13:55.003923 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:13:55.003923 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:13:55.003923 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:13:55.003923 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:13:55.003923 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:13:55.003923 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:13:55.003923 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:13:55.003923 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:13:55.003923 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:13:55.003923 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:13:55.003923 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:13:55.003923 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:13:55.003923 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 22:13:55.004920 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 22:13:55.004920 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:13:55.004920 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:13:55.010557 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 611/1203] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 20 22:13:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:13:55.010717 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafc9e7c-298c-4068-8bc9-470766353f6a None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:13:55.144411 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafc9e7c-298c-4068-8bc9-470766353f6a None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:13:55.187832 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:13:55.194824 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e951c97e-4e6d-444a-9f17-0574296eeda2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:13:55.195766 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e951c97e-4e6d-444a-9f17-0574296eeda2 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:13:55.198061 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e951c97e-4e6d-444a-9f17-0574296eeda2 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:13:55.198061 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e951c97e-4e6d-444a-9f17-0574296eeda2 None admin] PATH_INFO: `/v3/domains` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:13:55.198061 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e951c97e-4e6d-444a-9f17-0574296eeda2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:13:55.198061 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e951c97e-4e6d-444a-9f17-0574296eeda2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:13:55.199323 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e951c97e-4e6d-444a-9f17-0574296eeda2 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:13:55.214017 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 593/1204] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 20 22:13:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:13:55.221254 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d6c46f-566c-410c-aac2-e1c0be6ccff6 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:13:55.292269 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:13:55.356744 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d6c46f-566c-410c-aac2-e1c0be6ccff6 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:13:55.405260 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ec2f0c-2745-4ed1-be1e-d52296ea5272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:13:55.405877 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ec2f0c-2745-4ed1-be1e-d52296ea5272 None admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:13:55.406053 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ec2f0c-2745-4ed1-be1e-d52296ea5272 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:13:55.406381 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ec2f0c-2745-4ed1-be1e-d52296ea5272 None admin] PATH_INFO: `/v3/users` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:13:55.407170 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ec2f0c-2745-4ed1-be1e-d52296ea5272 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:13:55.408789 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ec2f0c-2745-4ed1-be1e-d52296ea5272 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:13:55.438569 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 612/1205] 10.222.0.33 () {60 vars in 1132 bytes} [Tue Sep 20 22:13:55 2022] POST /identity/v3/users => generated 251 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:13:57.956382 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476615b1-6614-410d-bcf9-1efa7d94ab60 None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:13:57.956933 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476615b1-6614-410d-bcf9-1efa7d94ab60 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:13:57.956933 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476615b1-6614-410d-bcf9-1efa7d94ab60 None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:13:57.958279 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 594/1206] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:13:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:13:57.964121 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04661f73-f797-4ff2-ba39-7d60eaafceb9 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:13:57.964716 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04661f73-f797-4ff2-ba39-7d60eaafceb9 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:13:57.964716 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04661f73-f797-4ff2-ba39-7d60eaafceb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:13:57.985183 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-04661f73-f797-4ff2-ba39-7d60eaafceb9 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:13:57.986363 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-04661f73-f797-4ff2-ba39-7d60eaafceb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:13:58.062202 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 613/1207] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:13:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 20 22:13:58.329788 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476615b1-6614-410d-bcf9-1efa7d94ab60 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:13:58.446770 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476615b1-6614-410d-bcf9-1efa7d94ab60 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:13:58.485911 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6714f0a-7fbc-4fef-80b9-acb4686f2638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:13:58.486606 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6714f0a-7fbc-4fef-80b9-acb4686f2638 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:13:58.486842 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6714f0a-7fbc-4fef-80b9-acb4686f2638 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:13:58.487109 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6714f0a-7fbc-4fef-80b9-acb4686f2638 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:13:58.498244 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6714f0a-7fbc-4fef-80b9-acb4686f2638 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 22:13:58.502987 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-d6714f0a-7fbc-4fef-80b9-acb4686f2638 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 20 22:13:58.502987 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:13:58.502987 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:13:58.502987 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:13:58.502987 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:13:58.502987 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:13:58.502987 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:13:58.502987 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:13:58.502987 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:13:58.502987 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:13:58.502987 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:13:58.502987 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:13:58.502987 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 22:13:58.502987 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 22:13:58.502987 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 22:13:58.502987 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 22:13:58.506888 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 22:13:58.506888 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 22:13:58.506888 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 22:13:58.506888 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 22:13:58.506888 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:13:58.506888 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:13:58.506888 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:13:58.506888 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:13:58.506888 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:13:58.506888 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:13:58.506888 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:13:58.506888 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:13:58.506888 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:13:58.506888 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:13:58.506888 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:13:58.506888 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:13:58.507757 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:13:58.507757 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:13:58.507757 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:13:58.507757 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:13:58.507757 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 22:13:58.507757 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 22:13:58.507757 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 22:13:58.507757 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 22:13:58.507757 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 22:13:58.507757 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 22:13:58.507757 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 20 22:13:58.507757 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:13:58.507757 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 595/1208] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Sep 20 22:13:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:13:58.510055 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04661f73-f797-4ff2-ba39-7d60eaafceb9 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:13:58.554089 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:13:58.629144 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04661f73-f797-4ff2-ba39-7d60eaafceb9 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:13:58.666115 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d54d672-e627-454b-bf32-3f47790a4e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:13:58.666881 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d54d672-e627-454b-bf32-3f47790a4e5a None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:13:58.667182 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d54d672-e627-454b-bf32-3f47790a4e5a None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:13:58.667536 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d54d672-e627-454b-bf32-3f47790a4e5a None admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:13:58.668344 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d54d672-e627-454b-bf32-3f47790a4e5a None admin] RBAC: Adding query filter params (name=service) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:13:58.668661 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d54d672-e627-454b-bf32-3f47790a4e5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:13:58.670954 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d54d672-e627-454b-bf32-3f47790a4e5a None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:13:58.682833 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 614/1209] 10.222.0.33 () {56 vars in 1103 bytes} [Tue Sep 20 22:13:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:13:58.689421 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6714f0a-7fbc-4fef-80b9-acb4686f2638 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:13:58.745691 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:13:58.813090 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6714f0a-7fbc-4fef-80b9-acb4686f2638 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:13:58.863523 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30b1956-f2d0-4c71-b16e-86feb1ac3079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:13:58.864312 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30b1956-f2d0-4c71-b16e-86feb1ac3079 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:13:58.864695 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30b1956-f2d0-4c71-b16e-86feb1ac3079 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:13:58.864974 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30b1956-f2d0-4c71-b16e-86feb1ac3079 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:13:58.877098 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30b1956-f2d0-4c71-b16e-86feb1ac3079 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:13:58.878840 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30b1956-f2d0-4c71-b16e-86feb1ac3079 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:13:58.896121 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-f30b1956-f2d0-4c71-b16e-86feb1ac3079 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:13:58.896121 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:13:58.896121 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:13:58.896121 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:13:58.896121 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:13:58.896121 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:13:58.896121 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:13:58.896121 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:13:58.896121 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:13:58.896121 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:13:58.896121 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:13:58.896121 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:13:58.896121 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 22:13:58.896121 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 22:13:58.896121 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 22:13:58.896121 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 22:13:58.898918 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:13:58.898918 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:13:58.898918 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:13:58.898918 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:13:58.898918 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:13:58.898918 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:13:58.898918 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:13:58.898918 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:13:58.898918 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:13:58.898918 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:13:58.898918 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:13:58.898918 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:13:58.898918 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:13:58.898918 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:13:58.898918 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:13:58.898918 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:13:58.898918 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 22:13:58.900051 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 22:13:58.900051 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:13:58.900051 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:13:58.900051 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 596/1210] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 20 22:13:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:13:58.903130 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d54d672-e627-454b-bf32-3f47790a4e5a None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:13:59.027177 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:13:59.031306 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d54d672-e627-454b-bf32-3f47790a4e5a None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:13:59.065837 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278eee73-1a8b-4446-912c-b3bc5f6b1d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:13:59.066409 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278eee73-1a8b-4446-912c-b3bc5f6b1d36 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:13:59.066730 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278eee73-1a8b-4446-912c-b3bc5f6b1d36 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:13:59.067004 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278eee73-1a8b-4446-912c-b3bc5f6b1d36 None admin] PATH_INFO: `/v3/domains` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:13:59.067667 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278eee73-1a8b-4446-912c-b3bc5f6b1d36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:13:59.067969 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278eee73-1a8b-4446-912c-b3bc5f6b1d36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:13:59.069324 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278eee73-1a8b-4446-912c-b3bc5f6b1d36 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:13:59.082800 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 615/1211] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 20 22:13:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:13:59.088321 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30b1956-f2d0-4c71-b16e-86feb1ac3079 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:13:59.200341 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30b1956-f2d0-4c71-b16e-86feb1ac3079 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:13:59.202558 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:13:59.239687 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b91844-9ba6-4314-9652-e92a2efdf5b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:13:59.240321 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b91844-9ba6-4314-9652-e92a2efdf5b9 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:13:59.240597 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b91844-9ba6-4314-9652-e92a2efdf5b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:13:59.240880 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b91844-9ba6-4314-9652-e92a2efdf5b9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:13:59.248848 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b91844-9ba6-4314-9652-e92a2efdf5b9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:13:59.250273 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b91844-9ba6-4314-9652-e92a2efdf5b9 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:13:59.261881 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-73b91844-9ba6-4314-9652-e92a2efdf5b9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 20 22:13:59.261881 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:13:59.261881 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:13:59.261881 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:13:59.261881 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:13:59.261881 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:13:59.261881 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:13:59.261881 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:13:59.261881 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:13:59.261881 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:13:59.261881 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:13:59.261881 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:13:59.261881 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 20 22:13:59.261881 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 20 22:13:59.261881 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 20 22:13:59.261881 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 20 22:13:59.263728 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:13:59.263728 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:13:59.263728 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 20 22:13:59.263728 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 22:13:59.263728 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 20 22:13:59.263728 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 22:13:59.263728 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:13:59.263728 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:13:59.263728 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:13:59.263728 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:13:59.263728 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:13:59.263728 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:13:59.263728 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:13:59.263728 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:13:59.263728 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:13:59.263728 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:13:59.263728 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:13:59.263728 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:13:59.264713 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:13:59.264713 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:13:59.264713 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 20 22:13:59.264713 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 20 22:13:59.264713 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 20 22:13:59.264713 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 20 22:13:59.264713 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 20 22:13:59.264713 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 20 22:13:59.264713 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 20 22:13:59.264713 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:13:59.264713 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 597/1212] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 20 22:13:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:13:59.269383 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278eee73-1a8b-4446-912c-b3bc5f6b1d36 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:13:59.375363 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278eee73-1a8b-4446-912c-b3bc5f6b1d36 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:13:59.415450 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6abd05-6c82-4e45-8bf5-cd8eaf54e79e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:13:59.416058 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6abd05-6c82-4e45-8bf5-cd8eaf54e79e None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:13:59.416337 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6abd05-6c82-4e45-8bf5-cd8eaf54e79e None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:13:59.416607 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6abd05-6c82-4e45-8bf5-cd8eaf54e79e None admin] PATH_INFO: `/v3/users` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:13:59.417343 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6abd05-6c82-4e45-8bf5-cd8eaf54e79e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:13:59.417632 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6abd05-6c82-4e45-8bf5-cd8eaf54e79e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:13:59.419082 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6abd05-6c82-4e45-8bf5-cd8eaf54e79e None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:13:59.444484 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 616/1213] 10.222.0.33 () {56 vars in 1143 bytes} [Tue Sep 20 22:13:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:13:59.446582 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b91844-9ba6-4314-9652-e92a2efdf5b9 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:13:59.554865 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b91844-9ba6-4314-9652-e92a2efdf5b9 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:13:59.596590 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e1cf06-5339-4f6a-abcf-8f45183a6a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:13:59.597225 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e1cf06-5339-4f6a-abcf-8f45183a6a90 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:13:59.597494 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e1cf06-5339-4f6a-abcf-8f45183a6a90 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:13:59.597766 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e1cf06-5339-4f6a-abcf-8f45183a6a90 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:13:59.632068 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:13:59.674764 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e1cf06-5339-4f6a-abcf-8f45183a6a90 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:13:59.676527 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e1cf06-5339-4f6a-abcf-8f45183a6a90 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:13:59.802526 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 598/1214] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 20 22:13:59 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 20 22:13:59.808530 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6abd05-6c82-4e45-8bf5-cd8eaf54e79e None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:13:59.831056 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:13:59.929548 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6abd05-6c82-4e45-8bf5-cd8eaf54e79e None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:13:59.976068 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad1ed38-3832-4e96-9543-02f1a14d3592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:13:59.976796 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad1ed38-3832-4e96-9543-02f1a14d3592 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:13:59.977075 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad1ed38-3832-4e96-9543-02f1a14d3592 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:13:59.977443 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad1ed38-3832-4e96-9543-02f1a14d3592 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:13:59.991647 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad1ed38-3832-4e96-9543-02f1a14d3592 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:13:59.993270 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad1ed38-3832-4e96-9543-02f1a14d3592 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:14:00.012920 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-aad1ed38-3832-4e96-9543-02f1a14d3592 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:14:00.012920 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:14:00.012920 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:14:00.012920 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:14:00.012920 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:14:00.012920 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:14:00.012920 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:14:00.012920 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:14:00.012920 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:14:00.012920 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:14:00.012920 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:14:00.012920 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:14:00.012920 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 22:14:00.012920 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 22:14:00.012920 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 22:14:00.012920 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 22:14:00.014161 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:14:00.014161 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:14:00.014161 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:14:00.014161 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:14:00.014161 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:14:00.014161 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:14:00.014161 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:14:00.014161 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:14:00.014161 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:14:00.014161 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:14:00.014161 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:14:00.014161 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:14:00.014161 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:14:00.014161 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:14:00.014161 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:14:00.014161 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:14:00.014161 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 22:14:00.015189 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 22:14:00.015189 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:14:00.015189 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:14:00.015189 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 617/1215] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 20 22:13:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:14:00.020306 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e1cf06-5339-4f6a-abcf-8f45183a6a90 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:14:00.102152 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:14:00.148957 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e1cf06-5339-4f6a-abcf-8f45183a6a90 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:14:00.187860 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537e3e0b-b6d5-496f-8b0e-03bc06323b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:14:00.188397 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537e3e0b-b6d5-496f-8b0e-03bc06323b33 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:14:00.188678 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537e3e0b-b6d5-496f-8b0e-03bc06323b33 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:14:00.188951 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537e3e0b-b6d5-496f-8b0e-03bc06323b33 None admin] PATH_INFO: `/v3/domains` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:14:00.189667 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537e3e0b-b6d5-496f-8b0e-03bc06323b33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:14:00.189970 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537e3e0b-b6d5-496f-8b0e-03bc06323b33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:14:00.191756 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537e3e0b-b6d5-496f-8b0e-03bc06323b33 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:14:00.205060 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 599/1216] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 20 22:14:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:14:00.211032 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad1ed38-3832-4e96-9543-02f1a14d3592 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:14:00.286193 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:14:00.318776 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad1ed38-3832-4e96-9543-02f1a14d3592 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:14:00.357755 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa67565f-69c9-49dc-a639-4b22ba570c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:14:00.358386 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa67565f-69c9-49dc-a639-4b22ba570c28 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:14:00.358707 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa67565f-69c9-49dc-a639-4b22ba570c28 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:14:00.358967 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa67565f-69c9-49dc-a639-4b22ba570c28 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:14:00.366683 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa67565f-69c9-49dc-a639-4b22ba570c28 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:14:00.368127 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa67565f-69c9-49dc-a639-4b22ba570c28 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:14:00.381360 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-fa67565f-69c9-49dc-a639-4b22ba570c28 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 22:14:00.381360 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:14:00.381360 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:14:00.381360 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:14:00.381360 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:14:00.381360 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:14:00.381360 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:14:00.381360 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:14:00.381360 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:14:00.381360 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:14:00.381360 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:14:00.381360 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:14:00.381360 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 20 22:14:00.381360 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 20 22:14:00.381360 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 20 22:14:00.382423 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 20 22:14:00.382423 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:14:00.382423 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:14:00.382423 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:14:00.382423 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:14:00.382423 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:14:00.382423 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:14:00.382423 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:14:00.382423 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:14:00.382423 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:14:00.382423 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:14:00.382423 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:14:00.382423 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:14:00.382423 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:14:00.382423 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:14:00.382423 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:14:00.382423 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:14:00.383350 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 20 22:14:00.383350 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 20 22:14:00.383350 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 20 22:14:00.383350 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 20 22:14:00.383350 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 20 22:14:00.383350 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 20 22:14:00.383350 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 22:14:00.383350 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:14:00.383350 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 618/1217] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Sep 20 22:14:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:14:00.389103 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537e3e0b-b6d5-496f-8b0e-03bc06323b33 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:14:00.497276 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537e3e0b-b6d5-496f-8b0e-03bc06323b33 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:14:00.519982 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:14:00.532767 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b17749-4b15-4579-9e35-65fb63d5d442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:14:00.533375 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b17749-4b15-4579-9e35-65fb63d5d442 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:14:00.533654 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b17749-4b15-4579-9e35-65fb63d5d442 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:14:00.533923 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b17749-4b15-4579-9e35-65fb63d5d442 None admin] PATH_INFO: `/v3/projects` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:14:00.534713 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b17749-4b15-4579-9e35-65fb63d5d442 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:14:00.535019 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b17749-4b15-4579-9e35-65fb63d5d442 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:14:00.536456 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b17749-4b15-4579-9e35-65fb63d5d442 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:14:00.549204 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 600/1218] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Sep 20 22:14:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 22:14:00.555630 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa67565f-69c9-49dc-a639-4b22ba570c28 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:14:00.667463 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa67565f-69c9-49dc-a639-4b22ba570c28 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:14:00.698719 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:14:00.705683 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e76c91-37e2-4fcb-a7df-80d18b366014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:14:00.706484 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e76c91-37e2-4fcb-a7df-80d18b366014 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:14:00.706791 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e76c91-37e2-4fcb-a7df-80d18b366014 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:14:00.707070 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e76c91-37e2-4fcb-a7df-80d18b366014 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:14:00.707784 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e76c91-37e2-4fcb-a7df-80d18b366014 None admin] RBAC: Adding query filter params (role.id=6d6dcbd3bc16491db00308c3b7d27a63, scope.project.id=3ce415d02aa9489bae19cd514805fd8c, user.id=c79676ee86294dab92ba732e38d6fa74) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:14:00.708142 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e76c91-37e2-4fcb-a7df-80d18b366014 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:14:00.709506 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e76c91-37e2-4fcb-a7df-80d18b366014 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:14:00.715120 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 619/1219] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Sep 20 22:14:00 2022] GET /identity/v3/role_assignments?user.id=c79676ee86294dab92ba732e38d6fa74&scope.project.id=3ce415d02aa9489bae19cd514805fd8c&role.id=6d6dcbd3bc16491db00308c3b7d27a63 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:14:02.947791 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cdc77d-c0e0-48a9-971c-817a28533cb8 None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:14:02.948320 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cdc77d-c0e0-48a9-971c-817a28533cb8 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:14:02.948320 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cdc77d-c0e0-48a9-971c-817a28533cb8 None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:14:02.949651 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 601/1220] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:14:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:14:02.956280 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423ffbfd-e6e8-48c1-8924-800674063bd4 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:14:02.956782 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423ffbfd-e6e8-48c1-8924-800674063bd4 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:14:02.956782 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423ffbfd-e6e8-48c1-8924-800674063bd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:14:02.978144 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-423ffbfd-e6e8-48c1-8924-800674063bd4 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:14:02.979390 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-423ffbfd-e6e8-48c1-8924-800674063bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:14:03.057937 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 620/1221] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:14:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 20 22:14:03.368117 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cdc77d-c0e0-48a9-971c-817a28533cb8 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:14:03.476759 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cdc77d-c0e0-48a9-971c-817a28533cb8 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:14:03.517601 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d78efa-7a8d-4f32-b269-a3734ac8746d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:14:03.518239 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d78efa-7a8d-4f32-b269-a3734ac8746d None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:14:03.518546 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d78efa-7a8d-4f32-b269-a3734ac8746d None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:14:03.518812 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d78efa-7a8d-4f32-b269-a3734ac8746d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:14:03.531841 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d78efa-7a8d-4f32-b269-a3734ac8746d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 22:14:03.537465 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-93d78efa-7a8d-4f32-b269-a3734ac8746d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 20 22:14:03.537465 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:14:03.537465 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:14:03.537465 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:14:03.537465 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:14:03.537465 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:14:03.537465 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:14:03.537465 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:14:03.537465 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:14:03.537465 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:14:03.537465 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:14:03.537465 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:14:03.537465 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 22:14:03.537465 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 22:14:03.537465 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 22:14:03.537465 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 22:14:03.548251 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 22:14:03.548251 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 22:14:03.548251 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 22:14:03.548251 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 22:14:03.548251 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:14:03.548251 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:14:03.548251 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:14:03.548251 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:14:03.548251 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:14:03.548251 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:14:03.548251 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:14:03.548251 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:14:03.548251 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:14:03.548251 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:14:03.548251 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:14:03.548251 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:14:03.549159 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:14:03.549159 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:14:03.549159 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:14:03.549159 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:14:03.549159 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 22:14:03.549159 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 22:14:03.549159 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 22:14:03.549159 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 22:14:03.549159 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 22:14:03.549159 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 22:14:03.549159 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 20 22:14:03.549159 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:14:03.549159 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 602/1222] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Sep 20 22:14:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 20 22:14:03.549943 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423ffbfd-e6e8-48c1-8924-800674063bd4 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:14:03.655128 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423ffbfd-e6e8-48c1-8924-800674063bd4 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:14:03.681269 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:14:03.694717 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a580034b-7815-4ab0-a57a-a5614b7d4d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:14:03.695367 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a580034b-7815-4ab0-a57a-a5614b7d4d45 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:14:03.695761 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a580034b-7815-4ab0-a57a-a5614b7d4d45 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:14:03.696084 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a580034b-7815-4ab0-a57a-a5614b7d4d45 None admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:14:03.696749 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a580034b-7815-4ab0-a57a-a5614b7d4d45 None admin] RBAC: Adding query filter params (name=service) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:14:03.697064 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a580034b-7815-4ab0-a57a-a5614b7d4d45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:14:03.698638 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a580034b-7815-4ab0-a57a-a5614b7d4d45 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:14:03.707513 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 621/1223] 10.222.0.33 () {56 vars in 1103 bytes} [Tue Sep 20 22:14:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:14:03.713614 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d78efa-7a8d-4f32-b269-a3734ac8746d None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:14:03.761882 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:14:03.826644 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d78efa-7a8d-4f32-b269-a3734ac8746d None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:14:03.862953 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01d635d-3d97-4130-9aec-019ffc777542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:14:03.863737 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d635d-3d97-4130-9aec-019ffc777542 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:14:03.864038 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d635d-3d97-4130-9aec-019ffc777542 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:14:03.864406 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d635d-3d97-4130-9aec-019ffc777542 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:14:03.879562 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01d635d-3d97-4130-9aec-019ffc777542 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:14:03.881036 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01d635d-3d97-4130-9aec-019ffc777542 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:14:03.899219 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-b01d635d-3d97-4130-9aec-019ffc777542 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:14:03.899219 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:14:03.899219 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:14:03.899219 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:14:03.899219 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:14:03.899219 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:14:03.899219 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:14:03.899219 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:14:03.899219 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:14:03.899219 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:14:03.899219 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:14:03.899219 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:14:03.899219 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 22:14:03.899219 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 22:14:03.899219 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 22:14:03.899219 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 22:14:03.900321 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:14:03.900321 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:14:03.900321 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:14:03.900321 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:14:03.900321 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:14:03.900321 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:14:03.900321 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:14:03.900321 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:14:03.900321 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:14:03.900321 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:14:03.900321 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:14:03.900321 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:14:03.900321 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:14:03.900321 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:14:03.900321 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:14:03.900321 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:14:03.900321 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 22:14:03.901463 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 22:14:03.901463 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:14:03.901463 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:14:03.901463 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 603/1224] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 20 22:14:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:14:03.907885 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a580034b-7815-4ab0-a57a-a5614b7d4d45 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:14:04.025769 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a580034b-7815-4ab0-a57a-a5614b7d4d45 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:14:04.066809 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf20de0c-6de9-4f88-aad5-7262060fd8c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:14:04.067531 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf20de0c-6de9-4f88-aad5-7262060fd8c2 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:14:04.067833 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf20de0c-6de9-4f88-aad5-7262060fd8c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:14:04.068284 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf20de0c-6de9-4f88-aad5-7262060fd8c2 None admin] PATH_INFO: `/v3/domains` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:14:04.069069 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf20de0c-6de9-4f88-aad5-7262060fd8c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:14:04.069429 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf20de0c-6de9-4f88-aad5-7262060fd8c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:14:04.071051 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf20de0c-6de9-4f88-aad5-7262060fd8c2 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:14:04.089551 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 622/1225] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 20 22:14:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:14:04.091623 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01d635d-3d97-4130-9aec-019ffc777542 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:14:04.208222 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:14:04.216593 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01d635d-3d97-4130-9aec-019ffc777542 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:14:04.257549 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21041b20-4e4a-418b-b04f-0eaa17f9ae72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:14:04.258176 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21041b20-4e4a-418b-b04f-0eaa17f9ae72 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:14:04.258538 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21041b20-4e4a-418b-b04f-0eaa17f9ae72 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:14:04.258817 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21041b20-4e4a-418b-b04f-0eaa17f9ae72 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:14:04.268108 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21041b20-4e4a-418b-b04f-0eaa17f9ae72 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:14:04.269551 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21041b20-4e4a-418b-b04f-0eaa17f9ae72 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:14:04.282164 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-21041b20-4e4a-418b-b04f-0eaa17f9ae72 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 20 22:14:04.282164 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:14:04.282164 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:14:04.282164 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:14:04.282164 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:14:04.282164 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:14:04.282164 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:14:04.282164 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:14:04.282164 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:14:04.282164 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:14:04.282164 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:14:04.282164 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:14:04.282164 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 20 22:14:04.282164 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 20 22:14:04.282164 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 20 22:14:04.282164 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 20 22:14:04.283243 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:14:04.283243 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:14:04.283243 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 20 22:14:04.283243 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 22:14:04.283243 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 20 22:14:04.283243 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 22:14:04.283243 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:14:04.283243 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:14:04.283243 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:14:04.283243 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:14:04.283243 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:14:04.283243 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:14:04.283243 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:14:04.283243 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:14:04.283243 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:14:04.283243 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:14:04.283243 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:14:04.283243 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:14:04.284554 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:14:04.284554 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:14:04.284554 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 20 22:14:04.284554 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 20 22:14:04.284554 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 20 22:14:04.284554 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 20 22:14:04.284554 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 20 22:14:04.284554 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 20 22:14:04.284554 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 20 22:14:04.284554 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:14:04.284554 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 604/1226] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 20 22:14:04 2022] GET /identity/v3/users/placement => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:14:04.289580 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf20de0c-6de9-4f88-aad5-7262060fd8c2 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:14:04.342915 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:14:04.401008 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf20de0c-6de9-4f88-aad5-7262060fd8c2 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:14:04.437807 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf407b9-7b13-4d1e-b1b4-5546c2253885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:14:04.438485 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf407b9-7b13-4d1e-b1b4-5546c2253885 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:14:04.438795 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf407b9-7b13-4d1e-b1b4-5546c2253885 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:14:04.439069 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf407b9-7b13-4d1e-b1b4-5546c2253885 None admin] PATH_INFO: `/v3/users` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:14:04.439829 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf407b9-7b13-4d1e-b1b4-5546c2253885 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:14:04.440140 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf407b9-7b13-4d1e-b1b4-5546c2253885 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:14:04.441752 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf407b9-7b13-4d1e-b1b4-5546c2253885 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:14:04.459725 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 623/1227] 10.222.0.33 () {56 vars in 1143 bytes} [Tue Sep 20 22:14:04 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 22:14:04.466149 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21041b20-4e4a-418b-b04f-0eaa17f9ae72 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:14:04.571928 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21041b20-4e4a-418b-b04f-0eaa17f9ae72 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:14:04.612422 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d9f39c-b608-44c4-abbe-8e6fb7d3194b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:14:04.612987 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d9f39c-b608-44c4-abbe-8e6fb7d3194b None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:14:04.613271 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d9f39c-b608-44c4-abbe-8e6fb7d3194b None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:14:04.613542 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d9f39c-b608-44c4-abbe-8e6fb7d3194b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:14:04.624934 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d9f39c-b608-44c4-abbe-8e6fb7d3194b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:14:04.626455 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d9f39c-b608-44c4-abbe-8e6fb7d3194b None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:14:04.643079 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-09d9f39c-b608-44c4-abbe-8e6fb7d3194b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:14:04.643079 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:14:04.643079 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:14:04.643079 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:14:04.643079 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:14:04.643079 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:14:04.643079 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:14:04.643079 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:14:04.643079 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:14:04.643079 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:14:04.643079 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:14:04.643079 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:14:04.643079 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 22:14:04.643079 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 22:14:04.643079 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 22:14:04.643079 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 22:14:04.644263 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:14:04.644263 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:14:04.644263 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:14:04.644263 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:14:04.644263 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:14:04.644263 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:14:04.644263 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:14:04.644263 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:14:04.644263 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:14:04.644263 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:14:04.644263 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:14:04.644263 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:14:04.644263 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:14:04.644263 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:14:04.644263 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:14:04.644263 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:14:04.644263 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 22:14:04.645162 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 22:14:04.645162 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:14:04.645162 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:14:04.645162 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 605/1228] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 20 22:14:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 20 22:14:04.650393 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf407b9-7b13-4d1e-b1b4-5546c2253885 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:14:04.759086 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf407b9-7b13-4d1e-b1b4-5546c2253885 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:14:04.761399 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:14:04.796219 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014dedd0-aff2-4386-815e-757c9e248186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:14:04.796843 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014dedd0-aff2-4386-815e-757c9e248186 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:14:04.797120 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014dedd0-aff2-4386-815e-757c9e248186 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:14:04.797384 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014dedd0-aff2-4386-815e-757c9e248186 None admin] PATH_INFO: `/v3/domains` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:14:04.798015 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014dedd0-aff2-4386-815e-757c9e248186 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:14:04.798307 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014dedd0-aff2-4386-815e-757c9e248186 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:14:04.799691 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014dedd0-aff2-4386-815e-757c9e248186 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:14:04.812275 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 624/1229] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 20 22:14:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:14:04.818646 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d9f39c-b608-44c4-abbe-8e6fb7d3194b None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:14:04.828617 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:14:04.937075 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d9f39c-b608-44c4-abbe-8e6fb7d3194b None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:14:04.976403 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e150bc-5dbd-4aca-9fde-38112261d5ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:14:04.977086 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e150bc-5dbd-4aca-9fde-38112261d5ef None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:14:04.977308 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e150bc-5dbd-4aca-9fde-38112261d5ef None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:14:04.977581 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e150bc-5dbd-4aca-9fde-38112261d5ef None admin] PATH_INFO: `/v3/projects/service` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:14:04.989193 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e150bc-5dbd-4aca-9fde-38112261d5ef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:14:04.991768 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e150bc-5dbd-4aca-9fde-38112261d5ef None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:14:05.008621 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-d4e150bc-5dbd-4aca-9fde-38112261d5ef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 22:14:05.008621 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:14:05.008621 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:14:05.008621 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:14:05.008621 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:14:05.008621 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:14:05.008621 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:14:05.008621 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:14:05.008621 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:14:05.008621 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:14:05.008621 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:14:05.008621 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:14:05.008621 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 20 22:14:05.008621 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 20 22:14:05.008621 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 20 22:14:05.009680 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 20 22:14:05.009680 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:14:05.009680 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:14:05.009680 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:14:05.009680 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:14:05.009680 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:14:05.009680 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:14:05.009680 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:14:05.009680 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:14:05.009680 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:14:05.009680 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:14:05.009680 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:14:05.009680 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:14:05.009680 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:14:05.009680 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:14:05.009680 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:14:05.009680 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:14:05.010635 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 20 22:14:05.010635 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 20 22:14:05.010635 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 20 22:14:05.010635 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 20 22:14:05.010635 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 20 22:14:05.010635 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 20 22:14:05.010635 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 22:14:05.010635 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:14:05.010635 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 606/1230] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Sep 20 22:14:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:14:05.016635 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014dedd0-aff2-4386-815e-757c9e248186 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:14:05.132657 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014dedd0-aff2-4386-815e-757c9e248186 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:14:05.171856 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16878741-4232-4656-b03c-d890cebe4ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:14:05.172578 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16878741-4232-4656-b03c-d890cebe4ee4 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:14:05.173036 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16878741-4232-4656-b03c-d890cebe4ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:14:05.173373 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16878741-4232-4656-b03c-d890cebe4ee4 None admin] PATH_INFO: `/v3/projects` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:14:05.174391 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16878741-4232-4656-b03c-d890cebe4ee4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:14:05.174813 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16878741-4232-4656-b03c-d890cebe4ee4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:14:05.176733 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16878741-4232-4656-b03c-d890cebe4ee4 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:14:05.193367 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 625/1231] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Sep 20 22:14:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:14:05.201846 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e150bc-5dbd-4aca-9fde-38112261d5ef None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:14:05.280004 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:14:05.321043 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e150bc-5dbd-4aca-9fde-38112261d5ef None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:14:05.359990 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7145026c-b81d-4ef7-9515-bfd5f7fd479d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:14:05.360654 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7145026c-b81d-4ef7-9515-bfd5f7fd479d None admin] REQUEST_METHOD: `PUT` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:14:05.360933 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7145026c-b81d-4ef7-9515-bfd5f7fd479d None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:14:05.361207 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7145026c-b81d-4ef7-9515-bfd5f7fd479d None admin] PATH_INFO: `/v3/projects/3ce415d02aa9489bae19cd514805fd8c/users/c79676ee86294dab92ba732e38d6fa74/roles/6d6dcbd3bc16491db00308c3b7d27a63` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:14:05.377177 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7145026c-b81d-4ef7-9515-bfd5f7fd479d None admin] RBAC: Authorizing `identity:create_grant(project_id=3ce415d02aa9489bae19cd514805fd8c, user_id=c79676ee86294dab92ba732e38d6fa74, role_id=6d6dcbd3bc16491db00308c3b7d27a63)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:14:05.378782 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7145026c-b81d-4ef7-9515-bfd5f7fd479d None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:14:05.391824 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 607/1232] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Sep 20 22:14:05 2022] PUT /identity/v3/projects/3ce415d02aa9489bae19cd514805fd8c/users/c79676ee86294dab92ba732e38d6fa74/roles/6d6dcbd3bc16491db00308c3b7d27a63 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:14:07.608998 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17592dd-6557-47fe-90aa-76f4661ddb7f None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:14:07.609612 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17592dd-6557-47fe-90aa-76f4661ddb7f None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:14:07.609612 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17592dd-6557-47fe-90aa-76f4661ddb7f None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:14:07.610984 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 626/1233] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:14:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:14:07.616873 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a0d3c9-9045-4eaf-91d0-9935aa320d2f None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:14:07.617331 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a0d3c9-9045-4eaf-91d0-9935aa320d2f None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:14:07.617411 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a0d3c9-9045-4eaf-91d0-9935aa320d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:14:07.639163 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-63a0d3c9-9045-4eaf-91d0-9935aa320d2f None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:14:07.640479 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-63a0d3c9-9045-4eaf-91d0-9935aa320d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:14:07.718728 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 608/1234] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:14:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 20 22:14:08.005690 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17592dd-6557-47fe-90aa-76f4661ddb7f None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:14:08.036300 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:14:08.124050 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17592dd-6557-47fe-90aa-76f4661ddb7f None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:14:08.159993 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353d21bc-72cf-40ff-8c64-e83f41d269a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:14:08.160591 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353d21bc-72cf-40ff-8c64-e83f41d269a3 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:14:08.160864 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353d21bc-72cf-40ff-8c64-e83f41d269a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:14:08.161132 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353d21bc-72cf-40ff-8c64-e83f41d269a3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:14:08.171538 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353d21bc-72cf-40ff-8c64-e83f41d269a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 22:14:08.176702 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-353d21bc-72cf-40ff-8c64-e83f41d269a3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 20 22:14:08.176702 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:14:08.176702 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:14:08.176702 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:14:08.176702 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:14:08.176702 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:14:08.176702 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:14:08.176702 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:14:08.176702 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:14:08.176702 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:14:08.176702 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:14:08.176702 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:14:08.176702 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 22:14:08.176702 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 22:14:08.176702 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 22:14:08.176702 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 22:14:08.177744 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 22:14:08.177744 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 22:14:08.177744 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 22:14:08.177744 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 22:14:08.177744 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:14:08.177744 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:14:08.177744 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:14:08.177744 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:14:08.177744 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:14:08.177744 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:14:08.177744 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:14:08.177744 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:14:08.177744 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:14:08.177744 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:14:08.177744 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:14:08.177744 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:14:08.179059 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:14:08.179059 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:14:08.179059 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:14:08.179059 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:14:08.179059 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 22:14:08.179059 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 22:14:08.179059 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 22:14:08.179059 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 22:14:08.179059 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 22:14:08.179059 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 22:14:08.179059 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 20 22:14:08.179059 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:14:08.179059 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 627/1235] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Sep 20 22:14:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:14:08.183839 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a0d3c9-9045-4eaf-91d0-9935aa320d2f None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:14:08.234955 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:14:08.290576 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a0d3c9-9045-4eaf-91d0-9935aa320d2f None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:14:08.331924 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac9e7f6-2d95-4d08-a0f4-98f7448a89e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:14:08.332510 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac9e7f6-2d95-4d08-a0f4-98f7448a89e8 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:14:08.332794 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac9e7f6-2d95-4d08-a0f4-98f7448a89e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:14:08.333088 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac9e7f6-2d95-4d08-a0f4-98f7448a89e8 None admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:14:08.333741 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac9e7f6-2d95-4d08-a0f4-98f7448a89e8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:14:08.334042 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac9e7f6-2d95-4d08-a0f4-98f7448a89e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:14:08.335446 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac9e7f6-2d95-4d08-a0f4-98f7448a89e8 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:14:08.346554 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 609/1236] 10.222.0.33 () {56 vars in 1103 bytes} [Tue Sep 20 22:14:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:14:08.351568 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353d21bc-72cf-40ff-8c64-e83f41d269a3 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:14:08.449862 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:14:08.467772 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353d21bc-72cf-40ff-8c64-e83f41d269a3 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:14:08.507818 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83591b51-0c17-4378-bbc0-4b5af2cd1344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:14:08.508682 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83591b51-0c17-4378-bbc0-4b5af2cd1344 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:14:08.509047 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83591b51-0c17-4378-bbc0-4b5af2cd1344 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:14:08.509500 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83591b51-0c17-4378-bbc0-4b5af2cd1344 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:14:08.522382 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83591b51-0c17-4378-bbc0-4b5af2cd1344 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:14:08.523845 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83591b51-0c17-4378-bbc0-4b5af2cd1344 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:14:08.540387 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-83591b51-0c17-4378-bbc0-4b5af2cd1344 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:14:08.540387 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:14:08.540387 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:14:08.540387 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:14:08.540387 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:14:08.540387 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:14:08.540387 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:14:08.540387 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:14:08.540387 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:14:08.540387 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:14:08.540387 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:14:08.540387 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:14:08.540387 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 22:14:08.540387 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 22:14:08.540387 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 22:14:08.540387 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 22:14:08.541517 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:14:08.541517 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:14:08.541517 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:14:08.541517 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:14:08.541517 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:14:08.541517 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:14:08.541517 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:14:08.541517 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:14:08.541517 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:14:08.541517 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:14:08.541517 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:14:08.541517 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:14:08.541517 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:14:08.541517 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:14:08.541517 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:14:08.541517 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:14:08.541517 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 22:14:08.547768 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 22:14:08.547768 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:14:08.547768 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:14:08.547768 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 628/1237] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 20 22:14:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:14:08.548975 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac9e7f6-2d95-4d08-a0f4-98f7448a89e8 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:14:08.655289 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac9e7f6-2d95-4d08-a0f4-98f7448a89e8 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:14:08.664385 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:14:08.690284 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0c3d4d-55f1-47dd-a452-11787bc80233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:14:08.690899 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c3d4d-55f1-47dd-a452-11787bc80233 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:14:08.691177 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c3d4d-55f1-47dd-a452-11787bc80233 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:14:08.691443 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c3d4d-55f1-47dd-a452-11787bc80233 None admin] PATH_INFO: `/v3/domains` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:14:08.692080 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0c3d4d-55f1-47dd-a452-11787bc80233 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:14:08.692381 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0c3d4d-55f1-47dd-a452-11787bc80233 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:14:08.693736 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0c3d4d-55f1-47dd-a452-11787bc80233 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:14:08.706930 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 610/1238] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 20 22:14:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:14:08.712795 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83591b51-0c17-4378-bbc0-4b5af2cd1344 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:14:08.822932 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83591b51-0c17-4378-bbc0-4b5af2cd1344 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:14:08.860031 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d2f6f4-f27b-43b3-9826-4072117d5cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:14:08.860687 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d2f6f4-f27b-43b3-9826-4072117d5cbe None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:14:08.861008 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d2f6f4-f27b-43b3-9826-4072117d5cbe None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:14:08.861278 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d2f6f4-f27b-43b3-9826-4072117d5cbe None admin] PATH_INFO: `/v3/users/placement` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:14:08.864115 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:14:08.870040 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d2f6f4-f27b-43b3-9826-4072117d5cbe None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:14:08.872480 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d2f6f4-f27b-43b3-9826-4072117d5cbe None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:14:08.884325 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-51d2f6f4-f27b-43b3-9826-4072117d5cbe None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 20 22:14:08.884325 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:14:08.884325 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:14:08.884325 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:14:08.884325 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:14:08.884325 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:14:08.884325 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:14:08.884325 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:14:08.884325 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:14:08.884325 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:14:08.884325 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:14:08.884325 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:14:08.884325 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 20 22:14:08.884325 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 20 22:14:08.884325 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 20 22:14:08.884325 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 20 22:14:08.885400 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:14:08.885400 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:14:08.885400 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 20 22:14:08.885400 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 22:14:08.885400 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 20 22:14:08.885400 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 22:14:08.885400 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:14:08.885400 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:14:08.885400 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:14:08.885400 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:14:08.885400 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:14:08.885400 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:14:08.885400 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:14:08.885400 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:14:08.885400 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:14:08.885400 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:14:08.885400 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:14:08.885400 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:14:08.886797 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:14:08.886797 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:14:08.886797 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 20 22:14:08.886797 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 20 22:14:08.886797 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 20 22:14:08.886797 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 20 22:14:08.886797 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 20 22:14:08.886797 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 20 22:14:08.886797 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 20 22:14:08.886797 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:14:08.886797 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 629/1239] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 20 22:14:08 2022] GET /identity/v3/users/placement => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:14:08.891602 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0c3d4d-55f1-47dd-a452-11787bc80233 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:14:09.000555 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0c3d4d-55f1-47dd-a452-11787bc80233 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:14:09.039161 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f3c044-16a5-41e7-97dd-bb2ed7fa3d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:14:09.040016 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f3c044-16a5-41e7-97dd-bb2ed7fa3d8d None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:14:09.040447 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f3c044-16a5-41e7-97dd-bb2ed7fa3d8d None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:14:09.040729 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f3c044-16a5-41e7-97dd-bb2ed7fa3d8d None admin] PATH_INFO: `/v3/users` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:14:09.041668 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f3c044-16a5-41e7-97dd-bb2ed7fa3d8d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:14:09.042012 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f3c044-16a5-41e7-97dd-bb2ed7fa3d8d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:14:09.044814 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f3c044-16a5-41e7-97dd-bb2ed7fa3d8d None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:14:09.065334 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 611/1240] 10.222.0.33 () {56 vars in 1143 bytes} [Tue Sep 20 22:14:08 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:14:09.071279 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d2f6f4-f27b-43b3-9826-4072117d5cbe None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:14:09.196700 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d2f6f4-f27b-43b3-9826-4072117d5cbe None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:14:09.233905 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1c2439-bf0a-4a17-bbd9-a61d52c397e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:14:09.234529 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c2439-bf0a-4a17-bbd9-a61d52c397e0 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:14:09.234820 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c2439-bf0a-4a17-bbd9-a61d52c397e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:14:09.235094 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c2439-bf0a-4a17-bbd9-a61d52c397e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:14:09.306136 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:14:09.313013 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1c2439-bf0a-4a17-bbd9-a61d52c397e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:14:09.314492 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1c2439-bf0a-4a17-bbd9-a61d52c397e0 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:14:09.424059 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 630/1241] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 20 22:14:09 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 20 22:14:09.430318 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f3c044-16a5-41e7-97dd-bb2ed7fa3d8d None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:14:09.461436 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:14:09.554414 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f3c044-16a5-41e7-97dd-bb2ed7fa3d8d None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:14:09.597159 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a0a02f-2452-4bd9-a270-a720f61742b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:14:09.597941 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a0a02f-2452-4bd9-a270-a720f61742b3 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:14:09.598254 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a0a02f-2452-4bd9-a270-a720f61742b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:14:09.598577 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a0a02f-2452-4bd9-a270-a720f61742b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:14:09.611554 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a0a02f-2452-4bd9-a270-a720f61742b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:14:09.613061 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a0a02f-2452-4bd9-a270-a720f61742b3 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:14:09.628532 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-e2a0a02f-2452-4bd9-a270-a720f61742b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:14:09.628532 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:14:09.628532 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:14:09.628532 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:14:09.628532 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:14:09.628532 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:14:09.628532 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:14:09.628532 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:14:09.628532 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:14:09.628532 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:14:09.628532 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:14:09.628532 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:14:09.628532 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 22:14:09.628532 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 22:14:09.628532 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 22:14:09.628532 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 22:14:09.629648 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:14:09.629648 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:14:09.629648 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:14:09.629648 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:14:09.629648 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:14:09.629648 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:14:09.629648 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:14:09.629648 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:14:09.629648 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:14:09.629648 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:14:09.629648 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:14:09.629648 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:14:09.629648 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:14:09.629648 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:14:09.629648 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:14:09.629648 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:14:09.629648 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 22:14:09.631153 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 22:14:09.631153 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:14:09.631153 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:14:09.631153 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 612/1242] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 20 22:14:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:14:09.635904 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1c2439-bf0a-4a17-bbd9-a61d52c397e0 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:14:09.742404 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:14:09.749059 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1c2439-bf0a-4a17-bbd9-a61d52c397e0 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:14:09.789832 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a70ec9e-92c5-4e54-b196-9dc57878cb08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:14:09.790440 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a70ec9e-92c5-4e54-b196-9dc57878cb08 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:14:09.790787 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a70ec9e-92c5-4e54-b196-9dc57878cb08 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:14:09.791040 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a70ec9e-92c5-4e54-b196-9dc57878cb08 None admin] PATH_INFO: `/v3/domains` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:14:09.791764 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a70ec9e-92c5-4e54-b196-9dc57878cb08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:14:09.792087 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a70ec9e-92c5-4e54-b196-9dc57878cb08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:14:09.793542 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a70ec9e-92c5-4e54-b196-9dc57878cb08 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:14:09.806115 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 631/1243] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 20 22:14:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:14:09.814619 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a0a02f-2452-4bd9-a270-a720f61742b3 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:14:09.905613 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:14:09.929942 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a0a02f-2452-4bd9-a270-a720f61742b3 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:14:09.970249 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2c8f46-4930-4a91-a531-b18e627119a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:14:09.971080 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c8f46-4930-4a91-a531-b18e627119a6 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:14:09.971376 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c8f46-4930-4a91-a531-b18e627119a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:14:09.971765 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c8f46-4930-4a91-a531-b18e627119a6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:14:09.981739 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2c8f46-4930-4a91-a531-b18e627119a6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:14:09.983458 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2c8f46-4930-4a91-a531-b18e627119a6 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:14:10.000195 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-6c2c8f46-4930-4a91-a531-b18e627119a6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 22:14:10.000195 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:14:10.000195 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:14:10.000195 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:14:10.000195 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:14:10.000195 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:14:10.000195 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:14:10.000195 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:14:10.000195 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:14:10.000195 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:14:10.000195 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:14:10.000195 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:14:10.000195 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 20 22:14:10.000195 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 20 22:14:10.000195 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 20 22:14:10.001448 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 20 22:14:10.001448 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:14:10.001448 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:14:10.001448 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:14:10.001448 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:14:10.001448 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:14:10.001448 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:14:10.001448 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:14:10.001448 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:14:10.001448 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:14:10.001448 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:14:10.001448 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:14:10.001448 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:14:10.001448 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:14:10.001448 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:14:10.001448 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:14:10.001448 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:14:10.002542 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 20 22:14:10.002542 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 20 22:14:10.002542 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 20 22:14:10.002542 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 20 22:14:10.002542 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 20 22:14:10.002542 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 20 22:14:10.002542 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 22:14:10.002542 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:14:10.002542 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 613/1244] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Sep 20 22:14:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 20 22:14:10.008448 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a70ec9e-92c5-4e54-b196-9dc57878cb08 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:14:10.120395 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a70ec9e-92c5-4e54-b196-9dc57878cb08 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:14:10.159620 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c170a0bb-6f26-4340-accb-af2baa482277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:14:10.160293 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c170a0bb-6f26-4340-accb-af2baa482277 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:14:10.160608 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c170a0bb-6f26-4340-accb-af2baa482277 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:14:10.160937 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c170a0bb-6f26-4340-accb-af2baa482277 None admin] PATH_INFO: `/v3/projects` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:14:10.161663 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c170a0bb-6f26-4340-accb-af2baa482277 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:14:10.161997 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c170a0bb-6f26-4340-accb-af2baa482277 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:14:10.163753 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c170a0bb-6f26-4340-accb-af2baa482277 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:14:10.177225 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 632/1245] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Sep 20 22:14:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:14:10.183470 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2c8f46-4930-4a91-a531-b18e627119a6 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:14:10.302906 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2c8f46-4930-4a91-a531-b18e627119a6 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:14:10.339084 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ed02ef-9334-4c11-bd4d-59b01ad36864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:14:10.339695 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ed02ef-9334-4c11-bd4d-59b01ad36864 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:14:10.340044 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ed02ef-9334-4c11-bd4d-59b01ad36864 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:14:10.340293 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ed02ef-9334-4c11-bd4d-59b01ad36864 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:14:10.341151 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ed02ef-9334-4c11-bd4d-59b01ad36864 None admin] RBAC: Adding query filter params (role.id=6d6dcbd3bc16491db00308c3b7d27a63, scope.project.id=3ce415d02aa9489bae19cd514805fd8c, user.id=c79676ee86294dab92ba732e38d6fa74) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:14:10.341528 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ed02ef-9334-4c11-bd4d-59b01ad36864 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:14:10.343178 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ed02ef-9334-4c11-bd4d-59b01ad36864 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:14:10.349707 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 614/1246] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Sep 20 22:14:10 2022] GET /identity/v3/role_assignments?user.id=c79676ee86294dab92ba732e38d6fa74&scope.project.id=3ce415d02aa9489bae19cd514805fd8c&role.id=6d6dcbd3bc16491db00308c3b7d27a63 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:14:12.569824 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3948c4-3ce4-46e0-9bb3-392f40c0759b None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:14:12.570320 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3948c4-3ce4-46e0-9bb3-392f40c0759b None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:14:12.570320 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3948c4-3ce4-46e0-9bb3-392f40c0759b None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:14:12.571792 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 633/1247] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:14:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:14:12.577199 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff36a7e-3cff-459b-be0d-8843fc8f4126 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:14:12.577652 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff36a7e-3cff-459b-be0d-8843fc8f4126 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:14:12.577751 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff36a7e-3cff-459b-be0d-8843fc8f4126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:14:12.587563 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:14:12.601754 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-eff36a7e-3cff-459b-be0d-8843fc8f4126 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:14:12.603047 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-eff36a7e-3cff-459b-be0d-8843fc8f4126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:14:12.672826 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 615/1248] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:14:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 20 22:14:12.944915 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3948c4-3ce4-46e0-9bb3-392f40c0759b None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:14:12.963716 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:14:13.059670 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3948c4-3ce4-46e0-9bb3-392f40c0759b None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:14:13.095724 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a86f10-38e7-4558-94bf-436978806d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:14:13.096377 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a86f10-38e7-4558-94bf-436978806d42 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:14:13.096655 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a86f10-38e7-4558-94bf-436978806d42 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:14:13.096925 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a86f10-38e7-4558-94bf-436978806d42 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:14:13.109837 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a86f10-38e7-4558-94bf-436978806d42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 22:14:13.114814 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-30a86f10-38e7-4558-94bf-436978806d42 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 22:14:13.114814 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:14:13.114814 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:14:13.114814 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:14:13.114814 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:14:13.114814 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:14:13.114814 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:14:13.114814 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:14:13.114814 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:14:13.114814 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:14:13.114814 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:14:13.114814 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:14:13.114814 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 22:14:13.114814 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 22:14:13.114814 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 22:14:13.114814 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 22:14:13.115988 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 22:14:13.115988 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 22:14:13.115988 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 22:14:13.115988 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 22:14:13.115988 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:14:13.115988 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:14:13.115988 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:14:13.115988 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:14:13.115988 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:14:13.115988 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:14:13.115988 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:14:13.115988 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:14:13.115988 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:14:13.115988 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:14:13.115988 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:14:13.115988 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:14:13.117459 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:14:13.117459 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:14:13.117459 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:14:13.117459 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:14:13.117459 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 22:14:13.117459 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 22:14:13.117459 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 22:14:13.117459 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 22:14:13.117459 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 22:14:13.117459 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 22:14:13.117459 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 22:14:13.117459 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:14:13.117459 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 634/1249] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Sep 20 22:14:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:14:13.122918 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff36a7e-3cff-459b-be0d-8843fc8f4126 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:14:13.229335 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff36a7e-3cff-459b-be0d-8843fc8f4126 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:14:13.261271 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:14:13.267649 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3aa223-2b85-44bc-bb5b-ee9e3d7898ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:14:13.268272 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3aa223-2b85-44bc-bb5b-ee9e3d7898ec None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:14:13.268552 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3aa223-2b85-44bc-bb5b-ee9e3d7898ec None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:14:13.268824 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3aa223-2b85-44bc-bb5b-ee9e3d7898ec None admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:14:13.269494 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3aa223-2b85-44bc-bb5b-ee9e3d7898ec None admin] RBAC: Adding query filter params (name=admin) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:14:13.269797 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3aa223-2b85-44bc-bb5b-ee9e3d7898ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:14:13.271199 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3aa223-2b85-44bc-bb5b-ee9e3d7898ec None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:14:13.280473 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 616/1250] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 20 22:14:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:14:13.286493 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a86f10-38e7-4558-94bf-436978806d42 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:14:13.367618 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:14:13.391947 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a86f10-38e7-4558-94bf-436978806d42 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:14:13.429049 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca00a14-4a76-43c1-87d3-a43fe926a544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:14:13.429696 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca00a14-4a76-43c1-87d3-a43fe926a544 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:14:13.429973 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca00a14-4a76-43c1-87d3-a43fe926a544 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:14:13.430241 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca00a14-4a76-43c1-87d3-a43fe926a544 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:14:13.441766 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca00a14-4a76-43c1-87d3-a43fe926a544 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:14:13.443273 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca00a14-4a76-43c1-87d3-a43fe926a544 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:14:13.458766 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-2ca00a14-4a76-43c1-87d3-a43fe926a544 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:14:13.458766 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:14:13.458766 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:14:13.458766 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:14:13.458766 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:14:13.458766 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:14:13.458766 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:14:13.458766 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:14:13.458766 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:14:13.458766 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:14:13.458766 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:14:13.458766 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:14:13.458766 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 22:14:13.458766 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 22:14:13.458766 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 22:14:13.458766 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 22:14:13.459941 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:14:13.459941 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:14:13.459941 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:14:13.459941 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:14:13.459941 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:14:13.459941 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:14:13.459941 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:14:13.459941 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:14:13.459941 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:14:13.459941 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:14:13.459941 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:14:13.459941 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:14:13.459941 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:14:13.459941 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:14:13.459941 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:14:13.459941 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:14:13.459941 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 22:14:13.461410 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 22:14:13.461410 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:14:13.461410 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:14:13.461410 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 635/1251] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 20 22:14:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:14:13.465898 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3aa223-2b85-44bc-bb5b-ee9e3d7898ec None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:14:13.569455 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3aa223-2b85-44bc-bb5b-ee9e3d7898ec None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:14:13.602783 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8991b2a8-f466-4c4e-9d8a-b7da0669a4f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:14:13.603377 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8991b2a8-f466-4c4e-9d8a-b7da0669a4f0 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:14:13.603656 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8991b2a8-f466-4c4e-9d8a-b7da0669a4f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:14:13.603929 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8991b2a8-f466-4c4e-9d8a-b7da0669a4f0 None admin] PATH_INFO: `/v3/domains` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:14:13.604561 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8991b2a8-f466-4c4e-9d8a-b7da0669a4f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:14:13.604859 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8991b2a8-f466-4c4e-9d8a-b7da0669a4f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:14:13.606790 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8991b2a8-f466-4c4e-9d8a-b7da0669a4f0 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:14:13.618843 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 617/1252] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 20 22:14:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:14:13.628333 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca00a14-4a76-43c1-87d3-a43fe926a544 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:14:13.734181 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca00a14-4a76-43c1-87d3-a43fe926a544 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:14:13.759127 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:14:13.767448 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c0e6b2-e007-4070-a859-62d5a127440a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:14:13.768068 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c0e6b2-e007-4070-a859-62d5a127440a None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:14:13.768340 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c0e6b2-e007-4070-a859-62d5a127440a None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:14:13.768606 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c0e6b2-e007-4070-a859-62d5a127440a None admin] PATH_INFO: `/v3/users/placement` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:14:13.775677 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c0e6b2-e007-4070-a859-62d5a127440a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:14:13.777095 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c0e6b2-e007-4070-a859-62d5a127440a None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:14:13.788299 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-53c0e6b2-e007-4070-a859-62d5a127440a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 20 22:14:13.788299 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:14:13.788299 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:14:13.788299 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:14:13.788299 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:14:13.788299 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:14:13.788299 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:14:13.788299 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:14:13.788299 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:14:13.788299 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:14:13.788299 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:14:13.788299 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:14:13.788299 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 20 22:14:13.788299 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 20 22:14:13.788299 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 20 22:14:13.788299 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 20 22:14:13.789331 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:14:13.789331 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:14:13.789331 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 20 22:14:13.789331 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 22:14:13.789331 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 20 22:14:13.789331 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 22:14:13.789331 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:14:13.789331 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:14:13.789331 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:14:13.789331 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:14:13.789331 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:14:13.789331 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:14:13.789331 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:14:13.789331 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:14:13.789331 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:14:13.789331 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:14:13.789331 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:14:13.789331 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:14:13.790311 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:14:13.790311 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:14:13.790311 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 20 22:14:13.790311 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 20 22:14:13.790311 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 20 22:14:13.790311 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 20 22:14:13.790311 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 20 22:14:13.790311 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 20 22:14:13.790311 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 20 22:14:13.790311 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:14:13.790311 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 636/1253] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 20 22:14:13 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:14:13.796001 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8991b2a8-f466-4c4e-9d8a-b7da0669a4f0 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:14:13.849399 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:14:13.892287 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8991b2a8-f466-4c4e-9d8a-b7da0669a4f0 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:14:13.925340 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df4df1b-4c77-4b8f-9e39-e3240f0e2a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:14:13.925964 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df4df1b-4c77-4b8f-9e39-e3240f0e2a44 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:14:13.926242 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df4df1b-4c77-4b8f-9e39-e3240f0e2a44 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:14:13.926532 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df4df1b-4c77-4b8f-9e39-e3240f0e2a44 None admin] PATH_INFO: `/v3/users` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:14:13.927274 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df4df1b-4c77-4b8f-9e39-e3240f0e2a44 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:14:13.927577 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df4df1b-4c77-4b8f-9e39-e3240f0e2a44 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:14:13.928988 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df4df1b-4c77-4b8f-9e39-e3240f0e2a44 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:14:13.945219 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 618/1254] 10.222.0.33 () {56 vars in 1143 bytes} [Tue Sep 20 22:14:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:14:13.950935 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c0e6b2-e007-4070-a859-62d5a127440a None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:14:14.058296 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c0e6b2-e007-4070-a859-62d5a127440a None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:14:14.091167 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a508af-5966-4294-aed7-c0fbd8960f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:14:14.091762 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a508af-5966-4294-aed7-c0fbd8960f78 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:14:14.092042 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a508af-5966-4294-aed7-c0fbd8960f78 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:14:14.092315 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a508af-5966-4294-aed7-c0fbd8960f78 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:14:14.144656 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:14:14.157653 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a508af-5966-4294-aed7-c0fbd8960f78 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:14:14.159129 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a508af-5966-4294-aed7-c0fbd8960f78 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:14:14.252399 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 637/1255] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 20 22:14:13 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 20 22:14:14.258370 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df4df1b-4c77-4b8f-9e39-e3240f0e2a44 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:14:14.356129 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df4df1b-4c77-4b8f-9e39-e3240f0e2a44 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:14:14.368735 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:14:14.389688 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19108a55-dfca-49c4-8f4f-ccbbffd353ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:14:14.390302 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19108a55-dfca-49c4-8f4f-ccbbffd353ef None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:14:14.390603 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19108a55-dfca-49c4-8f4f-ccbbffd353ef None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:14:14.390875 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19108a55-dfca-49c4-8f4f-ccbbffd353ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:14:14.400491 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19108a55-dfca-49c4-8f4f-ccbbffd353ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:14:14.401866 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19108a55-dfca-49c4-8f4f-ccbbffd353ef None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:14:14.416331 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-19108a55-dfca-49c4-8f4f-ccbbffd353ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:14:14.416331 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:14:14.416331 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:14:14.416331 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:14:14.416331 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:14:14.416331 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:14:14.416331 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:14:14.416331 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:14:14.416331 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:14:14.416331 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:14:14.416331 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:14:14.416331 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:14:14.416331 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 22:14:14.416331 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 22:14:14.416331 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 22:14:14.416331 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 22:14:14.417406 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:14:14.417406 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:14:14.417406 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:14:14.417406 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:14:14.417406 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:14:14.417406 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:14:14.417406 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:14:14.417406 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:14:14.417406 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:14:14.417406 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:14:14.417406 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:14:14.417406 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:14:14.417406 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:14:14.417406 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:14:14.417406 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:14:14.417406 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:14:14.417406 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 22:14:14.418366 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 22:14:14.418366 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:14:14.418366 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:14:14.418366 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 619/1256] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 20 22:14:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:14:14.423237 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a508af-5966-4294-aed7-c0fbd8960f78 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:14:14.507234 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:14:14.519953 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a508af-5966-4294-aed7-c0fbd8960f78 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:14:14.552162 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d11618-93c2-409d-baf2-2f78e265483d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:14:14.552750 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d11618-93c2-409d-baf2-2f78e265483d None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:14:14.553023 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d11618-93c2-409d-baf2-2f78e265483d None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:14:14.553291 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d11618-93c2-409d-baf2-2f78e265483d None admin] PATH_INFO: `/v3/domains` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:14:14.553920 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d11618-93c2-409d-baf2-2f78e265483d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:14:14.554233 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d11618-93c2-409d-baf2-2f78e265483d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:14:14.555577 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d11618-93c2-409d-baf2-2f78e265483d None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:14:14.568631 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 638/1257] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 20 22:14:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:14:14.574329 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19108a55-dfca-49c4-8f4f-ccbbffd353ef None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:14:14.669868 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19108a55-dfca-49c4-8f4f-ccbbffd353ef None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:14:14.703259 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dc51f1-c2d1-45ee-9258-e33059c9d8b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:14:14.703867 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dc51f1-c2d1-45ee-9258-e33059c9d8b8 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:14:14.704141 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dc51f1-c2d1-45ee-9258-e33059c9d8b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:14:14.704407 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dc51f1-c2d1-45ee-9258-e33059c9d8b8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:14:14.710878 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dc51f1-c2d1-45ee-9258-e33059c9d8b8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:14:14.712304 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dc51f1-c2d1-45ee-9258-e33059c9d8b8 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:14:14.723135 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-f5dc51f1-c2d1-45ee-9258-e33059c9d8b8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 22:14:14.723135 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:14:14.723135 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:14:14.723135 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:14:14.723135 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:14:14.723135 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:14:14.723135 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:14:14.723135 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:14:14.723135 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:14:14.723135 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:14:14.723135 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:14:14.723135 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:14:14.723135 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 20 22:14:14.723135 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 20 22:14:14.723135 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 20 22:14:14.724188 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 20 22:14:14.724188 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:14:14.724188 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:14:14.724188 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:14:14.724188 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:14:14.724188 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:14:14.724188 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:14:14.724188 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:14:14.724188 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:14:14.724188 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:14:14.724188 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:14:14.724188 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:14:14.724188 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:14:14.724188 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:14:14.724188 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:14:14.724188 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:14:14.724188 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:14:14.725087 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 20 22:14:14.725087 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 20 22:14:14.725087 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 20 22:14:14.725087 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 20 22:14:14.725087 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 20 22:14:14.725087 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 20 22:14:14.725087 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 22:14:14.725087 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:14:14.725087 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 620/1258] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Sep 20 22:14:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:14:14.730144 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d11618-93c2-409d-baf2-2f78e265483d None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:14:14.827016 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d11618-93c2-409d-baf2-2f78e265483d None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:14:14.858711 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9ebed5-4a85-4c2b-a7da-16d6204cf83d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:14:14.859290 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9ebed5-4a85-4c2b-a7da-16d6204cf83d None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:14:14.859564 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9ebed5-4a85-4c2b-a7da-16d6204cf83d None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:14:14.859831 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9ebed5-4a85-4c2b-a7da-16d6204cf83d None admin] PATH_INFO: `/v3/projects` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:14:14.860503 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9ebed5-4a85-4c2b-a7da-16d6204cf83d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:14:14.860802 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9ebed5-4a85-4c2b-a7da-16d6204cf83d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:14:14.862197 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9ebed5-4a85-4c2b-a7da-16d6204cf83d None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:14:14.874109 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 639/1259] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Sep 20 22:14:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:14:14.879995 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dc51f1-c2d1-45ee-9258-e33059c9d8b8 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:14:14.904504 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:14:14.984501 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dc51f1-c2d1-45ee-9258-e33059c9d8b8 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:14:15.020797 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b60f37a-c0f5-4f12-a4ce-414f22d56c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:14:15.021395 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b60f37a-c0f5-4f12-a4ce-414f22d56c7c None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:14:15.021671 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b60f37a-c0f5-4f12-a4ce-414f22d56c7c None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:14:15.021941 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b60f37a-c0f5-4f12-a4ce-414f22d56c7c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:14:15.022686 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b60f37a-c0f5-4f12-a4ce-414f22d56c7c None admin] RBAC: Adding query filter params (role.id=8a829170b29d42d6af589399e51edb0f, scope.project.id=3ce415d02aa9489bae19cd514805fd8c, user.id=c79676ee86294dab92ba732e38d6fa74) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:14:15.022993 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b60f37a-c0f5-4f12-a4ce-414f22d56c7c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:14:15.024420 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b60f37a-c0f5-4f12-a4ce-414f22d56c7c None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:14:15.029693 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 621/1260] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Sep 20 22:14:14 2022] GET /identity/v3/role_assignments?user.id=c79676ee86294dab92ba732e38d6fa74&scope.project.id=3ce415d02aa9489bae19cd514805fd8c&role.id=8a829170b29d42d6af589399e51edb0f => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:14:17.173234 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e678a9ca-8280-47f0-ad4a-eac61d372747 None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:14:17.173784 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e678a9ca-8280-47f0-ad4a-eac61d372747 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:14:17.173784 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e678a9ca-8280-47f0-ad4a-eac61d372747 None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:14:17.175406 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 640/1261] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:14:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:14:17.180730 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d411b9c-adcf-425d-a99a-bd32f8434d77 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:14:17.181115 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d411b9c-adcf-425d-a99a-bd32f8434d77 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:14:17.181285 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d411b9c-adcf-425d-a99a-bd32f8434d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:14:17.199882 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-1d411b9c-adcf-425d-a99a-bd32f8434d77 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:14:17.201080 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-1d411b9c-adcf-425d-a99a-bd32f8434d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:14:17.265540 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 622/1262] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:14:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 20 22:14:17.534538 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e678a9ca-8280-47f0-ad4a-eac61d372747 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:14:17.545245 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:14:17.635659 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e678a9ca-8280-47f0-ad4a-eac61d372747 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:14:17.668345 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cdfcbd-3055-4d2e-a1a2-c61bccbfddf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:14:17.668961 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cdfcbd-3055-4d2e-a1a2-c61bccbfddf6 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:14:17.669238 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cdfcbd-3055-4d2e-a1a2-c61bccbfddf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:14:17.669508 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cdfcbd-3055-4d2e-a1a2-c61bccbfddf6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:14:17.679402 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cdfcbd-3055-4d2e-a1a2-c61bccbfddf6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 22:14:17.684678 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-82cdfcbd-3055-4d2e-a1a2-c61bccbfddf6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 22:14:17.684678 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:14:17.684678 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:14:17.684678 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:14:17.684678 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:14:17.684678 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:14:17.684678 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:14:17.684678 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:14:17.684678 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:14:17.684678 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:14:17.684678 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:14:17.684678 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:14:17.684678 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 22:14:17.684678 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 22:14:17.684678 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 22:14:17.684678 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 22:14:17.685758 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 22:14:17.685758 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 22:14:17.685758 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 22:14:17.685758 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 22:14:17.685758 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:14:17.685758 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:14:17.685758 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:14:17.685758 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:14:17.685758 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:14:17.685758 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:14:17.685758 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:14:17.685758 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:14:17.685758 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:14:17.685758 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:14:17.685758 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:14:17.685758 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:14:17.686697 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:14:17.686697 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:14:17.686697 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:14:17.686697 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:14:17.686697 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 22:14:17.686697 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 22:14:17.686697 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 22:14:17.686697 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 22:14:17.686697 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 22:14:17.686697 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 22:14:17.686697 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 22:14:17.686697 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:14:17.686697 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 641/1263] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Sep 20 22:14:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:14:17.691797 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d411b9c-adcf-425d-a99a-bd32f8434d77 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:14:17.709964 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:14:17.788837 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d411b9c-adcf-425d-a99a-bd32f8434d77 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:14:17.822090 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d951f8e-622f-49fa-b1f4-6d414fe2862f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:14:17.822713 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d951f8e-622f-49fa-b1f4-6d414fe2862f None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:14:17.822994 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d951f8e-622f-49fa-b1f4-6d414fe2862f None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:14:17.823264 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d951f8e-622f-49fa-b1f4-6d414fe2862f None admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:14:17.823923 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d951f8e-622f-49fa-b1f4-6d414fe2862f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:14:17.824224 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d951f8e-622f-49fa-b1f4-6d414fe2862f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:14:17.825603 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d951f8e-622f-49fa-b1f4-6d414fe2862f None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:14:17.833252 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 623/1264] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 20 22:14:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:14:17.839052 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cdfcbd-3055-4d2e-a1a2-c61bccbfddf6 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:14:17.903011 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:14:17.936405 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cdfcbd-3055-4d2e-a1a2-c61bccbfddf6 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:14:17.971514 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0099c207-5609-447e-9752-5eb576441dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:14:17.972176 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0099c207-5609-447e-9752-5eb576441dba None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:14:17.972470 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0099c207-5609-447e-9752-5eb576441dba None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:14:17.972729 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0099c207-5609-447e-9752-5eb576441dba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:14:17.985381 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0099c207-5609-447e-9752-5eb576441dba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:14:17.986955 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0099c207-5609-447e-9752-5eb576441dba None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:14:18.005467 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-0099c207-5609-447e-9752-5eb576441dba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:14:18.005467 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:14:18.005467 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:14:18.005467 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:14:18.005467 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:14:18.005467 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:14:18.005467 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:14:18.005467 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:14:18.005467 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:14:18.005467 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:14:18.005467 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:14:18.005467 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:14:18.005467 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 22:14:18.005467 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 22:14:18.005467 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 22:14:18.005467 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 22:14:18.006656 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:14:18.006656 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:14:18.006656 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:14:18.006656 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:14:18.006656 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:14:18.006656 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:14:18.006656 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:14:18.006656 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:14:18.006656 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:14:18.006656 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:14:18.006656 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:14:18.006656 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:14:18.006656 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:14:18.006656 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:14:18.006656 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:14:18.006656 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:14:18.006656 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 22:14:18.007885 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 22:14:18.007885 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:14:18.007885 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:14:18.007885 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 642/1265] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 20 22:14:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:14:18.012621 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d951f8e-622f-49fa-b1f4-6d414fe2862f None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:14:18.092692 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:14:18.111931 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d951f8e-622f-49fa-b1f4-6d414fe2862f None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:14:18.144040 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fabbb37-8465-4297-be86-559b78ab8287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:14:18.144634 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fabbb37-8465-4297-be86-559b78ab8287 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:14:18.144912 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fabbb37-8465-4297-be86-559b78ab8287 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:14:18.145184 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fabbb37-8465-4297-be86-559b78ab8287 None admin] PATH_INFO: `/v3/domains` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:14:18.145818 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fabbb37-8465-4297-be86-559b78ab8287 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:14:18.146119 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fabbb37-8465-4297-be86-559b78ab8287 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:14:18.147543 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fabbb37-8465-4297-be86-559b78ab8287 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:14:18.159274 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 624/1266] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 20 22:14:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:14:18.164919 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0099c207-5609-447e-9752-5eb576441dba None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:14:18.260640 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0099c207-5609-447e-9752-5eb576441dba None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:14:18.279795 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:14:18.293989 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49e2622-e395-484c-a89a-c40b059223d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:14:18.294642 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49e2622-e395-484c-a89a-c40b059223d3 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:14:18.295234 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49e2622-e395-484c-a89a-c40b059223d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:14:18.295234 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49e2622-e395-484c-a89a-c40b059223d3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:14:18.303002 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49e2622-e395-484c-a89a-c40b059223d3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:14:18.304434 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49e2622-e395-484c-a89a-c40b059223d3 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:14:18.315303 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-d49e2622-e395-484c-a89a-c40b059223d3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 20 22:14:18.315303 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:14:18.315303 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:14:18.315303 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:14:18.315303 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:14:18.315303 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:14:18.315303 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:14:18.315303 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:14:18.315303 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:14:18.315303 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:14:18.315303 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:14:18.315303 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:14:18.315303 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 20 22:14:18.315303 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 20 22:14:18.315303 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 20 22:14:18.315303 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 20 22:14:18.316348 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:14:18.316348 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:14:18.316348 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 20 22:14:18.316348 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 22:14:18.316348 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 20 22:14:18.316348 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 22:14:18.316348 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:14:18.316348 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:14:18.316348 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:14:18.316348 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:14:18.316348 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:14:18.316348 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:14:18.316348 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:14:18.316348 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:14:18.316348 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:14:18.316348 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:14:18.316348 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:14:18.316348 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:14:18.317296 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:14:18.317296 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:14:18.317296 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 20 22:14:18.317296 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 20 22:14:18.317296 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 20 22:14:18.317296 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 20 22:14:18.317296 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 20 22:14:18.317296 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 20 22:14:18.317296 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 20 22:14:18.317296 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:14:18.317296 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 643/1267] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 20 22:14:18 2022] GET /identity/v3/users/placement => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:14:18.322216 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fabbb37-8465-4297-be86-559b78ab8287 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:14:18.417592 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fabbb37-8465-4297-be86-559b78ab8287 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:14:18.450288 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7567de-47a4-4e5c-943a-d986b779a18c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:14:18.450909 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7567de-47a4-4e5c-943a-d986b779a18c None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:14:18.451188 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7567de-47a4-4e5c-943a-d986b779a18c None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:14:18.451461 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7567de-47a4-4e5c-943a-d986b779a18c None admin] PATH_INFO: `/v3/users` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:14:18.452185 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7567de-47a4-4e5c-943a-d986b779a18c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:14:18.452489 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7567de-47a4-4e5c-943a-d986b779a18c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:14:18.453895 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7567de-47a4-4e5c-943a-d986b779a18c None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:14:18.462122 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:14:18.470815 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 625/1268] 10.222.0.33 () {56 vars in 1143 bytes} [Tue Sep 20 22:14:18 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:14:18.476458 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49e2622-e395-484c-a89a-c40b059223d3 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:14:18.573569 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49e2622-e395-484c-a89a-c40b059223d3 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:14:18.606272 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f69bcd-cbc6-4314-b7ca-2d9b03d6bb71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:14:18.606906 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f69bcd-cbc6-4314-b7ca-2d9b03d6bb71 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:14:18.607185 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f69bcd-cbc6-4314-b7ca-2d9b03d6bb71 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:14:18.607455 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f69bcd-cbc6-4314-b7ca-2d9b03d6bb71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:14:18.617469 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f69bcd-cbc6-4314-b7ca-2d9b03d6bb71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:14:18.618921 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f69bcd-cbc6-4314-b7ca-2d9b03d6bb71 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:14:18.634089 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-c7f69bcd-cbc6-4314-b7ca-2d9b03d6bb71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:14:18.634089 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:14:18.634089 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:14:18.634089 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:14:18.634089 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:14:18.634089 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:14:18.634089 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:14:18.634089 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:14:18.634089 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:14:18.634089 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:14:18.634089 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:14:18.634089 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:14:18.634089 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 22:14:18.634089 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 22:14:18.634089 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 22:14:18.634089 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 22:14:18.635194 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:14:18.635194 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:14:18.635194 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:14:18.635194 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:14:18.635194 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:14:18.635194 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:14:18.635194 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:14:18.635194 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:14:18.635194 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:14:18.635194 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:14:18.635194 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:14:18.635194 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:14:18.635194 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:14:18.635194 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:14:18.635194 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:14:18.635194 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:14:18.635194 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 22:14:18.636187 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 22:14:18.636187 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:14:18.636187 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:14:18.636187 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 644/1269] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 20 22:14:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:14:18.641327 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7567de-47a4-4e5c-943a-d986b779a18c None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:14:18.736852 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7567de-47a4-4e5c-943a-d986b779a18c None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:14:18.769937 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679a02dc-eed3-4f84-b03f-d4153e01bbbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:14:18.770541 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a02dc-eed3-4f84-b03f-d4153e01bbbc None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:14:18.770822 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a02dc-eed3-4f84-b03f-d4153e01bbbc None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:14:18.771089 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a02dc-eed3-4f84-b03f-d4153e01bbbc None admin] PATH_INFO: `/v3/domains` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:14:18.771718 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679a02dc-eed3-4f84-b03f-d4153e01bbbc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:14:18.772015 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679a02dc-eed3-4f84-b03f-d4153e01bbbc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:14:18.773367 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679a02dc-eed3-4f84-b03f-d4153e01bbbc None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:14:18.784500 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 626/1270] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 20 22:14:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:14:18.789964 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f69bcd-cbc6-4314-b7ca-2d9b03d6bb71 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:14:18.821275 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:14:18.887849 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f69bcd-cbc6-4314-b7ca-2d9b03d6bb71 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:14:18.920663 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6322f8-9d43-42b2-ba9e-3ac516ecfb8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:14:18.921267 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6322f8-9d43-42b2-ba9e-3ac516ecfb8b None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:14:18.921543 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6322f8-9d43-42b2-ba9e-3ac516ecfb8b None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:14:18.921812 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6322f8-9d43-42b2-ba9e-3ac516ecfb8b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:14:18.928457 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6322f8-9d43-42b2-ba9e-3ac516ecfb8b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:14:18.929879 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6322f8-9d43-42b2-ba9e-3ac516ecfb8b None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:14:18.940797 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-fd6322f8-9d43-42b2-ba9e-3ac516ecfb8b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 22:14:18.940797 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:14:18.940797 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:14:18.940797 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:14:18.940797 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:14:18.940797 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:14:18.940797 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:14:18.940797 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:14:18.940797 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:14:18.940797 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:14:18.940797 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:14:18.940797 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:14:18.940797 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 20 22:14:18.940797 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 20 22:14:18.940797 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 20 22:14:18.941671 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 20 22:14:18.941671 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:14:18.941671 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:14:18.941671 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:14:18.941671 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:14:18.941671 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:14:18.941671 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:14:18.941671 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:14:18.941671 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:14:18.941671 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:14:18.941671 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:14:18.941671 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:14:18.941671 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:14:18.941671 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:14:18.941671 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:14:18.941671 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:14:18.941671 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:14:18.942667 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 20 22:14:18.942667 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 20 22:14:18.942667 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 20 22:14:18.942667 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 20 22:14:18.942667 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 20 22:14:18.942667 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 20 22:14:18.942667 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 22:14:18.942667 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:14:18.942667 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 645/1271] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Sep 20 22:14:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:14:18.947698 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679a02dc-eed3-4f84-b03f-d4153e01bbbc None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:14:19.010741 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:14:19.051725 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679a02dc-eed3-4f84-b03f-d4153e01bbbc None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:14:19.083179 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab9ceca-9aad-49d2-9c62-2c2a4da65388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:14:19.083777 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab9ceca-9aad-49d2-9c62-2c2a4da65388 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:14:19.084053 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab9ceca-9aad-49d2-9c62-2c2a4da65388 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:14:19.084321 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab9ceca-9aad-49d2-9c62-2c2a4da65388 None admin] PATH_INFO: `/v3/projects` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:14:19.084993 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab9ceca-9aad-49d2-9c62-2c2a4da65388 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:14:19.085291 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab9ceca-9aad-49d2-9c62-2c2a4da65388 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:14:19.086723 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab9ceca-9aad-49d2-9c62-2c2a4da65388 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:14:19.098670 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 627/1272] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Sep 20 22:14:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 22:14:19.104709 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6322f8-9d43-42b2-ba9e-3ac516ecfb8b None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:14:19.191512 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:14:19.200269 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6322f8-9d43-42b2-ba9e-3ac516ecfb8b None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:14:19.232692 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df08c18-f886-4433-804c-a2d2b041a6a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:14:19.233326 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df08c18-f886-4433-804c-a2d2b041a6a7 None admin] REQUEST_METHOD: `PUT` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:14:19.233603 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df08c18-f886-4433-804c-a2d2b041a6a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:14:19.233873 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df08c18-f886-4433-804c-a2d2b041a6a7 None admin] PATH_INFO: `/v3/projects/3ce415d02aa9489bae19cd514805fd8c/users/c79676ee86294dab92ba732e38d6fa74/roles/8a829170b29d42d6af589399e51edb0f` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:14:19.235745 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df08c18-f886-4433-804c-a2d2b041a6a7 None admin] RBAC: Authorizing `identity:create_grant(project_id=3ce415d02aa9489bae19cd514805fd8c, user_id=c79676ee86294dab92ba732e38d6fa74, role_id=8a829170b29d42d6af589399e51edb0f)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:14:19.237150 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df08c18-f886-4433-804c-a2d2b041a6a7 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:14:19.248853 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 646/1273] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Sep 20 22:14:19 2022] PUT /identity/v3/projects/3ce415d02aa9489bae19cd514805fd8c/users/c79676ee86294dab92ba732e38d6fa74/roles/8a829170b29d42d6af589399e51edb0f => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:14:21.354933 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cb5030-d96b-44a5-b351-ca1dde2e56ce None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:14:21.355479 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cb5030-d96b-44a5-b351-ca1dde2e56ce None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:14:21.355479 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cb5030-d96b-44a5-b351-ca1dde2e56ce None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:14:21.356794 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 628/1274] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:14:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:14:21.362002 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387523af-3942-4b8b-a910-9e843f00a0c8 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:14:21.362410 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387523af-3942-4b8b-a910-9e843f00a0c8 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:14:21.362568 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387523af-3942-4b8b-a910-9e843f00a0c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:14:21.380657 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-387523af-3942-4b8b-a910-9e843f00a0c8 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:14:21.381817 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-387523af-3942-4b8b-a910-9e843f00a0c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:14:21.445044 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 647/1275] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:14:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 20 22:14:21.710591 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cb5030-d96b-44a5-b351-ca1dde2e56ce None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:14:21.810337 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cb5030-d96b-44a5-b351-ca1dde2e56ce None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:14:21.826731 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:14:21.842865 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b5a0f8-7a14-4213-89a6-24c63a750870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:14:21.843485 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b5a0f8-7a14-4213-89a6-24c63a750870 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:14:21.843763 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b5a0f8-7a14-4213-89a6-24c63a750870 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:14:21.844032 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b5a0f8-7a14-4213-89a6-24c63a750870 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:14:21.853676 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b5a0f8-7a14-4213-89a6-24c63a750870 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 22:14:21.858981 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-84b5a0f8-7a14-4213-89a6-24c63a750870 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 22:14:21.858981 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:14:21.858981 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:14:21.858981 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:14:21.858981 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:14:21.858981 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:14:21.858981 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:14:21.858981 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:14:21.858981 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:14:21.858981 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:14:21.858981 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:14:21.858981 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:14:21.858981 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 22:14:21.858981 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 22:14:21.858981 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 22:14:21.858981 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 22:14:21.860090 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 22:14:21.860090 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 22:14:21.860090 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 22:14:21.860090 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 22:14:21.860090 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:14:21.860090 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:14:21.860090 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:14:21.860090 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:14:21.860090 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:14:21.860090 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:14:21.860090 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:14:21.860090 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:14:21.860090 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:14:21.860090 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:14:21.860090 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:14:21.860090 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:14:21.861115 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:14:21.861115 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:14:21.861115 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:14:21.861115 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:14:21.861115 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 22:14:21.861115 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 22:14:21.861115 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 22:14:21.861115 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 22:14:21.861115 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 22:14:21.861115 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 22:14:21.861115 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 22:14:21.861115 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:14:21.861115 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 629/1276] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Sep 20 22:14:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:14:21.865930 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387523af-3942-4b8b-a910-9e843f00a0c8 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:14:21.943321 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:14:21.963919 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387523af-3942-4b8b-a910-9e843f00a0c8 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:14:22.011112 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e11b4e-9957-4bd4-b8dd-23d1a04ebdf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:14:22.011950 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e11b4e-9957-4bd4-b8dd-23d1a04ebdf3 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:14:22.012374 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e11b4e-9957-4bd4-b8dd-23d1a04ebdf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:14:22.012737 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e11b4e-9957-4bd4-b8dd-23d1a04ebdf3 None admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:14:22.013647 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e11b4e-9957-4bd4-b8dd-23d1a04ebdf3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:14:22.014043 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e11b4e-9957-4bd4-b8dd-23d1a04ebdf3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:14:22.015750 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e11b4e-9957-4bd4-b8dd-23d1a04ebdf3 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:14:22.026203 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 648/1277] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Sep 20 22:14:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:14:22.034071 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b5a0f8-7a14-4213-89a6-24c63a750870 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:14:22.131355 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b5a0f8-7a14-4213-89a6-24c63a750870 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:14:22.164338 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b50cdae-8c23-40a5-8a48-2e7a29f10c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:14:22.164949 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b50cdae-8c23-40a5-8a48-2e7a29f10c29 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:14:22.165226 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b50cdae-8c23-40a5-8a48-2e7a29f10c29 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:14:22.165496 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b50cdae-8c23-40a5-8a48-2e7a29f10c29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:14:22.176062 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b50cdae-8c23-40a5-8a48-2e7a29f10c29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:14:22.177488 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b50cdae-8c23-40a5-8a48-2e7a29f10c29 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:14:22.191577 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-6b50cdae-8c23-40a5-8a48-2e7a29f10c29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:14:22.191577 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:14:22.191577 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:14:22.191577 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:14:22.191577 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:14:22.191577 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:14:22.191577 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:14:22.191577 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:14:22.191577 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:14:22.191577 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:14:22.191577 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:14:22.191577 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:14:22.191577 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 22:14:22.191577 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 22:14:22.191577 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 22:14:22.191577 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 22:14:22.192689 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:14:22.192689 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:14:22.192689 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:14:22.192689 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:14:22.192689 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:14:22.192689 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:14:22.192689 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:14:22.192689 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:14:22.192689 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:14:22.192689 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:14:22.192689 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:14:22.192689 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:14:22.192689 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:14:22.192689 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:14:22.192689 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:14:22.192689 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:14:22.192689 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 22:14:22.193768 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 22:14:22.193768 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:14:22.193768 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:14:22.193768 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 630/1278] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 20 22:14:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:14:22.198453 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e11b4e-9957-4bd4-b8dd-23d1a04ebdf3 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:14:22.295550 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e11b4e-9957-4bd4-b8dd-23d1a04ebdf3 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:14:22.327804 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed30f29-8e98-4ee2-a939-81ee8440d141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:14:22.328390 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed30f29-8e98-4ee2-a939-81ee8440d141 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:14:22.328663 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed30f29-8e98-4ee2-a939-81ee8440d141 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:14:22.328929 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed30f29-8e98-4ee2-a939-81ee8440d141 None admin] PATH_INFO: `/v3/domains` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:14:22.329552 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed30f29-8e98-4ee2-a939-81ee8440d141 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:14:22.329848 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed30f29-8e98-4ee2-a939-81ee8440d141 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:14:22.331223 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed30f29-8e98-4ee2-a939-81ee8440d141 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:14:22.342943 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 649/1279] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 20 22:14:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:14:22.348687 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b50cdae-8c23-40a5-8a48-2e7a29f10c29 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:14:22.378529 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:14:22.445655 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b50cdae-8c23-40a5-8a48-2e7a29f10c29 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:14:22.478257 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b175046d-8cef-42a2-9772-853f44b0c350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:14:22.478897 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b175046d-8cef-42a2-9772-853f44b0c350 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:14:22.479178 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b175046d-8cef-42a2-9772-853f44b0c350 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:14:22.479449 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b175046d-8cef-42a2-9772-853f44b0c350 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:14:22.487266 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b175046d-8cef-42a2-9772-853f44b0c350 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:14:22.488733 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b175046d-8cef-42a2-9772-853f44b0c350 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:14:22.499444 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-b175046d-8cef-42a2-9772-853f44b0c350 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 20 22:14:22.499444 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:14:22.499444 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:14:22.499444 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:14:22.499444 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:14:22.499444 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:14:22.499444 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:14:22.499444 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:14:22.499444 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:14:22.499444 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:14:22.499444 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:14:22.499444 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:14:22.499444 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 20 22:14:22.499444 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 20 22:14:22.499444 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 20 22:14:22.499444 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 20 22:14:22.500572 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:14:22.500572 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:14:22.500572 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 20 22:14:22.500572 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 22:14:22.500572 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 20 22:14:22.500572 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 22:14:22.500572 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:14:22.500572 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:14:22.500572 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:14:22.500572 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:14:22.500572 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:14:22.500572 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:14:22.500572 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:14:22.500572 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:14:22.500572 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:14:22.500572 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:14:22.500572 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:14:22.500572 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:14:22.501750 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:14:22.501750 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:14:22.501750 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 20 22:14:22.501750 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 20 22:14:22.501750 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 20 22:14:22.501750 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 20 22:14:22.501750 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 20 22:14:22.501750 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 20 22:14:22.501750 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 20 22:14:22.501750 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:14:22.501750 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 631/1280] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 20 22:14:22 2022] GET /identity/v3/users/placement => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:14:22.506357 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed30f29-8e98-4ee2-a939-81ee8440d141 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:14:22.510069 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:14:22.602250 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed30f29-8e98-4ee2-a939-81ee8440d141 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:14:22.638057 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2004cecf-914b-4e17-b7ca-fa117b896021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:14:22.638682 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2004cecf-914b-4e17-b7ca-fa117b896021 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:14:22.638960 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2004cecf-914b-4e17-b7ca-fa117b896021 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:14:22.639230 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2004cecf-914b-4e17-b7ca-fa117b896021 None admin] PATH_INFO: `/v3/users` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:14:22.639943 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2004cecf-914b-4e17-b7ca-fa117b896021 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:14:22.640248 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2004cecf-914b-4e17-b7ca-fa117b896021 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:14:22.641667 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2004cecf-914b-4e17-b7ca-fa117b896021 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:14:22.658578 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 650/1281] 10.222.0.33 () {56 vars in 1143 bytes} [Tue Sep 20 22:14:22 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:14:22.664323 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b175046d-8cef-42a2-9772-853f44b0c350 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:14:22.753025 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:14:22.763367 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b175046d-8cef-42a2-9772-853f44b0c350 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:14:22.795292 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9991adbf-f2a4-4520-b532-a337badc1518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:14:22.795887 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9991adbf-f2a4-4520-b532-a337badc1518 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:14:22.796174 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9991adbf-f2a4-4520-b532-a337badc1518 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:14:22.796445 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9991adbf-f2a4-4520-b532-a337badc1518 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:14:22.860878 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9991adbf-f2a4-4520-b532-a337badc1518 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:14:22.862238 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9991adbf-f2a4-4520-b532-a337badc1518 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:14:22.954801 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:14:22.967504 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 632/1282] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Sep 20 22:14:22 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 20 22:14:22.973621 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2004cecf-914b-4e17-b7ca-fa117b896021 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:14:23.034549 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:14:23.073825 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2004cecf-914b-4e17-b7ca-fa117b896021 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:14:23.107674 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df76010-8e85-4d8b-a075-1670c5e9294c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:14:23.108296 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df76010-8e85-4d8b-a075-1670c5e9294c None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:14:23.108572 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df76010-8e85-4d8b-a075-1670c5e9294c None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:14:23.108839 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df76010-8e85-4d8b-a075-1670c5e9294c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:14:23.118705 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df76010-8e85-4d8b-a075-1670c5e9294c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:14:23.120075 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df76010-8e85-4d8b-a075-1670c5e9294c None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:14:23.134265 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-7df76010-8e85-4d8b-a075-1670c5e9294c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:14:23.134265 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:14:23.134265 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:14:23.134265 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:14:23.134265 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:14:23.134265 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:14:23.134265 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:14:23.134265 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:14:23.134265 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:14:23.134265 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:14:23.134265 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:14:23.134265 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:14:23.134265 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 22:14:23.134265 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 22:14:23.134265 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 22:14:23.134265 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 22:14:23.135277 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:14:23.135277 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:14:23.135277 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:14:23.135277 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:14:23.135277 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:14:23.135277 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:14:23.135277 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:14:23.135277 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:14:23.135277 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:14:23.135277 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:14:23.135277 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:14:23.135277 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:14:23.135277 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:14:23.135277 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:14:23.135277 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:14:23.135277 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:14:23.135277 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 22:14:23.136198 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 22:14:23.136198 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 22:14:23.136198 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:14:23.136198 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 651/1283] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 20 22:14:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:14:23.141961 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9991adbf-f2a4-4520-b532-a337badc1518 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:14:23.240874 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9991adbf-f2a4-4520-b532-a337badc1518 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:14:23.274226 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091b68fa-8154-4222-a8f6-3f44a9cf6f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:14:23.274852 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091b68fa-8154-4222-a8f6-3f44a9cf6f00 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:14:23.275146 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091b68fa-8154-4222-a8f6-3f44a9cf6f00 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:14:23.275394 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091b68fa-8154-4222-a8f6-3f44a9cf6f00 None admin] PATH_INFO: `/v3/domains` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:14:23.276030 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091b68fa-8154-4222-a8f6-3f44a9cf6f00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:14:23.276328 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091b68fa-8154-4222-a8f6-3f44a9cf6f00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:14:23.278250 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091b68fa-8154-4222-a8f6-3f44a9cf6f00 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:14:23.289089 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 633/1284] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Sep 20 22:14:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:14:23.294877 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df76010-8e85-4d8b-a075-1670c5e9294c None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:14:23.390864 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df76010-8e85-4d8b-a075-1670c5e9294c None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:14:23.404038 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:14:23.423371 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10b7352-ec5f-46fa-ba84-a6cf1478634c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:14:23.423978 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b7352-ec5f-46fa-ba84-a6cf1478634c None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:14:23.424253 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b7352-ec5f-46fa-ba84-a6cf1478634c None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:14:23.424520 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b7352-ec5f-46fa-ba84-a6cf1478634c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:14:23.431044 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10b7352-ec5f-46fa-ba84-a6cf1478634c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:14:23.432469 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10b7352-ec5f-46fa-ba84-a6cf1478634c None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:14:23.443704 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application [None req-c10b7352-ec5f-46fa-ba84-a6cf1478634c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 22:14:23.443704 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:14:23.443704 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:14:23.443704 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:14:23.443704 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:14:23.443704 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:14:23.443704 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:14:23.443704 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:14:23.443704 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:14:23.443704 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:14:23.443704 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:14:23.443704 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:14:23.443704 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 20 22:14:23.443704 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 20 22:14:23.443704 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 20 22:14:23.444748 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 20 22:14:23.444748 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:14:23.444748 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:14:23.444748 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:14:23.444748 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:14:23.444748 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:14:23.444748 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:14:23.444748 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:14:23.444748 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application with Lock( Sep 20 22:14:23.444748 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:14:23.444748 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:14:23.444748 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:14:23.444748 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:14:23.444748 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:14:23.444748 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:14:23.444748 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:14:23.444748 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:14:23.445835 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 20 22:14:23.445835 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 20 22:14:23.445835 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 20 22:14:23.445835 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 20 22:14:23.445835 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 20 22:14:23.445835 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 20 22:14:23.445835 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 22:14:23.445835 dv-cinder-858276-1-smb devstack@keystone.service[81306]: ERROR keystone.server.flask.application Sep 20 22:14:23.445835 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 652/1285] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Sep 20 22:14:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:14:23.451107 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091b68fa-8154-4222-a8f6-3f44a9cf6f00 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:14:23.498413 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:14:23.546200 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091b68fa-8154-4222-a8f6-3f44a9cf6f00 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:14:23.579513 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84bac38-bae5-4324-a538-a3e9d0cc6797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:14:23.580109 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84bac38-bae5-4324-a538-a3e9d0cc6797 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:14:23.580384 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84bac38-bae5-4324-a538-a3e9d0cc6797 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:14:23.580652 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84bac38-bae5-4324-a538-a3e9d0cc6797 None admin] PATH_INFO: `/v3/projects` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:14:23.581335 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84bac38-bae5-4324-a538-a3e9d0cc6797 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:14:23.581633 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84bac38-bae5-4324-a538-a3e9d0cc6797 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:14:23.583074 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84bac38-bae5-4324-a538-a3e9d0cc6797 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:14:23.595612 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 634/1286] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Sep 20 22:14:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:14:23.602667 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10b7352-ec5f-46fa-ba84-a6cf1478634c None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:14:23.699966 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10b7352-ec5f-46fa-ba84-a6cf1478634c None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:14:23.731821 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d106e44-0022-4d6c-ad03-c5d9c6f73e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:14:23.732406 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d106e44-0022-4d6c-ad03-c5d9c6f73e4e None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:14:23.732684 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d106e44-0022-4d6c-ad03-c5d9c6f73e4e None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:14:23.732957 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d106e44-0022-4d6c-ad03-c5d9c6f73e4e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:14:23.733671 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d106e44-0022-4d6c-ad03-c5d9c6f73e4e None admin] RBAC: Adding query filter params (role.id=8a829170b29d42d6af589399e51edb0f, scope.project.id=3ce415d02aa9489bae19cd514805fd8c, user.id=c79676ee86294dab92ba732e38d6fa74) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:14:23.733977 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d106e44-0022-4d6c-ad03-c5d9c6f73e4e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:14:23.735420 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d106e44-0022-4d6c-ad03-c5d9c6f73e4e None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:14:23.740951 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 653/1287] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Sep 20 22:14:23 2022] GET /identity/v3/role_assignments?user.id=c79676ee86294dab92ba732e38d6fa74&scope.project.id=3ce415d02aa9489bae19cd514805fd8c&role.id=8a829170b29d42d6af589399e51edb0f => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:14:25.855905 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e96bb5c-4444-4fb9-bdc4-64b572f248f4 None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:14:25.856433 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e96bb5c-4444-4fb9-bdc4-64b572f248f4 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:14:25.856433 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e96bb5c-4444-4fb9-bdc4-64b572f248f4 None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:14:25.857762 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 635/1288] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:14:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:14:25.863024 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa7e0a-db0a-4f02-8b11-43ffe2dd629f None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:14:25.863413 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa7e0a-db0a-4f02-8b11-43ffe2dd629f None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:14:25.863564 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa7e0a-db0a-4f02-8b11-43ffe2dd629f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:14:25.881273 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-befa7e0a-db0a-4f02-8b11-43ffe2dd629f None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:14:25.882449 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-befa7e0a-db0a-4f02-8b11-43ffe2dd629f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:14:25.911004 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:14:25.947167 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 654/1289] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:14:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 20 22:14:26.212487 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e96bb5c-4444-4fb9-bdc4-64b572f248f4 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:14:26.311717 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e96bb5c-4444-4fb9-bdc4-64b572f248f4 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:14:26.322736 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:14:26.345931 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109fc05e-d3cd-4b00-9339-719737a832c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:14:26.346579 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109fc05e-d3cd-4b00-9339-719737a832c0 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:14:26.346862 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109fc05e-d3cd-4b00-9339-719737a832c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:14:26.347132 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109fc05e-d3cd-4b00-9339-719737a832c0 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:14:26.347703 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109fc05e-d3cd-4b00-9339-719737a832c0 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:14:26.349061 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109fc05e-d3cd-4b00-9339-719737a832c0 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:14:26.358072 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-109fc05e-d3cd-4b00-9339-719737a832c0 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 20 22:14:26.358072 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:14:26.358072 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 20 22:14:26.358072 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 20 22:14:26.358072 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 20 22:14:26.358072 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 20 22:14:26.358072 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 20 22:14:26.358072 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 20 22:14:26.358072 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 20 22:14:26.358072 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:14:26.358072 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 20 22:14:26.358072 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:14:26.358072 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:14:26.358072 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:14:26.358072 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:14:26.358072 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:14:26.358072 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:14:26.359281 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:14:26.359281 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:14:26.359281 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:14:26.359281 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:14:26.359281 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:14:26.359281 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:14:26.359281 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 20 22:14:26.359281 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 20 22:14:26.359281 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 20 22:14:26.359281 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 20 22:14:26.359281 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:14:26.359281 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:14:26.359281 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:14:26.359281 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:14:26.359281 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:14:26.359281 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:14:26.360297 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:14:26.360297 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:14:26.360297 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:14:26.360297 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:14:26.360297 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:14:26.360297 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:14:26.360297 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:14:26.360297 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:14:26.360297 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:14:26.360297 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:14:26.360297 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 20 22:14:26.360297 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 20 22:14:26.360297 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 20 22:14:26.360297 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:14:26.360297 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 636/1290] 10.222.0.33 () {56 vars in 1117 bytes} [Tue Sep 20 22:14:26 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:14:26.365125 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befa7e0a-db0a-4f02-8b11-43ffe2dd629f None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:14:26.459077 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befa7e0a-db0a-4f02-8b11-43ffe2dd629f None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:14:26.491691 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8f7428-5ae8-45eb-bee5-9731eb51bbdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:14:26.492222 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8f7428-5ae8-45eb-bee5-9731eb51bbdf None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:14:26.492507 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8f7428-5ae8-45eb-bee5-9731eb51bbdf None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:14:26.492776 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8f7428-5ae8-45eb-bee5-9731eb51bbdf None admin] PATH_INFO: `/v3/services` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:14:26.493388 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8f7428-5ae8-45eb-bee5-9731eb51bbdf None admin] RBAC: Adding query filter params (name=placement) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:14:26.493688 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8f7428-5ae8-45eb-bee5-9731eb51bbdf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:14:26.495066 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8f7428-5ae8-45eb-bee5-9731eb51bbdf None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:14:26.499665 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 655/1291] 10.222.0.33 () {56 vars in 1116 bytes} [Tue Sep 20 22:14:26 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:14:26.505061 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109fc05e-d3cd-4b00-9339-719737a832c0 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:14:26.601063 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109fc05e-d3cd-4b00-9339-719737a832c0 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:14:26.633259 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d72327-331d-4a62-9d3f-c411801acd21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:14:26.633844 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d72327-331d-4a62-9d3f-c411801acd21 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:14:26.634123 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d72327-331d-4a62-9d3f-c411801acd21 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:14:26.634396 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d72327-331d-4a62-9d3f-c411801acd21 None admin] PATH_INFO: `/v3/services` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:14:26.635045 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d72327-331d-4a62-9d3f-c411801acd21 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:14:26.635347 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d72327-331d-4a62-9d3f-c411801acd21 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:14:26.636728 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d72327-331d-4a62-9d3f-c411801acd21 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:14:26.640959 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 637/1292] 10.222.0.33 () {56 vars in 1116 bytes} [Tue Sep 20 22:14:26 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:14:28.737186 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9655be16-97da-4a4e-9aa4-dc08d7613772 None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:14:28.737736 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9655be16-97da-4a4e-9aa4-dc08d7613772 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:14:28.737736 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9655be16-97da-4a4e-9aa4-dc08d7613772 None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:14:28.739184 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 656/1293] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:14:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:14:28.744493 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdd532f-424c-4cac-b978-5e5a11681183 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:14:28.744860 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdd532f-424c-4cac-b978-5e5a11681183 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:14:28.745046 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdd532f-424c-4cac-b978-5e5a11681183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:14:28.763883 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-0cdd532f-424c-4cac-b978-5e5a11681183 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:14:28.765057 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-0cdd532f-424c-4cac-b978-5e5a11681183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:14:28.793278 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:14:28.830833 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 638/1294] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:14:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 20 22:14:29.100384 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9655be16-97da-4a4e-9aa4-dc08d7613772 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:14:29.130192 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:14:29.197621 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9655be16-97da-4a4e-9aa4-dc08d7613772 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:14:29.230644 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876da79a-007a-498c-ad0d-5d9a464eb7bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:14:29.231235 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876da79a-007a-498c-ad0d-5d9a464eb7bd None admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:14:29.231512 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876da79a-007a-498c-ad0d-5d9a464eb7bd None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:14:29.231782 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876da79a-007a-498c-ad0d-5d9a464eb7bd None admin] PATH_INFO: `/v3/services` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:14:29.232418 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876da79a-007a-498c-ad0d-5d9a464eb7bd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:14:29.233770 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876da79a-007a-498c-ad0d-5d9a464eb7bd None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:14:29.247220 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 657/1295] 10.222.0.33 () {60 vars in 1141 bytes} [Tue Sep 20 22:14:29 2022] POST /identity/v3/services => generated 246 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:14:31.382076 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da05a90b-b98c-423a-9682-1258b349c042 None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:14:31.382650 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da05a90b-b98c-423a-9682-1258b349c042 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:14:31.382650 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da05a90b-b98c-423a-9682-1258b349c042 None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:14:31.383977 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 639/1296] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:14:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:14:31.389297 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc2e85b-a882-437f-b47c-fe89d3505268 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:14:31.389697 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc2e85b-a882-437f-b47c-fe89d3505268 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:14:31.389846 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc2e85b-a882-437f-b47c-fe89d3505268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:14:31.408105 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-0fc2e85b-a882-437f-b47c-fe89d3505268 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:14:31.409453 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-0fc2e85b-a882-437f-b47c-fe89d3505268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:14:31.479545 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 658/1297] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:14:31 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 20 22:14:31.754843 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da05a90b-b98c-423a-9682-1258b349c042 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:14:31.855148 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da05a90b-b98c-423a-9682-1258b349c042 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:14:31.888371 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5427ed5f-a8d0-46ec-8ed5-39a245755913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:14:31.888988 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5427ed5f-a8d0-46ec-8ed5-39a245755913 None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:14:31.889267 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5427ed5f-a8d0-46ec-8ed5-39a245755913 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:14:31.889537 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5427ed5f-a8d0-46ec-8ed5-39a245755913 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:14:31.890113 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5427ed5f-a8d0-46ec-8ed5-39a245755913 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:14:31.891504 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5427ed5f-a8d0-46ec-8ed5-39a245755913 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:14:31.900024 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-5427ed5f-a8d0-46ec-8ed5-39a245755913 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 20 22:14:31.900024 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:14:31.900024 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 20 22:14:31.900024 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 20 22:14:31.900024 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 20 22:14:31.900024 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 20 22:14:31.900024 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 20 22:14:31.900024 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 20 22:14:31.900024 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 20 22:14:31.900024 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:14:31.900024 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 20 22:14:31.900024 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:14:31.900024 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:14:31.900024 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:14:31.900024 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:14:31.900024 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:14:31.900024 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:14:31.901190 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:14:31.901190 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:14:31.901190 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:14:31.901190 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:14:31.901190 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:14:31.901190 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:14:31.901190 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 20 22:14:31.901190 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 20 22:14:31.901190 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 20 22:14:31.901190 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 20 22:14:31.901190 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:14:31.901190 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:14:31.901190 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:14:31.901190 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:14:31.901190 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:14:31.901190 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:14:31.904007 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:14:31.904007 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:14:31.904007 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:14:31.904007 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:14:31.904007 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:14:31.904007 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:14:31.904007 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:14:31.904007 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:14:31.904007 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:14:31.904007 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:14:31.904007 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 20 22:14:31.904007 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 20 22:14:31.904007 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 20 22:14:31.904007 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:14:31.904007 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 640/1298] 10.222.0.33 () {56 vars in 1117 bytes} [Tue Sep 20 22:14:31 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:14:31.908814 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc2e85b-a882-437f-b47c-fe89d3505268 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:14:31.926989 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:14:32.018776 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc2e85b-a882-437f-b47c-fe89d3505268 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:14:32.052178 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae8ad77-5870-4d4e-8b48-c25e7f5a5ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:14:32.052774 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae8ad77-5870-4d4e-8b48-c25e7f5a5ee0 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:14:32.053050 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae8ad77-5870-4d4e-8b48-c25e7f5a5ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:14:32.053318 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae8ad77-5870-4d4e-8b48-c25e7f5a5ee0 None admin] PATH_INFO: `/v3/services` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:14:32.053938 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae8ad77-5870-4d4e-8b48-c25e7f5a5ee0 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:14:32.054234 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae8ad77-5870-4d4e-8b48-c25e7f5a5ee0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:14:32.055657 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae8ad77-5870-4d4e-8b48-c25e7f5a5ee0 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:14:32.061173 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 659/1299] 10.222.0.33 () {56 vars in 1116 bytes} [Tue Sep 20 22:14:31 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:14:32.067187 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5427ed5f-a8d0-46ec-8ed5-39a245755913 None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:14:32.097635 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:14:32.164447 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5427ed5f-a8d0-46ec-8ed5-39a245755913 None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:14:32.197381 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d2e2da-8c4a-4353-98c6-df70dd22669d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:14:32.197974 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d2e2da-8c4a-4353-98c6-df70dd22669d None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:14:32.198252 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d2e2da-8c4a-4353-98c6-df70dd22669d None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:14:32.198573 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d2e2da-8c4a-4353-98c6-df70dd22669d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:14:32.199272 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d2e2da-8c4a-4353-98c6-df70dd22669d None admin] RBAC: Adding query filter params (interface=public, service_id=71d99d9bed524d80b614a42175b68f2d, region_id=RegionOne) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:14:32.199580 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d2e2da-8c4a-4353-98c6-df70dd22669d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:14:32.200935 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d2e2da-8c4a-4353-98c6-df70dd22669d None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:14:32.205735 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 641/1300] 10.222.0.33 () {56 vars in 1251 bytes} [Tue Sep 20 22:14:32 2022] GET /identity/v3/endpoints?service_id=71d99d9bed524d80b614a42175b68f2d&interface=public®ion_id=RegionOne => generated 194 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:14:32.211319 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae8ad77-5870-4d4e-8b48-c25e7f5a5ee0 None admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:14:32.295830 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:14:32.314162 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae8ad77-5870-4d4e-8b48-c25e7f5a5ee0 None admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:14:32.345878 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea5d1be-3924-4a98-94eb-a1163bc33322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:14:32.346465 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5d1be-3924-4a98-94eb-a1163bc33322 None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:14:32.346770 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5d1be-3924-4a98-94eb-a1163bc33322 None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:14:32.347050 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5d1be-3924-4a98-94eb-a1163bc33322 None admin] PATH_INFO: `/v3/services` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:14:32.347647 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea5d1be-3924-4a98-94eb-a1163bc33322 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:14:32.348993 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea5d1be-3924-4a98-94eb-a1163bc33322 None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:14:32.356048 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 660/1301] 10.222.0.33 () {56 vars in 1087 bytes} [Tue Sep 20 22:14:32 2022] GET /identity/v3/services => generated 2191 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 20 22:14:34.491354 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb3c318-84c5-4051-9f24-fed05950e100 None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:14:34.491897 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb3c318-84c5-4051-9f24-fed05950e100 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:14:34.491897 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb3c318-84c5-4051-9f24-fed05950e100 None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:14:34.493241 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 642/1302] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:14:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:14:34.498927 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492fe959-eef3-4665-8f08-7d309b2c8d80 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:14:34.499330 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492fe959-eef3-4665-8f08-7d309b2c8d80 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:14:34.499479 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492fe959-eef3-4665-8f08-7d309b2c8d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:14:34.517628 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-492fe959-eef3-4665-8f08-7d309b2c8d80 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:14:34.518918 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-492fe959-eef3-4665-8f08-7d309b2c8d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:14:34.583590 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 661/1303] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:14:34 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 20 22:14:34.846278 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb3c318-84c5-4051-9f24-fed05950e100 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:14:34.938035 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:14:34.945004 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb3c318-84c5-4051-9f24-fed05950e100 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:14:34.980475 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe9c570-d52d-428a-a677-eca8984cd6fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:14:34.981096 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe9c570-d52d-428a-a677-eca8984cd6fb None admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:14:34.981375 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe9c570-d52d-428a-a677-eca8984cd6fb None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:14:34.981646 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe9c570-d52d-428a-a677-eca8984cd6fb None admin] PATH_INFO: `/v3/services/placement` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:14:34.982223 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe9c570-d52d-428a-a677-eca8984cd6fb None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:14:34.983613 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe9c570-d52d-428a-a677-eca8984cd6fb None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:14:34.992208 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application [None req-cfe9c570-d52d-428a-a677-eca8984cd6fb None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 20 22:14:34.992208 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:14:34.992208 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 20 22:14:34.992208 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 20 22:14:34.992208 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 20 22:14:34.992208 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 20 22:14:34.992208 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 20 22:14:34.992208 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 20 22:14:34.992208 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 20 22:14:34.992208 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:14:34.992208 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 20 22:14:34.992208 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:14:34.992208 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 22:14:34.992208 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 22:14:34.992208 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 22:14:34.992208 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 22:14:34.992208 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 22:14:34.993353 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 22:14:34.993353 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 22:14:34.993353 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 22:14:34.993353 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 22:14:34.993353 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 22:14:34.993353 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 22:14:34.993353 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 20 22:14:34.993353 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 20 22:14:34.993353 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 20 22:14:34.993353 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 20 22:14:34.993353 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 22:14:34.993353 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 22:14:34.993353 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 22:14:34.993353 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 22:14:34.993353 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 22:14:34.993353 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 22:14:34.994227 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 22:14:34.994227 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application with Lock( Sep 20 22:14:34.994227 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 22:14:34.994227 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self._enter() Sep 20 22:14:34.994227 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 22:14:34.994227 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 22:14:34.994227 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 22:14:34.994227 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application return self.creator() Sep 20 22:14:34.994227 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 22:14:34.994227 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application created_value = creator( Sep 20 22:14:34.994227 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 20 22:14:34.994227 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 20 22:14:34.994227 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 20 22:14:34.994227 dv-cinder-858276-1-smb devstack@keystone.service[81307]: ERROR keystone.server.flask.application Sep 20 22:14:34.994227 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 643/1304] 10.222.0.33 () {56 vars in 1117 bytes} [Tue Sep 20 22:14:34 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 22:14:34.999287 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492fe959-eef3-4665-8f08-7d309b2c8d80 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:14:35.072048 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:14:35.095540 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492fe959-eef3-4665-8f08-7d309b2c8d80 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:14:35.127373 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e944b0-7fbb-427a-8964-2992c0b9683b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:14:35.127903 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e944b0-7fbb-427a-8964-2992c0b9683b None admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:14:35.128178 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e944b0-7fbb-427a-8964-2992c0b9683b None admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:14:35.128447 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e944b0-7fbb-427a-8964-2992c0b9683b None admin] PATH_INFO: `/v3/services` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:14:35.129061 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e944b0-7fbb-427a-8964-2992c0b9683b None admin] RBAC: Adding query filter params (name=placement) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:14:35.129361 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e944b0-7fbb-427a-8964-2992c0b9683b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:14:35.130735 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e944b0-7fbb-427a-8964-2992c0b9683b None admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:14:35.135618 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 662/1305] 10.222.0.33 () {56 vars in 1116 bytes} [Tue Sep 20 22:14:34 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 22:14:35.141827 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe9c570-d52d-428a-a677-eca8984cd6fb None admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:14:35.241134 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe9c570-d52d-428a-a677-eca8984cd6fb None admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:14:35.273883 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72893375-3746-48be-ac8a-b918631062b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:14:35.274490 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72893375-3746-48be-ac8a-b918631062b2 None admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:14:35.274810 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72893375-3746-48be-ac8a-b918631062b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:14:35.275084 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72893375-3746-48be-ac8a-b918631062b2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:14:35.275742 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72893375-3746-48be-ac8a-b918631062b2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:14:35.277696 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72893375-3746-48be-ac8a-b918631062b2 None admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:14:35.298316 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 644/1306] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 20 22:14:35 2022] POST /identity/v3/endpoints => generated 331 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:14:45.132742 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=30 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:14:45.292905 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:15:38.741270 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40793931-f9a0-46db-8b83-6a3825e76b34 None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:15:38.741270 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40793931-f9a0-46db-8b83-6a3825e76b34 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:15:38.741777 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40793931-f9a0-46db-8b83-6a3825e76b34 None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:15:38.743051 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 663/1307] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:15:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 20 22:15:38.748253 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c0a4c-7bcc-4a97-bab7-bf3fbee0317f None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:15:38.748690 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c0a4c-7bcc-4a97-bab7-bf3fbee0317f None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:15:38.748786 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c0a4c-7bcc-4a97-bab7-bf3fbee0317f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:15:38.839534 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-ac3c0a4c-7bcc-4a97-bab7-bf3fbee0317f None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:15:38.841105 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-ac3c0a4c-7bcc-4a97-bab7-bf3fbee0317f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:15:39.023056 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 645/1308] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:15:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:15:39.352145 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a0f00b-1e1d-42a3-98fb-c1b7a5ac57a2 None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:15:39.352674 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a0f00b-1e1d-42a3-98fb-c1b7a5ac57a2 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:15:39.353265 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a0f00b-1e1d-42a3-98fb-c1b7a5ac57a2 None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:15:39.355918 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 664/1309] 10.222.0.33 () {54 vars in 963 bytes} [Tue Sep 20 22:15:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:15:39.364592 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac79e25d-ca2e-4a0f-88ff-d38a130f373f None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:15:39.364882 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac79e25d-ca2e-4a0f-88ff-d38a130f373f None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:15:39.365159 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac79e25d-ca2e-4a0f-88ff-d38a130f373f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:15:39.451291 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-ac79e25d-ca2e-4a0f-88ff-d38a130f373f None None] MFA Rules not processed for user `e9b0b3ca4ecd41aaba9cf8e0f91fbf54`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:15:39.452657 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-ac79e25d-ca2e-4a0f-88ff-d38a130f373f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:15:39.477371 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:15:39.540999 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 646/1310] 10.222.0.33 () {58 vars in 1060 bytes} [Tue Sep 20 22:15:39 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:15:39.551164 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a0f00b-1e1d-42a3-98fb-c1b7a5ac57a2 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:15:39.553194 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-b3a0f00b-1e1d-42a3-98fb-c1b7a5ac57a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:15:39.697968 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a0f00b-1e1d-42a3-98fb-c1b7a5ac57a2 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:15:39.792733 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f295e922-53ae-489d-b65c-f930e0bcd12c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b0b3ca4ecd41aaba9cf8e0f91fbf54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:15:39.793223 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f295e922-53ae-489d-b65c-f930e0bcd12c service neutron] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:15:39.793223 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f295e922-53ae-489d-b65c-f930e0bcd12c service neutron] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:15:39.793615 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f295e922-53ae-489d-b65c-f930e0bcd12c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:15:39.795294 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-f295e922-53ae-489d-b65c-f930e0bcd12c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:15:39.860247 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:15:39.929005 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f295e922-53ae-489d-b65c-f930e0bcd12c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:15:39.930682 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f295e922-53ae-489d-b65c-f930e0bcd12c service neutron] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:15:39.951571 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 665/1311] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:15:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:15:42.476080 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c3ab0a-c0e4-4f9c-8ae0-1adcf4985820 None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:15:42.476660 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c3ab0a-c0e4-4f9c-8ae0-1adcf4985820 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:15:42.476660 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c3ab0a-c0e4-4f9c-8ae0-1adcf4985820 None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:15:42.477983 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 647/1312] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:15:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:15:42.483166 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d273afa5-4912-4b10-8498-f1b4d10bfb02 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:15:42.483593 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d273afa5-4912-4b10-8498-f1b4d10bfb02 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:15:42.483712 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d273afa5-4912-4b10-8498-f1b4d10bfb02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:15:42.566027 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-d273afa5-4912-4b10-8498-f1b4d10bfb02 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:15:42.567195 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-d273afa5-4912-4b10-8498-f1b4d10bfb02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:15:42.662009 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 666/1313] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:15:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:15:42.944676 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c3ab0a-c0e4-4f9c-8ae0-1adcf4985820 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:15:42.946218 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-b7c3ab0a-c0e4-4f9c-8ae0-1adcf4985820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:15:43.048276 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c3ab0a-c0e4-4f9c-8ae0-1adcf4985820 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:15:43.121844 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:15:43.124238 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bd96ea-b83d-4202-ab4c-bbe159580725 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b0b3ca4ecd41aaba9cf8e0f91fbf54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:15:43.125025 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bd96ea-b83d-4202-ab4c-bbe159580725 service neutron] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:15:43.125499 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bd96ea-b83d-4202-ab4c-bbe159580725 service neutron] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:15:43.125819 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bd96ea-b83d-4202-ab4c-bbe159580725 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:15:43.127701 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-b0bd96ea-b83d-4202-ab4c-bbe159580725 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:15:43.234364 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bd96ea-b83d-4202-ab4c-bbe159580725 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:15:43.235740 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bd96ea-b83d-4202-ab4c-bbe159580725 service neutron] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:15:43.253058 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 648/1314] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:15:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:15:45.684406 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649ad67a-60ce-42e5-a168-2dc368051891 None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:15:45.684957 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649ad67a-60ce-42e5-a168-2dc368051891 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:15:45.684957 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649ad67a-60ce-42e5-a168-2dc368051891 None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:15:45.686333 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 667/1315] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:15:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:15:45.691601 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccfc723-e9a4-4eac-869a-9644b20fe0e4 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:15:45.692022 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccfc723-e9a4-4eac-869a-9644b20fe0e4 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:15:45.692125 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccfc723-e9a4-4eac-869a-9644b20fe0e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:15:45.756565 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-4ccfc723-e9a4-4eac-869a-9644b20fe0e4 None None] MFA Rules not processed for user `353bf7be83974c0e8e94f1044be36966`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:15:45.757755 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-4ccfc723-e9a4-4eac-869a-9644b20fe0e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:15:45.808632 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:15:45.852049 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 649/1316] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:15:45 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:15:46.141961 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649ad67a-60ce-42e5-a168-2dc368051891 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:15:46.143543 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-649ad67a-60ce-42e5-a168-2dc368051891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:15:46.153657 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:15:46.246124 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649ad67a-60ce-42e5-a168-2dc368051891 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:15:46.320314 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e761f0-6a47-486f-8952-26f2ec3d79c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b0b3ca4ecd41aaba9cf8e0f91fbf54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:15:46.320923 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e761f0-6a47-486f-8952-26f2ec3d79c5 service neutron] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:15:46.321202 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e761f0-6a47-486f-8952-26f2ec3d79c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:15:46.321473 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e761f0-6a47-486f-8952-26f2ec3d79c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:15:46.323122 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-97e761f0-6a47-486f-8952-26f2ec3d79c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:15:46.385034 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:15:46.433077 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e761f0-6a47-486f-8952-26f2ec3d79c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:15:46.434447 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e761f0-6a47-486f-8952-26f2ec3d79c5 service neutron] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:15:46.452591 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 668/1317] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:15:46 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:15:49.111785 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87333cf-53a8-4217-a7a6-ae07d9fde72e None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:15:49.112356 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87333cf-53a8-4217-a7a6-ae07d9fde72e None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:15:49.112356 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87333cf-53a8-4217-a7a6-ae07d9fde72e None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:15:49.113677 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 650/1318] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:15:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:15:49.120534 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3122d30f-6a7b-4d58-a82b-38208d9e065d None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:15:49.120944 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3122d30f-6a7b-4d58-a82b-38208d9e065d None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:15:49.121085 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3122d30f-6a7b-4d58-a82b-38208d9e065d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:15:49.185481 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-3122d30f-6a7b-4d58-a82b-38208d9e065d None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:15:49.186717 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-3122d30f-6a7b-4d58-a82b-38208d9e065d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:15:49.281323 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 669/1319] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:15:49 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 22:15:49.568415 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87333cf-53a8-4217-a7a6-ae07d9fde72e None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:15:49.569958 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-d87333cf-53a8-4217-a7a6-ae07d9fde72e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:15:49.672384 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87333cf-53a8-4217-a7a6-ae07d9fde72e None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:15:49.744680 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad019732-ffd0-48f8-8b24-8cdca27556a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b0b3ca4ecd41aaba9cf8e0f91fbf54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:15:49.745277 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad019732-ffd0-48f8-8b24-8cdca27556a6 service neutron] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:15:49.745559 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad019732-ffd0-48f8-8b24-8cdca27556a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:15:49.745830 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad019732-ffd0-48f8-8b24-8cdca27556a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:15:49.747446 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-ad019732-ffd0-48f8-8b24-8cdca27556a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:15:49.754302 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:15:49.854987 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad019732-ffd0-48f8-8b24-8cdca27556a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:15:49.856424 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad019732-ffd0-48f8-8b24-8cdca27556a6 service neutron] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:15:49.873894 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 651/1320] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:15:49 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:15:52.678940 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a330e1f-19cc-43c6-b461-a5a027a201be None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:15:52.679501 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a330e1f-19cc-43c6-b461-a5a027a201be None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:15:52.679501 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a330e1f-19cc-43c6-b461-a5a027a201be None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:15:52.682418 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 670/1321] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:15:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:15:52.686527 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b07df1-861b-4666-9505-ffc2592496f4 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:15:52.687043 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b07df1-861b-4666-9505-ffc2592496f4 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:15:52.687147 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b07df1-861b-4666-9505-ffc2592496f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:15:52.759232 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-76b07df1-861b-4666-9505-ffc2592496f4 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:15:52.760468 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-76b07df1-861b-4666-9505-ffc2592496f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:15:52.821695 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:15:52.863245 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 652/1322] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:15:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:15:53.151345 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a330e1f-19cc-43c6-b461-a5a027a201be None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:15:53.152886 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-8a330e1f-19cc-43c6-b461-a5a027a201be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:15:53.172634 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:15:53.255230 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a330e1f-19cc-43c6-b461-a5a027a201be None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:15:53.330295 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bf6654-f210-4a15-8e30-3f21f2cdbfa9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b0b3ca4ecd41aaba9cf8e0f91fbf54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:15:53.330923 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bf6654-f210-4a15-8e30-3f21f2cdbfa9 service neutron] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:15:53.331233 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bf6654-f210-4a15-8e30-3f21f2cdbfa9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:15:53.331510 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bf6654-f210-4a15-8e30-3f21f2cdbfa9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:15:53.333123 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-26bf6654-f210-4a15-8e30-3f21f2cdbfa9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:15:53.405929 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:15:53.446187 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bf6654-f210-4a15-8e30-3f21f2cdbfa9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:15:53.447672 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bf6654-f210-4a15-8e30-3f21f2cdbfa9 service neutron] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:15:53.465237 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 671/1323] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:15:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:15:55.666759 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e260ba82-baae-4aab-9dc9-d2e5aeffdeac None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:15:55.667287 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e260ba82-baae-4aab-9dc9-d2e5aeffdeac None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:15:55.667287 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e260ba82-baae-4aab-9dc9-d2e5aeffdeac None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:15:55.668815 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 653/1324] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:15:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:15:55.674031 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba9d99-c4f1-4f5e-9061-c7013c5a7aaf None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:15:55.674406 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba9d99-c4f1-4f5e-9061-c7013c5a7aaf None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:15:55.674601 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba9d99-c4f1-4f5e-9061-c7013c5a7aaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:15:55.740206 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-19ba9d99-c4f1-4f5e-9061-c7013c5a7aaf None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:15:55.741410 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-19ba9d99-c4f1-4f5e-9061-c7013c5a7aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:15:55.845882 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 672/1325] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:15:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:15:56.133369 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e260ba82-baae-4aab-9dc9-d2e5aeffdeac None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:15:56.134937 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-e260ba82-baae-4aab-9dc9-d2e5aeffdeac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:15:56.237369 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e260ba82-baae-4aab-9dc9-d2e5aeffdeac None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:15:56.315033 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c760a6ab-bfb8-480b-9b4a-ef956fa30cee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b0b3ca4ecd41aaba9cf8e0f91fbf54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:15:56.315645 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c760a6ab-bfb8-480b-9b4a-ef956fa30cee service neutron] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:15:56.315923 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c760a6ab-bfb8-480b-9b4a-ef956fa30cee service neutron] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:15:56.316194 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c760a6ab-bfb8-480b-9b4a-ef956fa30cee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:15:56.318328 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-c760a6ab-bfb8-480b-9b4a-ef956fa30cee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:15:56.337213 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:15:56.430177 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c760a6ab-bfb8-480b-9b4a-ef956fa30cee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:15:56.431566 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c760a6ab-bfb8-480b-9b4a-ef956fa30cee service neutron] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:15:56.449662 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 654/1326] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:15:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:15:58.651398 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1866be70-fe93-4dbd-8f75-f78d039483ce None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:15:58.651879 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1866be70-fe93-4dbd-8f75-f78d039483ce None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:15:58.651992 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1866be70-fe93-4dbd-8f75-f78d039483ce None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:15:58.653493 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 673/1327] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:15:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:15:58.658991 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b115935b-6eec-4cd0-b895-5f2d1d418c87 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:15:58.659376 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b115935b-6eec-4cd0-b895-5f2d1d418c87 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:15:58.659536 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b115935b-6eec-4cd0-b895-5f2d1d418c87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:15:58.729539 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-b115935b-6eec-4cd0-b895-5f2d1d418c87 None None] MFA Rules not processed for user `353bf7be83974c0e8e94f1044be36966`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:15:58.730726 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-b115935b-6eec-4cd0-b895-5f2d1d418c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:15:58.803564 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:15:58.837387 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 655/1328] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:15:58 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:15:59.123838 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1866be70-fe93-4dbd-8f75-f78d039483ce None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:15:59.125405 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-1866be70-fe93-4dbd-8f75-f78d039483ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:15:59.157302 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:15:59.236188 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1866be70-fe93-4dbd-8f75-f78d039483ce None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:15:59.315631 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45a1d31-8c39-4611-9fb2-6391203e7d10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b0b3ca4ecd41aaba9cf8e0f91fbf54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:15:59.316239 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45a1d31-8c39-4611-9fb2-6391203e7d10 service neutron] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:15:59.316518 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45a1d31-8c39-4611-9fb2-6391203e7d10 service neutron] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:15:59.316792 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45a1d31-8c39-4611-9fb2-6391203e7d10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:15:59.318454 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-e45a1d31-8c39-4611-9fb2-6391203e7d10 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:15:59.395969 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:15:59.429384 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45a1d31-8c39-4611-9fb2-6391203e7d10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:15:59.430865 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45a1d31-8c39-4611-9fb2-6391203e7d10 service neutron] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:15:59.448976 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 674/1329] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:15:59 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:16:01.839111 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a042cd-7284-4a32-9e4f-4e1557ceb84b None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:16:01.839649 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a042cd-7284-4a32-9e4f-4e1557ceb84b None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:16:01.839649 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a042cd-7284-4a32-9e4f-4e1557ceb84b None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:16:01.840997 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 656/1330] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:16:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:16:01.846117 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ffee28-ead9-4b17-9d22-2703b34b68b4 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:16:01.846559 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ffee28-ead9-4b17-9d22-2703b34b68b4 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:16:01.846696 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ffee28-ead9-4b17-9d22-2703b34b68b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:16:01.911163 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-f4ffee28-ead9-4b17-9d22-2703b34b68b4 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:16:01.912368 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-f4ffee28-ead9-4b17-9d22-2703b34b68b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:16:02.010405 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 675/1331] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:16:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:16:02.294772 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a042cd-7284-4a32-9e4f-4e1557ceb84b None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:16:02.296609 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-03a042cd-7284-4a32-9e4f-4e1557ceb84b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:16:02.397226 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a042cd-7284-4a32-9e4f-4e1557ceb84b None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:16:02.470378 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef56ab5-958c-42d7-ad8d-5ac7d7e198dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b0b3ca4ecd41aaba9cf8e0f91fbf54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:16:02.471010 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef56ab5-958c-42d7-ad8d-5ac7d7e198dc service neutron] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:16:02.471289 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef56ab5-958c-42d7-ad8d-5ac7d7e198dc service neutron] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:16:02.471559 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef56ab5-958c-42d7-ad8d-5ac7d7e198dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:16:02.473150 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-fef56ab5-958c-42d7-ad8d-5ac7d7e198dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:16:02.499908 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:16:02.581367 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef56ab5-958c-42d7-ad8d-5ac7d7e198dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:16:02.583294 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef56ab5-958c-42d7-ad8d-5ac7d7e198dc service neutron] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:16:02.601609 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 657/1332] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:16:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:16:04.774659 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a63c29-0dd1-4c15-8097-8e18cfdbaef1 None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:16:04.775220 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a63c29-0dd1-4c15-8097-8e18cfdbaef1 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:16:04.775220 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a63c29-0dd1-4c15-8097-8e18cfdbaef1 None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:16:04.776629 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 676/1333] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:16:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:16:04.781933 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596f75a-1cb8-4c6b-a0f9-7d7ea9781102 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:16:04.782323 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596f75a-1cb8-4c6b-a0f9-7d7ea9781102 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:16:04.782489 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596f75a-1cb8-4c6b-a0f9-7d7ea9781102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:16:04.847369 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-d596f75a-1cb8-4c6b-a0f9-7d7ea9781102 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:16:04.848576 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-d596f75a-1cb8-4c6b-a0f9-7d7ea9781102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:16:04.921325 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:16:04.944628 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 658/1334] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:16:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:16:05.229292 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a63c29-0dd1-4c15-8097-8e18cfdbaef1 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:16:05.230872 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-d8a63c29-0dd1-4c15-8097-8e18cfdbaef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:16:05.271856 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:16:05.335499 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a63c29-0dd1-4c15-8097-8e18cfdbaef1 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:16:05.407479 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022456c6-3cee-4051-99d1-3352d931cebe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b0b3ca4ecd41aaba9cf8e0f91fbf54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:16:05.408082 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022456c6-3cee-4051-99d1-3352d931cebe service neutron] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:16:05.408369 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022456c6-3cee-4051-99d1-3352d931cebe service neutron] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:16:05.408639 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022456c6-3cee-4051-99d1-3352d931cebe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:16:05.410229 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-022456c6-3cee-4051-99d1-3352d931cebe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:16:05.495825 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:16:05.518283 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022456c6-3cee-4051-99d1-3352d931cebe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:16:05.519753 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022456c6-3cee-4051-99d1-3352d931cebe service neutron] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:16:05.538839 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 677/1335] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:16:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:16:07.991035 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c652efe-8084-4693-9f17-8da1423a7039 None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:16:07.991545 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c652efe-8084-4693-9f17-8da1423a7039 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:16:07.991903 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c652efe-8084-4693-9f17-8da1423a7039 None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:16:07.993736 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 659/1336] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:16:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:16:07.998953 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e57067-2886-4fa2-9c91-23d1047a35af None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:16:07.999387 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e57067-2886-4fa2-9c91-23d1047a35af None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:16:07.999501 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e57067-2886-4fa2-9c91-23d1047a35af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:16:08.065068 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-71e57067-2886-4fa2-9c91-23d1047a35af None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:16:08.066276 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-71e57067-2886-4fa2-9c91-23d1047a35af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:16:08.159951 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 678/1337] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:16:07 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:16:08.438840 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c652efe-8084-4693-9f17-8da1423a7039 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:16:08.440376 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-2c652efe-8084-4693-9f17-8da1423a7039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:16:08.541756 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c652efe-8084-4693-9f17-8da1423a7039 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:16:08.612794 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9300ab9-99ba-4e42-b9b1-d0cf555553b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b0b3ca4ecd41aaba9cf8e0f91fbf54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:16:08.613392 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9300ab9-99ba-4e42-b9b1-d0cf555553b8 service neutron] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:16:08.613666 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9300ab9-99ba-4e42-b9b1-d0cf555553b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:16:08.613930 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9300ab9-99ba-4e42-b9b1-d0cf555553b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:16:08.616176 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-e9300ab9-99ba-4e42-b9b1-d0cf555553b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:16:08.651522 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:16:08.723250 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9300ab9-99ba-4e42-b9b1-d0cf555553b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:16:08.724744 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9300ab9-99ba-4e42-b9b1-d0cf555553b8 service neutron] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:16:08.742897 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 660/1338] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:16:08 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:16:12.817776 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dccb72-64ef-4ef9-998f-4be7ab4bbd22 None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:16:12.818348 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dccb72-64ef-4ef9-998f-4be7ab4bbd22 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:16:12.818348 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dccb72-64ef-4ef9-998f-4be7ab4bbd22 None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:16:12.819660 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 679/1339] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:16:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:16:12.824821 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18484c8e-7bb3-45bb-b5fa-bb75c4a70189 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:16:12.825241 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18484c8e-7bb3-45bb-b5fa-bb75c4a70189 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:16:12.825526 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18484c8e-7bb3-45bb-b5fa-bb75c4a70189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:16:12.891950 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-18484c8e-7bb3-45bb-b5fa-bb75c4a70189 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:16:12.893199 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-18484c8e-7bb3-45bb-b5fa-bb75c4a70189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:16:12.981568 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:16:12.993148 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 661/1340] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:16:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:16:13.275714 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dccb72-64ef-4ef9-998f-4be7ab4bbd22 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:16:13.277341 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-b0dccb72-64ef-4ef9-998f-4be7ab4bbd22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:16:13.327426 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:16:13.384228 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dccb72-64ef-4ef9-998f-4be7ab4bbd22 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:16:13.460012 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070bb004-774c-4b44-9ca8-d1a4effde55e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b0b3ca4ecd41aaba9cf8e0f91fbf54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:16:13.460621 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070bb004-774c-4b44-9ca8-d1a4effde55e service neutron] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:16:13.460896 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070bb004-774c-4b44-9ca8-d1a4effde55e service neutron] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:16:13.461160 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070bb004-774c-4b44-9ca8-d1a4effde55e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:16:13.462818 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-070bb004-774c-4b44-9ca8-d1a4effde55e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:16:13.554451 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:16:13.572259 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070bb004-774c-4b44-9ca8-d1a4effde55e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:16:13.573700 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070bb004-774c-4b44-9ca8-d1a4effde55e service neutron] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:16:13.592199 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 680/1341] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:16:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:16:16.436802 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6245df37-2cad-4fcc-8548-7dfd67652d0b None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:16:16.437350 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6245df37-2cad-4fcc-8548-7dfd67652d0b None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:16:16.437350 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6245df37-2cad-4fcc-8548-7dfd67652d0b None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:16:16.438714 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 662/1342] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:16:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:16:16.444597 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b633303-7cde-455f-873d-27ae99181e2d None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:16:16.445049 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b633303-7cde-455f-873d-27ae99181e2d None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:16:16.445269 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b633303-7cde-455f-873d-27ae99181e2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:16:16.511787 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-0b633303-7cde-455f-873d-27ae99181e2d None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:16:16.513003 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-0b633303-7cde-455f-873d-27ae99181e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:16:16.613100 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 681/1343] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:16:16 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 22:16:16.899991 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6245df37-2cad-4fcc-8548-7dfd67652d0b None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:16:16.901543 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-6245df37-2cad-4fcc-8548-7dfd67652d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:16:17.008374 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6245df37-2cad-4fcc-8548-7dfd67652d0b None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:16:17.082187 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3bed02-4ce4-43f5-a2c5-ca17a0a454e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b0b3ca4ecd41aaba9cf8e0f91fbf54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:16:17.082832 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3bed02-4ce4-43f5-a2c5-ca17a0a454e5 service neutron] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:16:17.083128 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3bed02-4ce4-43f5-a2c5-ca17a0a454e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:16:17.083399 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3bed02-4ce4-43f5-a2c5-ca17a0a454e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:16:17.085038 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-fb3bed02-4ce4-43f5-a2c5-ca17a0a454e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:16:17.130980 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:16:17.199808 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3bed02-4ce4-43f5-a2c5-ca17a0a454e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:16:17.201250 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3bed02-4ce4-43f5-a2c5-ca17a0a454e5 service neutron] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:16:17.219953 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 663/1344] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:16:16 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:16:21.369051 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8dbb30-cba7-42c3-b2e0-ccdc3a02c512 None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:16:21.369535 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8dbb30-cba7-42c3-b2e0-ccdc3a02c512 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:16:21.369647 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8dbb30-cba7-42c3-b2e0-ccdc3a02c512 None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:16:21.370984 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 682/1345] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:16:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:16:21.376072 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c6bd54-7e4e-4252-8dfb-1650a417dacd None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:16:21.376452 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c6bd54-7e4e-4252-8dfb-1650a417dacd None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:16:21.376616 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c6bd54-7e4e-4252-8dfb-1650a417dacd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:16:21.442015 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-45c6bd54-7e4e-4252-8dfb-1650a417dacd None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:16:21.443886 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-45c6bd54-7e4e-4252-8dfb-1650a417dacd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:16:21.534634 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:16:21.537718 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 664/1346] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:16:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:16:21.824282 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8dbb30-cba7-42c3-b2e0-ccdc3a02c512 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:16:21.825835 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-3f8dbb30-cba7-42c3-b2e0-ccdc3a02c512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:16:21.883068 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:16:21.929259 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8dbb30-cba7-42c3-b2e0-ccdc3a02c512 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:16:22.003099 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7cd2c5-a746-402d-983e-a2447323d856 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b0b3ca4ecd41aaba9cf8e0f91fbf54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:16:22.003696 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7cd2c5-a746-402d-983e-a2447323d856 service neutron] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:16:22.003972 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7cd2c5-a746-402d-983e-a2447323d856 service neutron] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:16:22.004239 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7cd2c5-a746-402d-983e-a2447323d856 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:16:22.005828 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-3d7cd2c5-a746-402d-983e-a2447323d856 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:16:22.109680 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:16:22.113906 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7cd2c5-a746-402d-983e-a2447323d856 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:16:22.115409 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7cd2c5-a746-402d-983e-a2447323d856 service neutron] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:16:22.135266 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 683/1347] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:16:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:16:27.041743 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09499f54-f6de-4111-82b3-2c4fd145ed11 None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:16:27.042197 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09499f54-f6de-4111-82b3-2c4fd145ed11 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:16:27.042296 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09499f54-f6de-4111-82b3-2c4fd145ed11 None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:16:27.043981 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 665/1348] 10.222.0.33 () {54 vars in 921 bytes} [Tue Sep 20 22:16:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:16:27.049730 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48f1b9-9a04-4404-bfac-56a016934f93 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:16:27.050124 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48f1b9-9a04-4404-bfac-56a016934f93 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:16:27.050124 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48f1b9-9a04-4404-bfac-56a016934f93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:16:27.146820 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-8b48f1b9-9a04-4404-bfac-56a016934f93 None None] MFA Rules not processed for user `c79676ee86294dab92ba732e38d6fa74`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:16:27.148186 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-8b48f1b9-9a04-4404-bfac-56a016934f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:16:27.312208 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 684/1349] 10.222.0.33 () {58 vars in 1018 bytes} [Tue Sep 20 22:16:27 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 22:16:31.571850 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea7e763-3602-42bb-972b-0d26785af5f1 None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:16:31.572367 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea7e763-3602-42bb-972b-0d26785af5f1 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:16:31.572367 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea7e763-3602-42bb-972b-0d26785af5f1 None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:16:31.573841 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 666/1350] 10.222.0.33 () {54 vars in 921 bytes} [Tue Sep 20 22:16:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:16:31.579033 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d0b20d-6db7-4d7a-bc3d-52a2a7b74dbd None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:16:31.579487 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d0b20d-6db7-4d7a-bc3d-52a2a7b74dbd None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:16:31.579570 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d0b20d-6db7-4d7a-bc3d-52a2a7b74dbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:16:31.635655 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:16:31.660183 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-d4d0b20d-6db7-4d7a-bc3d-52a2a7b74dbd None None] MFA Rules not processed for user `c79676ee86294dab92ba732e38d6fa74`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:16:31.661496 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-d4d0b20d-6db7-4d7a-bc3d-52a2a7b74dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:16:31.782411 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 685/1351] 10.222.0.33 () {58 vars in 1018 bytes} [Tue Sep 20 22:16:31 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:16:32.964996 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09623c0b-bc0b-41ce-98d9-1d3751df0744 None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:16:32.964996 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09623c0b-bc0b-41ce-98d9-1d3751df0744 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:16:32.964996 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09623c0b-bc0b-41ce-98d9-1d3751df0744 None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:16:32.966498 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 667/1352] 10.222.0.33 () {54 vars in 921 bytes} [Tue Sep 20 22:16:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:16:32.971697 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aecf115-9752-4a49-98c6-4ae9330c2a17 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:16:32.972133 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aecf115-9752-4a49-98c6-4ae9330c2a17 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:16:32.972353 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aecf115-9752-4a49-98c6-4ae9330c2a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:16:33.049743 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-2aecf115-9752-4a49-98c6-4ae9330c2a17 None None] MFA Rules not processed for user `c79676ee86294dab92ba732e38d6fa74`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:16:33.051478 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-2aecf115-9752-4a49-98c6-4ae9330c2a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:16:33.092787 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:16:33.156804 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 686/1353] 10.222.0.33 () {58 vars in 1018 bytes} [Tue Sep 20 22:16:32 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 22:16:36.709389 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e77c3a-7cce-42d7-b544-54f16f81c94d None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:16:36.710324 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e77c3a-7cce-42d7-b544-54f16f81c94d None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:16:36.711727 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e77c3a-7cce-42d7-b544-54f16f81c94d None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:16:36.713589 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 668/1354] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:16:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:16:36.719452 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c713517-53e3-410a-91a9-b5f137c13c7f None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:16:36.719933 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c713517-53e3-410a-91a9-b5f137c13c7f None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:16:36.720033 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c713517-53e3-410a-91a9-b5f137c13c7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:16:36.802060 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-0c713517-53e3-410a-91a9-b5f137c13c7f None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:16:36.803298 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-0c713517-53e3-410a-91a9-b5f137c13c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:16:36.910550 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 687/1355] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:16:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:16:37.212213 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5312be7-c56a-4330-859e-d5e28e8e2fc2 None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:16:37.212810 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5312be7-c56a-4330-859e-d5e28e8e2fc2 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:16:37.213308 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5312be7-c56a-4330-859e-d5e28e8e2fc2 None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:16:37.214925 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 669/1356] 10.222.0.33 () {54 vars in 965 bytes} [Tue Sep 20 22:16:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:16:37.224059 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a0ddf4-46aa-4332-a075-36564fece206 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:16:37.224598 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a0ddf4-46aa-4332-a075-36564fece206 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:16:37.225138 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a0ddf4-46aa-4332-a075-36564fece206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:16:37.245789 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:16:37.316082 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-d0a0ddf4-46aa-4332-a075-36564fece206 None None] MFA Rules not processed for user `db7eed561e99452289a662ad326cf919`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:16:37.317296 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-d0a0ddf4-46aa-4332-a075-36564fece206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:16:37.451207 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 688/1357] 10.222.0.33 () {58 vars in 1062 bytes} [Tue Sep 20 22:16:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:16:37.459736 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5312be7-c56a-4330-859e-d5e28e8e2fc2 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:16:37.461427 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-d5312be7-c56a-4330-859e-d5e28e8e2fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:16:37.616853 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5312be7-c56a-4330-859e-d5e28e8e2fc2 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:16:37.694899 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:16:37.742966 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da964358-2512-4843-b073-c9f4b6378756 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db7eed561e99452289a662ad326cf919', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:16:37.743642 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da964358-2512-4843-b073-c9f4b6378756 service nova] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:16:37.743891 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da964358-2512-4843-b073-c9f4b6378756 service nova] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:16:37.744109 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da964358-2512-4843-b073-c9f4b6378756 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:16:37.745711 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-da964358-2512-4843-b073-c9f4b6378756 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:16:37.846861 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da964358-2512-4843-b073-c9f4b6378756 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:16:37.848515 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da964358-2512-4843-b073-c9f4b6378756 service nova] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:16:37.867367 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 670/1358] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:16:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:16:40.267637 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d681a5-fb54-48fa-921a-71df53a05642 None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:16:40.268294 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d681a5-fb54-48fa-921a-71df53a05642 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:16:40.268294 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d681a5-fb54-48fa-921a-71df53a05642 None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:16:40.274902 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef6670-6c04-4743-a470-ab3b772de5b7 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:16:40.276219 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef6670-6c04-4743-a470-ab3b772de5b7 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:16:40.276219 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef6670-6c04-4743-a470-ab3b772de5b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:16:40.279057 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 689/1359] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:16:40 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:16:40.348496 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-e0ef6670-6c04-4743-a470-ab3b772de5b7 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:16:40.349699 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-e0ef6670-6c04-4743-a470-ab3b772de5b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:16:40.391701 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:16:40.457217 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 671/1360] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:16:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:16:40.751433 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d681a5-fb54-48fa-921a-71df53a05642 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:16:40.754294 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-e4d681a5-fb54-48fa-921a-71df53a05642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:16:40.825087 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:16:40.941391 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d681a5-fb54-48fa-921a-71df53a05642 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:16:41.078687 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ab347c-cf5c-4f69-9caa-6419bac988ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db7eed561e99452289a662ad326cf919', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:16:41.079301 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ab347c-cf5c-4f69-9caa-6419bac988ba service nova] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:16:41.079581 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ab347c-cf5c-4f69-9caa-6419bac988ba service nova] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:16:41.079852 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ab347c-cf5c-4f69-9caa-6419bac988ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:16:41.081991 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-b3ab347c-cf5c-4f69-9caa-6419bac988ba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:16:41.105636 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:16:41.173047 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ab347c-cf5c-4f69-9caa-6419bac988ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:16:41.174673 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ab347c-cf5c-4f69-9caa-6419bac988ba service nova] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:16:41.193440 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 690/1361] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:16:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:16:43.722538 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafb2c5d-671b-4fdd-b43c-23c3e913e51c None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:16:43.723155 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafb2c5d-671b-4fdd-b43c-23c3e913e51c None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:16:43.723155 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafb2c5d-671b-4fdd-b43c-23c3e913e51c None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:16:43.724446 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 672/1362] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:16:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:16:43.730027 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c9ae14-5dd7-45a5-ae68-3c78ad358b04 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:16:43.730461 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c9ae14-5dd7-45a5-ae68-3c78ad358b04 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:16:43.730691 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c9ae14-5dd7-45a5-ae68-3c78ad358b04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:16:43.799033 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-a2c9ae14-5dd7-45a5-ae68-3c78ad358b04 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:16:43.800780 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-a2c9ae14-5dd7-45a5-ae68-3c78ad358b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:16:43.901573 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:16:43.914943 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 691/1363] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:16:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:16:44.206148 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e37698-2735-45fe-a217-f69fd98c7a34 None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:16:44.207241 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e37698-2735-45fe-a217-f69fd98c7a34 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:16:44.207533 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e37698-2735-45fe-a217-f69fd98c7a34 None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:16:44.209103 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 673/1364] 10.222.0.33 () {54 vars in 965 bytes} [Tue Sep 20 22:16:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:16:44.214767 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e1c18-14b7-4849-8a9a-511b09ee8a31 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:16:44.215122 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e1c18-14b7-4849-8a9a-511b09ee8a31 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:16:44.215501 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e1c18-14b7-4849-8a9a-511b09ee8a31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:16:44.295682 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-759e1c18-14b7-4849-8a9a-511b09ee8a31 None None] MFA Rules not processed for user `db7eed561e99452289a662ad326cf919`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:16:44.296898 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-759e1c18-14b7-4849-8a9a-511b09ee8a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:16:44.417750 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 692/1365] 10.222.0.33 () {58 vars in 1062 bytes} [Tue Sep 20 22:16:44 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:16:44.426285 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e37698-2735-45fe-a217-f69fd98c7a34 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:16:44.428083 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-94e37698-2735-45fe-a217-f69fd98c7a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:16:44.591861 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e37698-2735-45fe-a217-f69fd98c7a34 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:16:44.613052 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:16:44.711295 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6c575b-fb87-4acb-92ce-b70ed9ec549c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db7eed561e99452289a662ad326cf919', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:16:44.711905 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6c575b-fb87-4acb-92ce-b70ed9ec549c service nova] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:16:44.712179 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6c575b-fb87-4acb-92ce-b70ed9ec549c service nova] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:16:44.712442 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6c575b-fb87-4acb-92ce-b70ed9ec549c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:16:44.714049 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-5a6c575b-fb87-4acb-92ce-b70ed9ec549c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:16:44.807394 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6c575b-fb87-4acb-92ce-b70ed9ec549c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:16:44.808913 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6c575b-fb87-4acb-92ce-b70ed9ec549c service nova] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:16:44.829958 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 674/1366] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:16:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:16:44.944855 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddf2a35-e448-4a8a-a1ea-21f73b38fe1f None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:16:44.945406 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddf2a35-e448-4a8a-a1ea-21f73b38fe1f None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:16:44.945406 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddf2a35-e448-4a8a-a1ea-21f73b38fe1f None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:16:44.950350 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 693/1367] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:16:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:16:44.952705 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ae4775-1036-4901-87ec-d58e43a8e662 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:16:44.952992 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ae4775-1036-4901-87ec-d58e43a8e662 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:16:44.953288 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ae4775-1036-4901-87ec-d58e43a8e662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:16:44.992004 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:16:45.037353 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-b3ae4775-1036-4901-87ec-d58e43a8e662 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:16:45.038693 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-b3ae4775-1036-4901-87ec-d58e43a8e662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:16:45.153770 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 675/1368] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:16:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:16:45.506197 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfaae49-76a7-44bf-8e69-c1bc9fa7267c None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:16:45.506197 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfaae49-76a7-44bf-8e69-c1bc9fa7267c None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:16:45.506197 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfaae49-76a7-44bf-8e69-c1bc9fa7267c None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:16:45.507936 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 694/1369] 10.222.0.33 () {54 vars in 962 bytes} [Tue Sep 20 22:16:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:16:45.512255 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fd991e-631c-4981-b6df-8a5422516d4c None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:16:45.512620 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fd991e-631c-4981-b6df-8a5422516d4c None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:16:45.512973 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fd991e-631c-4981-b6df-8a5422516d4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:16:45.602964 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-f9fd991e-631c-4981-b6df-8a5422516d4c None None] MFA Rules not processed for user `6577c8b14c1f4279beac13b9ba11aba1`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:16:45.604296 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-f9fd991e-631c-4981-b6df-8a5422516d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:16:45.654168 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:16:45.687119 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 676/1370] 10.222.0.33 () {58 vars in 1059 bytes} [Tue Sep 20 22:16:45 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:16:45.694643 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfaae49-76a7-44bf-8e69-c1bc9fa7267c None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:16:45.696173 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-4cfaae49-76a7-44bf-8e69-c1bc9fa7267c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:16:45.749225 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:16:45.809314 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfaae49-76a7-44bf-8e69-c1bc9fa7267c None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:16:45.910560 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a668624e-ad70-4d72-b797-84c1f2889ff9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577c8b14c1f4279beac13b9ba11aba1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:16:45.911393 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a668624e-ad70-4d72-b797-84c1f2889ff9 service cinder] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:16:45.911744 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a668624e-ad70-4d72-b797-84c1f2889ff9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:16:45.912088 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a668624e-ad70-4d72-b797-84c1f2889ff9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:16:45.914257 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-a668624e-ad70-4d72-b797-84c1f2889ff9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:16:46.031501 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:16:46.045822 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a668624e-ad70-4d72-b797-84c1f2889ff9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:16:46.047358 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a668624e-ad70-4d72-b797-84c1f2889ff9 service cinder] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:16:46.078871 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 695/1371] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:16:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:16:47.072202 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa81c10d-854a-4891-8966-226c46df17b9 None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:16:47.072768 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa81c10d-854a-4891-8966-226c46df17b9 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:16:47.072768 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa81c10d-854a-4891-8966-226c46df17b9 None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:16:47.074075 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 677/1372] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:16:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:16:47.079466 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26517ead-3599-4017-9704-89cf2127cb86 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:16:47.079870 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26517ead-3599-4017-9704-89cf2127cb86 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:16:47.080026 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26517ead-3599-4017-9704-89cf2127cb86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:16:47.146099 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-26517ead-3599-4017-9704-89cf2127cb86 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:16:47.147344 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-26517ead-3599-4017-9704-89cf2127cb86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:16:47.241604 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 696/1373] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:16:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:16:47.534254 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa81c10d-854a-4891-8966-226c46df17b9 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:16:47.535803 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-fa81c10d-854a-4891-8966-226c46df17b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:16:47.698858 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa81c10d-854a-4891-8966-226c46df17b9 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:16:47.751400 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:16:47.816468 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbba0fc8-240c-463f-a1a4-570ad83a7d71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db7eed561e99452289a662ad326cf919', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:16:47.817072 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba0fc8-240c-463f-a1a4-570ad83a7d71 service nova] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:16:47.817364 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba0fc8-240c-463f-a1a4-570ad83a7d71 service nova] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:16:47.817614 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba0fc8-240c-463f-a1a4-570ad83a7d71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:16:47.819314 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-bbba0fc8-240c-463f-a1a4-570ad83a7d71 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:16:47.915025 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbba0fc8-240c-463f-a1a4-570ad83a7d71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:16:47.916619 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbba0fc8-240c-463f-a1a4-570ad83a7d71 service nova] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:16:47.936814 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 678/1374] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:16:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:16:50.119057 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c75ac3-be50-41eb-b7be-1ac7b4d7e1b5 None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:16:50.119649 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c75ac3-be50-41eb-b7be-1ac7b4d7e1b5 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:16:50.119649 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c75ac3-be50-41eb-b7be-1ac7b4d7e1b5 None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:16:50.121170 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 697/1375] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:16:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:16:50.126230 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf6ff27-2c2c-4568-8336-5414175102e0 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:16:50.126658 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf6ff27-2c2c-4568-8336-5414175102e0 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:16:50.126857 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf6ff27-2c2c-4568-8336-5414175102e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:16:50.199907 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-3bf6ff27-2c2c-4568-8336-5414175102e0 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:16:50.201255 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-3bf6ff27-2c2c-4568-8336-5414175102e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:16:50.208995 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:16:50.307329 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 679/1376] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:16:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:16:50.596069 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c75ac3-be50-41eb-b7be-1ac7b4d7e1b5 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:16:50.598384 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-39c75ac3-be50-41eb-b7be-1ac7b4d7e1b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:16:50.661368 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:16:50.749866 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c75ac3-be50-41eb-b7be-1ac7b4d7e1b5 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:16:50.867745 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d27c2a6-cc1b-4674-8e7f-b74f5ff6b6f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db7eed561e99452289a662ad326cf919', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:16:50.868356 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d27c2a6-cc1b-4674-8e7f-b74f5ff6b6f4 service nova] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:16:50.868635 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d27c2a6-cc1b-4674-8e7f-b74f5ff6b6f4 service nova] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:16:50.868903 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d27c2a6-cc1b-4674-8e7f-b74f5ff6b6f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:16:50.870483 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-0d27c2a6-cc1b-4674-8e7f-b74f5ff6b6f4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:16:50.891574 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:16:50.969125 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d27c2a6-cc1b-4674-8e7f-b74f5ff6b6f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:16:50.970884 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d27c2a6-cc1b-4674-8e7f-b74f5ff6b6f4 service nova] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:16:50.992891 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 698/1377] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:16:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:16:53.183119 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d819ec-f90c-400a-89a1-ecefdff2eccb None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:16:53.183684 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d819ec-f90c-400a-89a1-ecefdff2eccb None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:16:53.183903 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d819ec-f90c-400a-89a1-ecefdff2eccb None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:16:53.185471 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 680/1378] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:16:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:16:53.191255 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5f7435-6743-4b81-88ad-11b698a94b88 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:16:53.191682 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5f7435-6743-4b81-88ad-11b698a94b88 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:16:53.191784 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5f7435-6743-4b81-88ad-11b698a94b88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:16:53.259632 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-5e5f7435-6743-4b81-88ad-11b698a94b88 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:16:53.260833 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-5e5f7435-6743-4b81-88ad-11b698a94b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:16:53.362397 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:16:53.370113 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 699/1379] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:16:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:16:53.661410 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d819ec-f90c-400a-89a1-ecefdff2eccb None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:16:53.663015 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-73d819ec-f90c-400a-89a1-ecefdff2eccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:16:53.847727 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:16:53.865931 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d819ec-f90c-400a-89a1-ecefdff2eccb None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:16:54.001026 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e177c85b-9093-45bc-b59e-0ecde07dc70f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db7eed561e99452289a662ad326cf919', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:16:54.001636 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e177c85b-9093-45bc-b59e-0ecde07dc70f service nova] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:16:54.001918 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e177c85b-9093-45bc-b59e-0ecde07dc70f service nova] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:16:54.002188 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e177c85b-9093-45bc-b59e-0ecde07dc70f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:16:54.004802 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-e177c85b-9093-45bc-b59e-0ecde07dc70f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:16:54.107849 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e177c85b-9093-45bc-b59e-0ecde07dc70f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:16:54.109387 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e177c85b-9093-45bc-b59e-0ecde07dc70f service nova] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:16:54.120653 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:16:54.129966 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 681/1380] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:16:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:16:56.879376 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f720ef-3e54-4781-9273-3c2b17fe5d43 None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:16:56.880265 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f720ef-3e54-4781-9273-3c2b17fe5d43 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:16:56.880695 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f720ef-3e54-4781-9273-3c2b17fe5d43 None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:16:56.884236 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 700/1381] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:16:56 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:16:56.889657 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb3c723-0bfc-43a3-bec5-2e830c9bad43 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:16:56.890116 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb3c723-0bfc-43a3-bec5-2e830c9bad43 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:16:56.890200 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb3c723-0bfc-43a3-bec5-2e830c9bad43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:16:56.969731 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-ddb3c723-0bfc-43a3-bec5-2e830c9bad43 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:16:56.972363 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-ddb3c723-0bfc-43a3-bec5-2e830c9bad43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:16:57.084998 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 682/1382] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:16:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 22:16:57.449127 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f720ef-3e54-4781-9273-3c2b17fe5d43 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:16:57.450702 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-a3f720ef-3e54-4781-9273-3c2b17fe5d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:16:57.630244 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f720ef-3e54-4781-9273-3c2b17fe5d43 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:16:57.714713 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:16:57.761596 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a45eb2-1fb3-41d9-95f6-be0d497e5f53 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db7eed561e99452289a662ad326cf919', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:16:57.762189 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a45eb2-1fb3-41d9-95f6-be0d497e5f53 service nova] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:16:57.762470 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a45eb2-1fb3-41d9-95f6-be0d497e5f53 service nova] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:16:57.762780 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a45eb2-1fb3-41d9-95f6-be0d497e5f53 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:16:57.764403 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-a3a45eb2-1fb3-41d9-95f6-be0d497e5f53 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:16:57.866615 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a45eb2-1fb3-41d9-95f6-be0d497e5f53 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:16:57.868394 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a45eb2-1fb3-41d9-95f6-be0d497e5f53 service nova] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:16:57.893540 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 701/1383] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:16:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:17:00.130780 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad072f1-76de-4f15-b61c-b33b8456cceb None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:17:00.131321 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad072f1-76de-4f15-b61c-b33b8456cceb None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:17:00.131321 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad072f1-76de-4f15-b61c-b33b8456cceb None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:17:00.132692 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 683/1384] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:17:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:17:00.138101 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a02e60b-45f0-4c7e-b1f0-ef719c95ab5b None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:17:00.138558 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a02e60b-45f0-4c7e-b1f0-ef719c95ab5b None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:17:00.138687 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a02e60b-45f0-4c7e-b1f0-ef719c95ab5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:17:00.211441 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-0a02e60b-45f0-4c7e-b1f0-ef719c95ab5b None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:17:00.212653 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-0a02e60b-45f0-4c7e-b1f0-ef719c95ab5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:17:00.247329 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:17:00.313165 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 702/1385] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:17:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:17:00.604406 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad072f1-76de-4f15-b61c-b33b8456cceb None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:17:00.606020 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-1ad072f1-76de-4f15-b61c-b33b8456cceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:17:00.682354 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:17:00.752622 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad072f1-76de-4f15-b61c-b33b8456cceb None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:17:00.866436 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2525f1-5eb8-4e37-9bfc-4d63496cef15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db7eed561e99452289a662ad326cf919', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:17:00.867068 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2525f1-5eb8-4e37-9bfc-4d63496cef15 service nova] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:17:00.867342 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2525f1-5eb8-4e37-9bfc-4d63496cef15 service nova] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:17:00.867606 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2525f1-5eb8-4e37-9bfc-4d63496cef15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:17:00.869182 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-3d2525f1-5eb8-4e37-9bfc-4d63496cef15 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:17:00.913367 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:17:00.972766 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2525f1-5eb8-4e37-9bfc-4d63496cef15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:17:00.974371 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2525f1-5eb8-4e37-9bfc-4d63496cef15 service nova] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:17:00.992728 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 684/1386] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:17:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:17:02.241806 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a130db2-bfa8-4125-915b-a4fc81d37acf None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:17:02.242358 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a130db2-bfa8-4125-915b-a4fc81d37acf None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:17:02.242448 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a130db2-bfa8-4125-915b-a4fc81d37acf None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:17:02.243814 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 703/1387] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:17:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:17:02.249344 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa5959b-bf2f-41f3-9910-21e2bfcc42f5 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:17:02.249756 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa5959b-bf2f-41f3-9910-21e2bfcc42f5 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:17:02.249892 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa5959b-bf2f-41f3-9910-21e2bfcc42f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:17:02.319879 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-aaa5959b-bf2f-41f3-9910-21e2bfcc42f5 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:17:02.321354 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-aaa5959b-bf2f-41f3-9910-21e2bfcc42f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:17:02.420007 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 685/1388] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:17:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:17:02.719401 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddab8227-11c2-4e5c-aa5f-a2a09faacbe8 None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:17:02.719753 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddab8227-11c2-4e5c-aa5f-a2a09faacbe8 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:17:02.720087 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddab8227-11c2-4e5c-aa5f-a2a09faacbe8 None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:17:02.721512 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 704/1389] 10.222.0.33 () {54 vars in 962 bytes} [Tue Sep 20 22:17:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:17:02.726841 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3303c074-9067-44e3-b3cd-18f9aeaf7a77 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:17:02.727137 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3303c074-9067-44e3-b3cd-18f9aeaf7a77 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:17:02.727411 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3303c074-9067-44e3-b3cd-18f9aeaf7a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:17:02.744106 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:17:02.803968 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-3303c074-9067-44e3-b3cd-18f9aeaf7a77 None None] MFA Rules not processed for user `fbecfbbf24fd425ca99499fd44d8c7a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:17:02.805170 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-3303c074-9067-44e3-b3cd-18f9aeaf7a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:17:02.886468 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 686/1390] 10.222.0.33 () {58 vars in 1059 bytes} [Tue Sep 20 22:17:02 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:17:02.895675 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddab8227-11c2-4e5c-aa5f-a2a09faacbe8 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:17:02.897514 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-ddab8227-11c2-4e5c-aa5f-a2a09faacbe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:17:03.007501 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddab8227-11c2-4e5c-aa5f-a2a09faacbe8 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:17:03.070115 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:17:03.087360 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d542ab-ae38-4e25-b2c7-db6a6cadb91d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbecfbbf24fd425ca99499fd44d8c7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:17:03.087979 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d542ab-ae38-4e25-b2c7-db6a6cadb91d service glance] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:17:03.088261 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d542ab-ae38-4e25-b2c7-db6a6cadb91d service glance] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:17:03.088539 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d542ab-ae38-4e25-b2c7-db6a6cadb91d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:17:03.090177 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-47d542ab-ae38-4e25-b2c7-db6a6cadb91d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:17:03.177166 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94131852-c975-47ff-8ee6-40f28fd57392 None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:17:03.177371 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94131852-c975-47ff-8ee6-40f28fd57392 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:17:03.178081 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94131852-c975-47ff-8ee6-40f28fd57392 None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:17:03.179623 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 687/1391] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:17:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 20 22:17:03.184437 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c50f3e0-db4c-4515-8260-9c4f34b446f8 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:17:03.184722 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c50f3e0-db4c-4515-8260-9c4f34b446f8 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:17:03.184993 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c50f3e0-db4c-4515-8260-9c4f34b446f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:17:03.200633 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d542ab-ae38-4e25-b2c7-db6a6cadb91d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:17:03.202073 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d542ab-ae38-4e25-b2c7-db6a6cadb91d service glance] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:17:03.220235 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 705/1392] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:17:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:17:03.253040 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-5c50f3e0-db4c-4515-8260-9c4f34b446f8 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:17:03.254229 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-5c50f3e0-db4c-4515-8260-9c4f34b446f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:17:03.325242 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:17:03.367923 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 688/1393] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:17:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 22:17:03.659008 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d542ab-ae38-4e25-b2c7-db6a6cadb91d service glance] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:17:03.660300 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-47d542ab-ae38-4e25-b2c7-db6a6cadb91d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:17:03.751539 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:17:03.760123 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d542ab-ae38-4e25-b2c7-db6a6cadb91d service glance] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:17:03.884200 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df874e63-b38b-4d1a-af99-0d2fa662d78b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db7eed561e99452289a662ad326cf919', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:17:03.885878 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df874e63-b38b-4d1a-af99-0d2fa662d78b service nova] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:17:03.886159 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df874e63-b38b-4d1a-af99-0d2fa662d78b service nova] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:17:03.886431 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df874e63-b38b-4d1a-af99-0d2fa662d78b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:17:03.888113 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-df874e63-b38b-4d1a-af99-0d2fa662d78b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:17:03.975848 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef2b9ae-162d-4554-9f7d-60f1c48c88a6 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:17:03.976287 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef2b9ae-162d-4554-9f7d-60f1c48c88a6 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:17:03.976667 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef2b9ae-162d-4554-9f7d-60f1c48c88a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:17:03.983564 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df874e63-b38b-4d1a-af99-0d2fa662d78b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:17:03.985150 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df874e63-b38b-4d1a-af99-0d2fa662d78b service nova] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:17:04.002342 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:17:04.005429 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 706/1394] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:17:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:17:04.051646 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-3ef2b9ae-162d-4554-9f7d-60f1c48c88a6 None None] MFA Rules not processed for user `e916748fdee84c34af034e75a919b986`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:17:04.052972 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-3ef2b9ae-162d-4554-9f7d-60f1c48c88a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:17:04.153840 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 689/1395] 10.222.0.33 () {58 vars in 1009 bytes} [Tue Sep 20 22:17:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 22:17:04.206219 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72bd5b6-cbaa-4e37-886b-61256241dabc None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:17:04.206752 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72bd5b6-cbaa-4e37-886b-61256241dabc None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:17:04.207029 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72bd5b6-cbaa-4e37-886b-61256241dabc None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:17:04.208403 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 707/1396] 10.222.0.33 () {54 vars in 943 bytes} [Tue Sep 20 22:17:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:17:04.215550 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3294d4eb-63bc-4aa3-b390-d214f14d908a None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:17:04.215960 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3294d4eb-63bc-4aa3-b390-d214f14d908a None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:17:04.216334 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3294d4eb-63bc-4aa3-b390-d214f14d908a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:17:04.277297 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:17:04.300025 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-3294d4eb-63bc-4aa3-b390-d214f14d908a None None] MFA Rules not processed for user `257983500d7b430c8f0377b2aa743ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:17:04.301070 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-3294d4eb-63bc-4aa3-b390-d214f14d908a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:17:04.410655 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 690/1397] 10.222.0.33 () {58 vars in 1040 bytes} [Tue Sep 20 22:17:04 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:17:04.420055 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72bd5b6-cbaa-4e37-886b-61256241dabc None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:17:04.421685 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-c72bd5b6-cbaa-4e37-886b-61256241dabc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:17:04.557667 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72bd5b6-cbaa-4e37-886b-61256241dabc None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:17:04.643648 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:17:04.662621 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af1af07-b6ef-426e-814d-7d8093aef109 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '257983500d7b430c8f0377b2aa743ae0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:17:04.663224 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af1af07-b6ef-426e-814d-7d8093aef109 service swift] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:17:04.663381 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af1af07-b6ef-426e-814d-7d8093aef109 service swift] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:17:04.663651 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af1af07-b6ef-426e-814d-7d8093aef109 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:17:04.665290 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-0af1af07-b6ef-426e-814d-7d8093aef109 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:17:04.753796 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af1af07-b6ef-426e-814d-7d8093aef109 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:17:04.755578 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af1af07-b6ef-426e-814d-7d8093aef109 service swift] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:17:04.764481 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 708/1398] 10.222.0.33 () {60 vars in 1384 bytes} [Tue Sep 20 22:17:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 20 22:17:06.211131 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4216fa-5735-4f37-9157-6965d7f4fe11 None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:17:06.211716 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4216fa-5735-4f37-9157-6965d7f4fe11 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:17:06.211716 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4216fa-5735-4f37-9157-6965d7f4fe11 None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:17:06.215405 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 691/1399] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:17:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:17:06.218767 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2173ce60-aa65-400d-92a4-f21b3933aeef None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:17:06.219248 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2173ce60-aa65-400d-92a4-f21b3933aeef None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:17:06.219356 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2173ce60-aa65-400d-92a4-f21b3933aeef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:17:06.290402 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-2173ce60-aa65-400d-92a4-f21b3933aeef None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:17:06.291656 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-2173ce60-aa65-400d-92a4-f21b3933aeef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:17:06.369263 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:17:06.398787 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 709/1400] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:17:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 22:17:06.690907 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4216fa-5735-4f37-9157-6965d7f4fe11 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:17:06.692445 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-5b4216fa-5735-4f37-9157-6965d7f4fe11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:17:06.816405 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:17:06.870797 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4216fa-5735-4f37-9157-6965d7f4fe11 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:17:07.008064 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeebfe1e-8ebf-4e3c-8ef5-229b86594f9a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db7eed561e99452289a662ad326cf919', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:17:07.008801 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeebfe1e-8ebf-4e3c-8ef5-229b86594f9a service nova] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:17:07.009184 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeebfe1e-8ebf-4e3c-8ef5-229b86594f9a service nova] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:17:07.009551 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeebfe1e-8ebf-4e3c-8ef5-229b86594f9a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:17:07.011283 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-eeebfe1e-8ebf-4e3c-8ef5-229b86594f9a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:17:07.099149 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:17:07.123490 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeebfe1e-8ebf-4e3c-8ef5-229b86594f9a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:17:07.125257 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeebfe1e-8ebf-4e3c-8ef5-229b86594f9a service nova] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:17:07.144622 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 692/1401] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:17:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:17:09.444870 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d686e5a8-7c11-4f14-853f-142e0a50c595 None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:17:09.445469 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d686e5a8-7c11-4f14-853f-142e0a50c595 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:17:09.445469 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d686e5a8-7c11-4f14-853f-142e0a50c595 None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:17:09.447125 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 710/1402] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:17:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:17:09.452626 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daff909-9bde-4035-8e0e-67cf42aa69cd None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:17:09.453091 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daff909-9bde-4035-8e0e-67cf42aa69cd None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:17:09.453197 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daff909-9bde-4035-8e0e-67cf42aa69cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:17:09.526368 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-5daff909-9bde-4035-8e0e-67cf42aa69cd None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:17:09.529469 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-5daff909-9bde-4035-8e0e-67cf42aa69cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:17:09.637091 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 693/1403] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:17:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:17:09.932456 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d686e5a8-7c11-4f14-853f-142e0a50c595 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:17:09.934245 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-d686e5a8-7c11-4f14-853f-142e0a50c595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:17:10.110138 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d686e5a8-7c11-4f14-853f-142e0a50c595 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:17:10.176480 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:17:10.240345 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51508b0e-6881-4d22-9a3e-53185a8b644b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db7eed561e99452289a662ad326cf919', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:17:10.240984 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51508b0e-6881-4d22-9a3e-53185a8b644b service nova] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:17:10.241260 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51508b0e-6881-4d22-9a3e-53185a8b644b service nova] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:17:10.241526 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51508b0e-6881-4d22-9a3e-53185a8b644b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:17:10.243157 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-51508b0e-6881-4d22-9a3e-53185a8b644b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:17:10.346854 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51508b0e-6881-4d22-9a3e-53185a8b644b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:17:10.348463 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51508b0e-6881-4d22-9a3e-53185a8b644b service nova] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:17:10.367330 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 711/1404] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:17:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:17:12.610352 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a87eb6f-cef1-445d-a77b-40a560d223a4 None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:17:12.611377 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a87eb6f-cef1-445d-a77b-40a560d223a4 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:17:12.611472 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a87eb6f-cef1-445d-a77b-40a560d223a4 None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:17:12.613109 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 694/1405] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:17:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:17:12.618280 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80faa632-04a1-4db7-a55f-92dac4cbb2bf None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:17:12.618758 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80faa632-04a1-4db7-a55f-92dac4cbb2bf None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:17:12.618868 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80faa632-04a1-4db7-a55f-92dac4cbb2bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:17:12.691844 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-80faa632-04a1-4db7-a55f-92dac4cbb2bf None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:17:12.693236 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-80faa632-04a1-4db7-a55f-92dac4cbb2bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:17:12.707952 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:17:12.796151 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 712/1406] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:17:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:17:13.087716 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a87eb6f-cef1-445d-a77b-40a560d223a4 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:17:13.089340 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-6a87eb6f-cef1-445d-a77b-40a560d223a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:17:13.169827 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:17:13.364837 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a87eb6f-cef1-445d-a77b-40a560d223a4 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:17:13.519559 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0d74ca-6bd2-4ae0-acc7-70b2e56aa3ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db7eed561e99452289a662ad326cf919', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:17:13.520189 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0d74ca-6bd2-4ae0-acc7-70b2e56aa3ed service nova] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:17:13.520504 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0d74ca-6bd2-4ae0-acc7-70b2e56aa3ed service nova] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:17:13.520772 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0d74ca-6bd2-4ae0-acc7-70b2e56aa3ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:17:13.522396 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-2f0d74ca-6bd2-4ae0-acc7-70b2e56aa3ed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:17:13.535209 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:17:13.631512 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0d74ca-6bd2-4ae0-acc7-70b2e56aa3ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:17:13.633177 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0d74ca-6bd2-4ae0-acc7-70b2e56aa3ed service nova] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:17:13.653769 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 695/1407] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:17:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 566 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:17:22.794225 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=37 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:17:23.650837 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=41 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:17:27.486622 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77826b1d-804a-4450-afbc-20d9ac38656b None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:17:27.487191 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77826b1d-804a-4450-afbc-20d9ac38656b None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:17:27.487191 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77826b1d-804a-4450-afbc-20d9ac38656b None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:17:27.488516 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 713/1408] 10.222.0.33 () {54 vars in 918 bytes} [Tue Sep 20 22:17:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:17:27.493595 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b22ee-9ddd-477c-a174-7b40466b38cc None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:17:27.494014 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b22ee-9ddd-477c-a174-7b40466b38cc None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:17:27.494129 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b22ee-9ddd-477c-a174-7b40466b38cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:17:27.570454 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-936b22ee-9ddd-477c-a174-7b40466b38cc None None] MFA Rules not processed for user `c79676ee86294dab92ba732e38d6fa74`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:17:27.571620 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-936b22ee-9ddd-477c-a174-7b40466b38cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:17:27.676542 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 696/1409] 10.222.0.33 () {58 vars in 1015 bytes} [Tue Sep 20 22:17:27 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:17:27.690668 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db65138-f776-403c-850a-83e96f8bab93 None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:17:27.690956 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db65138-f776-403c-850a-83e96f8bab93 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:17:27.691228 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db65138-f776-403c-850a-83e96f8bab93 None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:17:27.692584 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 714/1410] 10.222.0.33 () {54 vars in 918 bytes} [Tue Sep 20 22:17:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:17:27.697365 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362a9d0f-bef7-41ae-8e92-c55e643f76bc None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:17:27.697654 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362a9d0f-bef7-41ae-8e92-c55e643f76bc None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:17:27.697935 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362a9d0f-bef7-41ae-8e92-c55e643f76bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:17:27.770358 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:17:27.773007 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-362a9d0f-bef7-41ae-8e92-c55e643f76bc None None] MFA Rules not processed for user `db7eed561e99452289a662ad326cf919`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:17:27.774764 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-362a9d0f-bef7-41ae-8e92-c55e643f76bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:17:27.889154 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 697/1411] 10.222.0.33 () {58 vars in 1015 bytes} [Tue Sep 20 22:17:27 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:17:30.484703 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204375df-b5dd-41ce-b698-266b3962864e None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:17:30.485271 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204375df-b5dd-41ce-b698-266b3962864e None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:17:30.485271 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204375df-b5dd-41ce-b698-266b3962864e None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:17:30.486606 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 715/1412] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 20 22:17:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:17:30.492051 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6279242-60d5-4a44-9c0c-3ea91a035880 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:17:30.492469 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6279242-60d5-4a44-9c0c-3ea91a035880 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:17:30.492600 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6279242-60d5-4a44-9c0c-3ea91a035880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:17:30.557719 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-d6279242-60d5-4a44-9c0c-3ea91a035880 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:17:30.558866 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-d6279242-60d5-4a44-9c0c-3ea91a035880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:17:30.613851 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:17:30.654936 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 698/1413] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 20 22:17:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:17:30.939855 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204375df-b5dd-41ce-b698-266b3962864e None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:17:30.941624 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-204375df-b5dd-41ce-b698-266b3962864e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:17:31.088189 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204375df-b5dd-41ce-b698-266b3962864e None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:17:31.168372 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:17:31.209313 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f441bf65-85a8-4028-aab4-59e91127cb59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db7eed561e99452289a662ad326cf919', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:17:31.209827 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f441bf65-85a8-4028-aab4-59e91127cb59 service nova] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:17:31.210101 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f441bf65-85a8-4028-aab4-59e91127cb59 service nova] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:17:31.210368 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f441bf65-85a8-4028-aab4-59e91127cb59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:17:31.211991 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-f441bf65-85a8-4028-aab4-59e91127cb59 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:17:31.300215 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f441bf65-85a8-4028-aab4-59e91127cb59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:17:31.301801 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f441bf65-85a8-4028-aab4-59e91127cb59 service nova] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:17:31.319602 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 716/1414] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:17:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:17:32.462270 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bf7547-62e8-482a-8807-b42d2d436fd8 None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:17:32.462850 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bf7547-62e8-482a-8807-b42d2d436fd8 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:17:32.462850 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bf7547-62e8-482a-8807-b42d2d436fd8 None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:17:32.464263 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 699/1415] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 20 22:17:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:17:32.471158 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be75a23-157d-4c46-8c2f-d71449f8e1d1 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:17:32.471586 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be75a23-157d-4c46-8c2f-d71449f8e1d1 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:17:32.471731 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be75a23-157d-4c46-8c2f-d71449f8e1d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:17:32.550826 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-0be75a23-157d-4c46-8c2f-d71449f8e1d1 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:17:32.551947 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-0be75a23-157d-4c46-8c2f-d71449f8e1d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:17:32.577655 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:17:32.645509 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 717/1416] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 20 22:17:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:17:32.796363 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bf7547-62e8-482a-8807-b42d2d436fd8 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:17:32.798473 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-c7bf7547-62e8-482a-8807-b42d2d436fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:17:32.942436 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bf7547-62e8-482a-8807-b42d2d436fd8 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:17:32.984051 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:17:33.056682 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035562ef-5ee9-4278-a65f-cf6dda95ad92 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db7eed561e99452289a662ad326cf919', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:17:33.057320 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035562ef-5ee9-4278-a65f-cf6dda95ad92 service nova] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:17:33.057602 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035562ef-5ee9-4278-a65f-cf6dda95ad92 service nova] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:17:33.057875 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035562ef-5ee9-4278-a65f-cf6dda95ad92 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:17:33.059534 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-035562ef-5ee9-4278-a65f-cf6dda95ad92 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:17:33.149398 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035562ef-5ee9-4278-a65f-cf6dda95ad92 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:17:33.151003 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035562ef-5ee9-4278-a65f-cf6dda95ad92 service nova] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:17:33.168744 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 700/1417] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:17:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:17:34.285812 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feee6f9-76b0-443d-bb50-3ffafb4bb4f9 None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:17:34.286338 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feee6f9-76b0-443d-bb50-3ffafb4bb4f9 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:17:34.286338 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feee6f9-76b0-443d-bb50-3ffafb4bb4f9 None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:17:34.287643 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 718/1418] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 20 22:17:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:17:34.294068 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f042e6cd-aab3-4fb8-afa0-ae5b4fe92c0a None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:17:34.294569 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f042e6cd-aab3-4fb8-afa0-ae5b4fe92c0a None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:17:34.294674 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f042e6cd-aab3-4fb8-afa0-ae5b4fe92c0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:17:34.349933 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:17:34.371715 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-f042e6cd-aab3-4fb8-afa0-ae5b4fe92c0a None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:17:34.372911 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-f042e6cd-aab3-4fb8-afa0-ae5b4fe92c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:17:34.466369 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 701/1419] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 20 22:17:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:17:34.615974 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feee6f9-76b0-443d-bb50-3ffafb4bb4f9 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:17:34.617510 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-2feee6f9-76b0-443d-bb50-3ffafb4bb4f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:17:34.760265 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feee6f9-76b0-443d-bb50-3ffafb4bb4f9 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:17:34.772009 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:17:34.871292 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbd1ed8-a809-453e-915a-fbad115ede3a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db7eed561e99452289a662ad326cf919', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:17:34.871811 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbd1ed8-a809-453e-915a-fbad115ede3a service nova] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:17:34.872089 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbd1ed8-a809-453e-915a-fbad115ede3a service nova] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:17:34.872359 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbd1ed8-a809-453e-915a-fbad115ede3a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:17:34.873951 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-9dbd1ed8-a809-453e-915a-fbad115ede3a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:17:34.960310 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbd1ed8-a809-453e-915a-fbad115ede3a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:17:34.961900 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbd1ed8-a809-453e-915a-fbad115ede3a service nova] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:17:34.979937 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 719/1420] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:17:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:17:36.084554 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c209af62-e999-4031-90cc-1553d3f5ef08 None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:17:36.085122 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c209af62-e999-4031-90cc-1553d3f5ef08 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:17:36.085122 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c209af62-e999-4031-90cc-1553d3f5ef08 None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:17:36.086431 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 702/1421] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 20 22:17:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:17:36.092717 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ced59f-0113-418c-9d1d-1611f4a6fc2b None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:17:36.093152 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ced59f-0113-418c-9d1d-1611f4a6fc2b None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:17:36.093271 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ced59f-0113-418c-9d1d-1611f4a6fc2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:17:36.113546 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:17:36.288431 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-b1ced59f-0113-418c-9d1d-1611f4a6fc2b None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:17:36.289622 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-b1ced59f-0113-418c-9d1d-1611f4a6fc2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:17:36.388924 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 720/1422] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 20 22:17:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:17:36.537386 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c209af62-e999-4031-90cc-1553d3f5ef08 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:17:36.538924 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-c209af62-e999-4031-90cc-1553d3f5ef08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:17:36.647742 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:17:36.683817 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c209af62-e999-4031-90cc-1553d3f5ef08 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:17:36.794643 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257373eb-1ca1-4060-abc3-6199c7de09ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db7eed561e99452289a662ad326cf919', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:17:36.795244 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257373eb-1ca1-4060-abc3-6199c7de09ad service nova] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:17:36.795521 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257373eb-1ca1-4060-abc3-6199c7de09ad service nova] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:17:36.795790 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257373eb-1ca1-4060-abc3-6199c7de09ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:17:36.797419 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-257373eb-1ca1-4060-abc3-6199c7de09ad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:17:36.872828 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:17:36.886212 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257373eb-1ca1-4060-abc3-6199c7de09ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:17:36.887826 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257373eb-1ca1-4060-abc3-6199c7de09ad service nova] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:17:36.905903 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 703/1423] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:17:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:17:38.018786 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8cb1ab-5ba8-4885-a1ef-91808d0f41b8 None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:17:38.019297 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8cb1ab-5ba8-4885-a1ef-91808d0f41b8 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:17:38.019297 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8cb1ab-5ba8-4885-a1ef-91808d0f41b8 None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:17:38.020597 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 721/1424] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 20 22:17:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:17:38.026755 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6aa344-c4c6-4e5f-a7c8-b844f13fffef None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:17:38.027163 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6aa344-c4c6-4e5f-a7c8-b844f13fffef None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:17:38.027307 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6aa344-c4c6-4e5f-a7c8-b844f13fffef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:17:38.102186 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-ae6aa344-c4c6-4e5f-a7c8-b844f13fffef None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:17:38.103399 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-ae6aa344-c4c6-4e5f-a7c8-b844f13fffef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:17:38.197219 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 704/1425] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 20 22:17:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:17:38.350520 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8cb1ab-5ba8-4885-a1ef-91808d0f41b8 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:17:38.352052 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-fb8cb1ab-5ba8-4885-a1ef-91808d0f41b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:17:38.436241 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:17:38.497484 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8cb1ab-5ba8-4885-a1ef-91808d0f41b8 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:17:38.610888 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca2a1ae-fb8a-4818-840c-38f3278d659f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db7eed561e99452289a662ad326cf919', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:17:38.611505 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca2a1ae-fb8a-4818-840c-38f3278d659f service nova] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:17:38.611786 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca2a1ae-fb8a-4818-840c-38f3278d659f service nova] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:17:38.612059 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca2a1ae-fb8a-4818-840c-38f3278d659f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:17:38.613675 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-2ca2a1ae-fb8a-4818-840c-38f3278d659f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:17:38.661591 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:17:38.702439 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca2a1ae-fb8a-4818-840c-38f3278d659f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:17:38.704090 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca2a1ae-fb8a-4818-840c-38f3278d659f service nova] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:17:38.722312 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 722/1426] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:17:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:17:39.767183 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c08cd6-618e-44b3-9b3c-5583d0ece6f7 None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:17:39.767789 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c08cd6-618e-44b3-9b3c-5583d0ece6f7 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:17:39.767789 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c08cd6-618e-44b3-9b3c-5583d0ece6f7 None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:17:39.769058 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 705/1427] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 20 22:17:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:17:39.775126 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b34869-b80b-4563-87a6-e10148cb4626 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:17:39.775587 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b34869-b80b-4563-87a6-e10148cb4626 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:17:39.775690 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b34869-b80b-4563-87a6-e10148cb4626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:17:39.853112 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-e8b34869-b80b-4563-87a6-e10148cb4626 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:17:39.854315 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-e8b34869-b80b-4563-87a6-e10148cb4626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:17:39.950034 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 723/1428] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 20 22:17:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:17:40.100526 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c08cd6-618e-44b3-9b3c-5583d0ece6f7 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:17:40.102041 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-65c08cd6-618e-44b3-9b3c-5583d0ece6f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:17:40.149716 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:17:40.244254 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c08cd6-618e-44b3-9b3c-5583d0ece6f7 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:17:40.356752 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eff0587-3495-4dcc-96b4-93d47bfab208 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db7eed561e99452289a662ad326cf919', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:17:40.357358 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eff0587-3495-4dcc-96b4-93d47bfab208 service nova] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:17:40.357636 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eff0587-3495-4dcc-96b4-93d47bfab208 service nova] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:17:40.357904 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eff0587-3495-4dcc-96b4-93d47bfab208 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:17:40.359547 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-4eff0587-3495-4dcc-96b4-93d47bfab208 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:17:40.366568 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:17:40.447915 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eff0587-3495-4dcc-96b4-93d47bfab208 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:17:40.449487 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eff0587-3495-4dcc-96b4-93d47bfab208 service nova] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:17:40.473351 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 706/1429] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:17:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:17:41.517702 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cf4197-717f-4953-bd2c-ad167d20b151 None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:17:41.518237 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cf4197-717f-4953-bd2c-ad167d20b151 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:17:41.518377 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cf4197-717f-4953-bd2c-ad167d20b151 None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:17:41.519647 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 724/1430] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 20 22:17:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:17:41.525805 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155bbbfd-7068-453c-b133-c5363dad0e10 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:17:41.526256 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155bbbfd-7068-453c-b133-c5363dad0e10 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:17:41.526383 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155bbbfd-7068-453c-b133-c5363dad0e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:17:41.601581 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-155bbbfd-7068-453c-b133-c5363dad0e10 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:17:41.602817 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-155bbbfd-7068-453c-b133-c5363dad0e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:17:41.669842 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:17:41.698922 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 707/1431] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 20 22:17:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:17:41.848558 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cf4197-717f-4953-bd2c-ad167d20b151 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:17:41.850097 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-a6cf4197-717f-4953-bd2c-ad167d20b151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:17:41.870224 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:17:41.996930 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cf4197-717f-4953-bd2c-ad167d20b151 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:17:42.082144 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:17:42.107634 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cf2698-3e47-43b4-a61b-23e2e284f5e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db7eed561e99452289a662ad326cf919', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:17:42.108235 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cf2698-3e47-43b4-a61b-23e2e284f5e3 service nova] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:17:42.108510 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cf2698-3e47-43b4-a61b-23e2e284f5e3 service nova] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:17:42.108775 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cf2698-3e47-43b4-a61b-23e2e284f5e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:17:42.110381 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-f9cf2698-3e47-43b4-a61b-23e2e284f5e3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:17:42.199896 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cf2698-3e47-43b4-a61b-23e2e284f5e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:17:42.201434 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cf2698-3e47-43b4-a61b-23e2e284f5e3 service nova] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:17:42.219529 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 725/1432] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:17:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:17:43.274322 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919aa65f-7a8d-43fb-9a9e-70479a5f7a4c None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:17:43.274943 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919aa65f-7a8d-43fb-9a9e-70479a5f7a4c None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:17:43.274943 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919aa65f-7a8d-43fb-9a9e-70479a5f7a4c None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:17:43.276264 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 708/1433] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 20 22:17:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:17:43.283090 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ad44d3-a766-43c7-b0f4-d5b6d3f19899 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:17:43.283533 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ad44d3-a766-43c7-b0f4-d5b6d3f19899 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:17:43.283647 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ad44d3-a766-43c7-b0f4-d5b6d3f19899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:17:43.358998 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-f4ad44d3-a766-43c7-b0f4-d5b6d3f19899 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:17:43.360187 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-f4ad44d3-a766-43c7-b0f4-d5b6d3f19899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:17:43.400339 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:17:43.454193 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 726/1434] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 20 22:17:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:17:43.605359 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919aa65f-7a8d-43fb-9a9e-70479a5f7a4c None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:17:43.606936 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-919aa65f-7a8d-43fb-9a9e-70479a5f7a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:17:43.749997 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919aa65f-7a8d-43fb-9a9e-70479a5f7a4c None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:17:43.807873 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:17:43.983220 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1297d756-718b-4d79-8d19-8de39232df77 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db7eed561e99452289a662ad326cf919', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:17:43.983749 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1297d756-718b-4d79-8d19-8de39232df77 service nova] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:17:43.984023 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1297d756-718b-4d79-8d19-8de39232df77 service nova] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:17:43.984285 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1297d756-718b-4d79-8d19-8de39232df77 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:17:43.986538 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-1297d756-718b-4d79-8d19-8de39232df77 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:17:44.073483 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1297d756-718b-4d79-8d19-8de39232df77 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:17:44.075104 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1297d756-718b-4d79-8d19-8de39232df77 service nova] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:17:44.097903 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 709/1435] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:17:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:17:45.148106 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d25150-2beb-449b-bb03-6218e128f2cf None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:17:45.148632 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d25150-2beb-449b-bb03-6218e128f2cf None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:17:45.148632 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d25150-2beb-449b-bb03-6218e128f2cf None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:17:45.149989 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 727/1436] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 20 22:17:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:17:45.156178 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5984e9c2-b362-4a0a-ac5c-de5963c74e4e None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:17:45.156638 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5984e9c2-b362-4a0a-ac5c-de5963c74e4e None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:17:45.156741 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5984e9c2-b362-4a0a-ac5c-de5963c74e4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:17:45.230585 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-5984e9c2-b362-4a0a-ac5c-de5963c74e4e None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:17:45.231769 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-5984e9c2-b362-4a0a-ac5c-de5963c74e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:17:45.233733 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:17:45.327509 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 710/1437] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 20 22:17:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:17:45.478026 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d25150-2beb-449b-bb03-6218e128f2cf None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:17:45.479587 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-50d25150-2beb-449b-bb03-6218e128f2cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:17:45.624691 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d25150-2beb-449b-bb03-6218e128f2cf None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:17:45.652728 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:17:45.739424 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524326dc-51f7-471d-87e7-13a3095ffed8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db7eed561e99452289a662ad326cf919', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:17:45.739950 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524326dc-51f7-471d-87e7-13a3095ffed8 service nova] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:17:45.740228 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524326dc-51f7-471d-87e7-13a3095ffed8 service nova] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:17:45.740491 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524326dc-51f7-471d-87e7-13a3095ffed8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:17:45.742085 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-524326dc-51f7-471d-87e7-13a3095ffed8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:17:45.830747 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524326dc-51f7-471d-87e7-13a3095ffed8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:17:45.832362 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524326dc-51f7-471d-87e7-13a3095ffed8 service nova] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:17:45.850469 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 728/1438] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:17:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:17:47.911046 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff217386-1a5b-48ff-9b93-1d994ee27e0c None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:17:47.911603 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff217386-1a5b-48ff-9b93-1d994ee27e0c None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:17:47.911603 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff217386-1a5b-48ff-9b93-1d994ee27e0c None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:17:47.912922 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 711/1439] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 20 22:17:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:17:47.918108 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cdf8dc-69df-423c-8dc3-c645e8fea461 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:17:47.918558 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cdf8dc-69df-423c-8dc3-c645e8fea461 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:17:47.918693 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cdf8dc-69df-423c-8dc3-c645e8fea461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:17:47.958778 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:17:47.984293 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-b1cdf8dc-69df-423c-8dc3-c645e8fea461 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:17:47.985499 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-b1cdf8dc-69df-423c-8dc3-c645e8fea461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:17:48.079151 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 729/1440] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 20 22:17:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:17:48.360720 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff217386-1a5b-48ff-9b93-1d994ee27e0c None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:17:48.362272 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-ff217386-1a5b-48ff-9b93-1d994ee27e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:17:48.465364 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff217386-1a5b-48ff-9b93-1d994ee27e0c None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:17:48.497760 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:17:48.542333 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3decb613-b5d0-4cc2-a2ba-77618086c038 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b0b3ca4ecd41aaba9cf8e0f91fbf54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:17:48.542960 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3decb613-b5d0-4cc2-a2ba-77618086c038 service neutron] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:17:48.543234 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3decb613-b5d0-4cc2-a2ba-77618086c038 service neutron] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:17:48.543497 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3decb613-b5d0-4cc2-a2ba-77618086c038 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:17:48.545339 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-3decb613-b5d0-4cc2-a2ba-77618086c038 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:17:48.652364 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3decb613-b5d0-4cc2-a2ba-77618086c038 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:17:48.653777 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3decb613-b5d0-4cc2-a2ba-77618086c038 service neutron] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:17:48.671331 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 712/1441] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:17:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:17:50.942705 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c5e819-79a7-4868-8cfe-12a1d079cb2d None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:17:50.943247 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c5e819-79a7-4868-8cfe-12a1d079cb2d None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:17:50.943247 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c5e819-79a7-4868-8cfe-12a1d079cb2d None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:17:50.944605 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 730/1442] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 20 22:17:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 20 22:17:50.949823 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7747f1e-3e88-4e40-8cd6-13f0d6833243 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:17:50.950258 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7747f1e-3e88-4e40-8cd6-13f0d6833243 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:17:50.950356 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7747f1e-3e88-4e40-8cd6-13f0d6833243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:17:51.015841 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-c7747f1e-3e88-4e40-8cd6-13f0d6833243 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:17:51.017041 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-c7747f1e-3e88-4e40-8cd6-13f0d6833243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:17:51.029492 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:17:51.111940 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 713/1443] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 20 22:17:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:17:51.406010 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c5e819-79a7-4868-8cfe-12a1d079cb2d None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:17:51.408173 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-03c5e819-79a7-4868-8cfe-12a1d079cb2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:17:51.520094 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c5e819-79a7-4868-8cfe-12a1d079cb2d None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:17:51.533924 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:17:51.596308 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522e5a95-0bb6-4fb5-9761-48842b237148 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b0b3ca4ecd41aaba9cf8e0f91fbf54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:17:51.596902 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522e5a95-0bb6-4fb5-9761-48842b237148 service neutron] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:17:51.597175 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522e5a95-0bb6-4fb5-9761-48842b237148 service neutron] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:17:51.597480 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522e5a95-0bb6-4fb5-9761-48842b237148 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:17:51.599084 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-522e5a95-0bb6-4fb5-9761-48842b237148 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:17:51.704305 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522e5a95-0bb6-4fb5-9761-48842b237148 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:17:51.705722 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522e5a95-0bb6-4fb5-9761-48842b237148 service neutron] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:17:51.723426 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 731/1444] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:17:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:17:54.175129 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8072123-9f4d-4641-9d62-7871d0867b86 None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:17:54.175694 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8072123-9f4d-4641-9d62-7871d0867b86 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:17:54.175694 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8072123-9f4d-4641-9d62-7871d0867b86 None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:17:54.177021 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 714/1445] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 20 22:17:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:17:54.182267 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad73b82-bada-499e-a0fa-5b7f62ac61e9 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:17:54.182742 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad73b82-bada-499e-a0fa-5b7f62ac61e9 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:17:54.182840 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad73b82-bada-499e-a0fa-5b7f62ac61e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:17:54.231703 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:17:54.249808 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-6ad73b82-bada-499e-a0fa-5b7f62ac61e9 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:17:54.251691 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-6ad73b82-bada-499e-a0fa-5b7f62ac61e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:17:54.347406 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 732/1446] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 20 22:17:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:17:54.628599 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8072123-9f4d-4641-9d62-7871d0867b86 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:17:54.630172 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-f8072123-9f4d-4641-9d62-7871d0867b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:17:54.731083 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8072123-9f4d-4641-9d62-7871d0867b86 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:17:54.770522 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:17:54.805008 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3234dffc-5f0e-4603-bb5d-73bcbdb218ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b0b3ca4ecd41aaba9cf8e0f91fbf54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:17:54.805605 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3234dffc-5f0e-4603-bb5d-73bcbdb218ee service neutron] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:17:54.805878 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3234dffc-5f0e-4603-bb5d-73bcbdb218ee service neutron] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:17:54.806141 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3234dffc-5f0e-4603-bb5d-73bcbdb218ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:17:54.807738 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-3234dffc-5f0e-4603-bb5d-73bcbdb218ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:17:54.920563 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3234dffc-5f0e-4603-bb5d-73bcbdb218ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:17:54.922036 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3234dffc-5f0e-4603-bb5d-73bcbdb218ee service neutron] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:17:54.941299 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 715/1447] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:17:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:17:57.194765 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145f1f94-da52-4196-bb68-61fa3374db2c None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:17:57.195330 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145f1f94-da52-4196-bb68-61fa3374db2c None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:17:57.195330 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145f1f94-da52-4196-bb68-61fa3374db2c None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:17:57.196730 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 733/1448] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 20 22:17:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 20 22:17:57.202459 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f827692-e84d-4ae4-abab-e9ce16cc8009 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:17:57.202950 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f827692-e84d-4ae4-abab-e9ce16cc8009 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:17:57.203092 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f827692-e84d-4ae4-abab-e9ce16cc8009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:17:57.267491 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-3f827692-e84d-4ae4-abab-e9ce16cc8009 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:17:57.268677 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-3f827692-e84d-4ae4-abab-e9ce16cc8009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:17:57.288624 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:17:57.367599 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 716/1449] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 20 22:17:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 22:17:57.654732 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145f1f94-da52-4196-bb68-61fa3374db2c None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:17:57.656298 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-145f1f94-da52-4196-bb68-61fa3374db2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:17:57.757705 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145f1f94-da52-4196-bb68-61fa3374db2c None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:17:57.777422 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:17:57.830115 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c662f449-7005-41da-87ee-8d3482ce7b0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b0b3ca4ecd41aaba9cf8e0f91fbf54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:17:57.830749 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c662f449-7005-41da-87ee-8d3482ce7b0f service neutron] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:17:57.831023 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c662f449-7005-41da-87ee-8d3482ce7b0f service neutron] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:17:57.831292 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c662f449-7005-41da-87ee-8d3482ce7b0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:17:57.832886 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-c662f449-7005-41da-87ee-8d3482ce7b0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:17:57.941238 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c662f449-7005-41da-87ee-8d3482ce7b0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:17:57.942599 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c662f449-7005-41da-87ee-8d3482ce7b0f service neutron] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:17:57.960089 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 734/1450] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:17:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:18:00.259062 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245674a8-dea5-404b-975f-7ac4ba64cff0 None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:18:00.259599 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245674a8-dea5-404b-975f-7ac4ba64cff0 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:18:00.259599 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245674a8-dea5-404b-975f-7ac4ba64cff0 None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:18:00.260984 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 717/1451] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 20 22:18:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:18:00.266395 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd922ecb-40e7-4b68-b48b-af9636dc6257 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:18:00.266850 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd922ecb-40e7-4b68-b48b-af9636dc6257 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:18:00.266952 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd922ecb-40e7-4b68-b48b-af9636dc6257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:18:00.330513 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:18:00.333245 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-cd922ecb-40e7-4b68-b48b-af9636dc6257 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:18:00.335109 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-cd922ecb-40e7-4b68-b48b-af9636dc6257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:18:00.428304 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 735/1452] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 20 22:18:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:18:00.715002 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245674a8-dea5-404b-975f-7ac4ba64cff0 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:18:00.716575 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-245674a8-dea5-404b-975f-7ac4ba64cff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:18:00.818534 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245674a8-dea5-404b-975f-7ac4ba64cff0 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:18:00.866633 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:18:00.891214 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39817edc-a29e-4b7d-b0ad-7ddd555328c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b0b3ca4ecd41aaba9cf8e0f91fbf54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:18:00.891753 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39817edc-a29e-4b7d-b0ad-7ddd555328c7 service neutron] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:18:00.892031 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39817edc-a29e-4b7d-b0ad-7ddd555328c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:18:00.892341 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39817edc-a29e-4b7d-b0ad-7ddd555328c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:18:00.893920 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-39817edc-a29e-4b7d-b0ad-7ddd555328c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:18:01.002142 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39817edc-a29e-4b7d-b0ad-7ddd555328c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:18:01.003622 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39817edc-a29e-4b7d-b0ad-7ddd555328c7 service neutron] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:18:01.021064 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 718/1453] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:18:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:18:03.222729 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d9a6b-7618-4cfa-9d4f-85711bd6dcdd None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:18:03.223267 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d9a6b-7618-4cfa-9d4f-85711bd6dcdd None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:18:03.223267 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d9a6b-7618-4cfa-9d4f-85711bd6dcdd None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:18:03.224615 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 736/1454] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 20 22:18:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:18:03.229788 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f7fd93-943b-4253-b71b-7df6244e667b None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:18:03.230221 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f7fd93-943b-4253-b71b-7df6244e667b None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:18:03.230340 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f7fd93-943b-4253-b71b-7df6244e667b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:18:03.300131 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-30f7fd93-943b-4253-b71b-7df6244e667b None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:18:03.301335 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-30f7fd93-943b-4253-b71b-7df6244e667b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:18:03.329641 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:18:03.395145 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 719/1455] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 20 22:18:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:18:03.691797 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0840e280-64da-4a08-aa0b-7e84ca8d39b1 None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:18:03.692084 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0840e280-64da-4a08-aa0b-7e84ca8d39b1 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:18:03.692361 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0840e280-64da-4a08-aa0b-7e84ca8d39b1 None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:18:03.693807 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 737/1456] 10.222.0.33 () {54 vars in 963 bytes} [Tue Sep 20 22:18:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:18:03.699443 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c84573b-d528-446a-aed4-432df970b123 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:18:03.699727 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c84573b-d528-446a-aed4-432df970b123 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:18:03.699996 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c84573b-d528-446a-aed4-432df970b123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:18:03.774247 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-2c84573b-d528-446a-aed4-432df970b123 None None] MFA Rules not processed for user `e9b0b3ca4ecd41aaba9cf8e0f91fbf54`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:18:03.775493 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-2c84573b-d528-446a-aed4-432df970b123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:18:03.850623 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 720/1457] 10.222.0.33 () {58 vars in 1060 bytes} [Tue Sep 20 22:18:03 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:18:03.859729 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0840e280-64da-4a08-aa0b-7e84ca8d39b1 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:18:03.861236 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-0840e280-64da-4a08-aa0b-7e84ca8d39b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:18:03.963376 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0840e280-64da-4a08-aa0b-7e84ca8d39b1 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:18:03.991697 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:18:04.036180 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1cf5f7-0a83-48ca-a197-c5bc70e91e8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b0b3ca4ecd41aaba9cf8e0f91fbf54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:18:04.036773 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1cf5f7-0a83-48ca-a197-c5bc70e91e8c service neutron] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:18:04.037049 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1cf5f7-0a83-48ca-a197-c5bc70e91e8c service neutron] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:18:04.037317 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1cf5f7-0a83-48ca-a197-c5bc70e91e8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:18:04.038939 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-7c1cf5f7-0a83-48ca-a197-c5bc70e91e8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:18:04.146822 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1cf5f7-0a83-48ca-a197-c5bc70e91e8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:18:04.148251 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1cf5f7-0a83-48ca-a197-c5bc70e91e8c service neutron] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:18:04.166381 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 738/1458] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:18:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 20 22:18:06.859337 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b4d425-c049-411b-aa4b-b007c819d5a9 None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:18:06.859899 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b4d425-c049-411b-aa4b-b007c819d5a9 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:18:06.859899 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b4d425-c049-411b-aa4b-b007c819d5a9 None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:18:06.861250 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 721/1459] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 20 22:18:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:18:06.866456 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e330bda2-2712-4d9a-8f9b-d4d22fdda3b3 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:18:06.866919 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e330bda2-2712-4d9a-8f9b-d4d22fdda3b3 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:18:06.867030 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e330bda2-2712-4d9a-8f9b-d4d22fdda3b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:18:06.931937 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-e330bda2-2712-4d9a-8f9b-d4d22fdda3b3 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:18:06.933063 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-e330bda2-2712-4d9a-8f9b-d4d22fdda3b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:18:06.941832 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:18:07.029730 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 739/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 20 22:18:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:18:07.311275 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b4d425-c049-411b-aa4b-b007c819d5a9 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:18:07.312794 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-b5b4d425-c049-411b-aa4b-b007c819d5a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:18:07.341760 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:18:07.420089 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b4d425-c049-411b-aa4b-b007c819d5a9 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:18:07.490824 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21db1925-2b00-4c58-ae2b-aec6c6522b46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b0b3ca4ecd41aaba9cf8e0f91fbf54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:18:07.491415 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21db1925-2b00-4c58-ae2b-aec6c6522b46 service neutron] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:18:07.491689 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21db1925-2b00-4c58-ae2b-aec6c6522b46 service neutron] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:18:07.491953 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21db1925-2b00-4c58-ae2b-aec6c6522b46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:18:07.493526 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-21db1925-2b00-4c58-ae2b-aec6c6522b46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:18:07.569362 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:18:07.601692 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21db1925-2b00-4c58-ae2b-aec6c6522b46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:18:07.603167 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21db1925-2b00-4c58-ae2b-aec6c6522b46 service neutron] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:18:07.621360 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 722/1461] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:18:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:18:09.802414 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3371aa-54ef-42fd-968b-05ff27a85fbb None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:18:09.803089 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3371aa-54ef-42fd-968b-05ff27a85fbb None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:18:09.803089 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3371aa-54ef-42fd-968b-05ff27a85fbb None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:18:09.804316 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 740/1462] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 20 22:18:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 20 22:18:09.809535 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7219c9be-6929-4442-a643-c6d0634230f7 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:18:09.809962 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7219c9be-6929-4442-a643-c6d0634230f7 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:18:09.810098 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7219c9be-6929-4442-a643-c6d0634230f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:18:09.875265 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-7219c9be-6929-4442-a643-c6d0634230f7 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:18:09.876454 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-7219c9be-6929-4442-a643-c6d0634230f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:18:09.970401 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 723/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 20 22:18:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:18:10.254884 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3371aa-54ef-42fd-968b-05ff27a85fbb None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:18:10.256498 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-da3371aa-54ef-42fd-968b-05ff27a85fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:18:10.358426 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3371aa-54ef-42fd-968b-05ff27a85fbb None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:18:10.395573 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:18:10.431285 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346ac105-84ab-4d06-b857-dc89b414c9c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b0b3ca4ecd41aaba9cf8e0f91fbf54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:18:10.431879 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346ac105-84ab-4d06-b857-dc89b414c9c1 service neutron] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:18:10.432151 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346ac105-84ab-4d06-b857-dc89b414c9c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:18:10.432414 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346ac105-84ab-4d06-b857-dc89b414c9c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:18:10.433992 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-346ac105-84ab-4d06-b857-dc89b414c9c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:18:10.544450 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346ac105-84ab-4d06-b857-dc89b414c9c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:18:10.546041 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346ac105-84ab-4d06-b857-dc89b414c9c1 service neutron] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:18:10.565004 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 741/1464] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:18:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 20 22:18:12.761529 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6125a13-6b1f-4ad7-a2f9-986a13ae1e67 None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:18:12.762078 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6125a13-6b1f-4ad7-a2f9-986a13ae1e67 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:18:12.762078 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6125a13-6b1f-4ad7-a2f9-986a13ae1e67 None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:18:12.763550 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 724/1465] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 20 22:18:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:18:12.769025 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2e63b1-4ab0-4960-8b17-0a65a12155c8 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:18:12.769441 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2e63b1-4ab0-4960-8b17-0a65a12155c8 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:18:12.769689 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2e63b1-4ab0-4960-8b17-0a65a12155c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:18:12.837018 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-aa2e63b1-4ab0-4960-8b17-0a65a12155c8 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:18:12.838223 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-aa2e63b1-4ab0-4960-8b17-0a65a12155c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:18:12.856795 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:18:12.935657 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 742/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 20 22:18:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:18:13.217930 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6125a13-6b1f-4ad7-a2f9-986a13ae1e67 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:18:13.219513 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-e6125a13-6b1f-4ad7-a2f9-986a13ae1e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:18:13.258246 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:18:13.325788 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6125a13-6b1f-4ad7-a2f9-986a13ae1e67 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:18:13.399005 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12721a26-3c25-478a-92de-f5e8d5ae685d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b0b3ca4ecd41aaba9cf8e0f91fbf54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:18:13.399598 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12721a26-3c25-478a-92de-f5e8d5ae685d service neutron] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:18:13.399900 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12721a26-3c25-478a-92de-f5e8d5ae685d service neutron] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:18:13.400162 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12721a26-3c25-478a-92de-f5e8d5ae685d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:18:13.401737 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-12721a26-3c25-478a-92de-f5e8d5ae685d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:18:13.482708 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:18:13.508685 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12721a26-3c25-478a-92de-f5e8d5ae685d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:18:13.510116 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12721a26-3c25-478a-92de-f5e8d5ae685d service neutron] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:18:13.528208 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 725/1467] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:18:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:18:15.673019 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1308ebb-3efa-4efe-b114-a8e56371c472 None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:18:15.673588 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1308ebb-3efa-4efe-b114-a8e56371c472 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:18:15.673588 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1308ebb-3efa-4efe-b114-a8e56371c472 None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:18:15.675461 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 743/1468] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 20 22:18:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:18:15.681031 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad0a7a9-c5fa-4b71-ba26-677b9eab330b None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:18:15.681426 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad0a7a9-c5fa-4b71-ba26-677b9eab330b None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:18:15.681569 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad0a7a9-c5fa-4b71-ba26-677b9eab330b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:18:15.748373 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-5ad0a7a9-c5fa-4b71-ba26-677b9eab330b None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:18:15.749586 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-5ad0a7a9-c5fa-4b71-ba26-677b9eab330b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:18:15.845030 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 726/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 20 22:18:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:18:16.129049 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1308ebb-3efa-4efe-b114-a8e56371c472 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:18:16.130663 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-c1308ebb-3efa-4efe-b114-a8e56371c472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:18:16.232587 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1308ebb-3efa-4efe-b114-a8e56371c472 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:18:16.279968 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:18:16.307857 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24228bd-584d-4bbf-a04a-06a70fbb358d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b0b3ca4ecd41aaba9cf8e0f91fbf54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:18:16.308462 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24228bd-584d-4bbf-a04a-06a70fbb358d service neutron] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:18:16.308734 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24228bd-584d-4bbf-a04a-06a70fbb358d service neutron] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:18:16.309000 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24228bd-584d-4bbf-a04a-06a70fbb358d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:18:16.310590 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-d24228bd-584d-4bbf-a04a-06a70fbb358d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:18:16.419612 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24228bd-584d-4bbf-a04a-06a70fbb358d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:18:16.421206 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24228bd-584d-4bbf-a04a-06a70fbb358d service neutron] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:18:16.439180 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 744/1470] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:18:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:18:25.843537 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=81 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:18:26.436931 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=66 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:18:36.226193 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78143bb1-3e6e-4b02-80b0-da6cde6594ab None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:18:36.226790 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78143bb1-3e6e-4b02-80b0-da6cde6594ab None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:18:36.226790 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78143bb1-3e6e-4b02-80b0-da6cde6594ab None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:18:36.228117 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 727/1471] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:18:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:18:36.233522 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df02ca17-607f-4662-8948-8342d3d9c2db None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:18:36.233932 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df02ca17-607f-4662-8948-8342d3d9c2db None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:18:36.234076 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df02ca17-607f-4662-8948-8342d3d9c2db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:18:36.299315 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-df02ca17-607f-4662-8948-8342d3d9c2db None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:18:36.300562 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-df02ca17-607f-4662-8948-8342d3d9c2db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:18:36.398120 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 745/1472] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:18:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:18:36.705076 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c31eb5-9e4c-4684-a597-6207ce9961ff None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:18:36.705366 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c31eb5-9e4c-4684-a597-6207ce9961ff None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:18:36.705639 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c31eb5-9e4c-4684-a597-6207ce9961ff None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:18:36.707021 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 728/1473] 10.222.0.33 () {54 vars in 962 bytes} [Tue Sep 20 22:18:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:18:36.711880 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841eaa30-89da-4ef3-b67d-ee7b6f84aea4 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:18:36.712182 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841eaa30-89da-4ef3-b67d-ee7b6f84aea4 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:18:36.712458 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841eaa30-89da-4ef3-b67d-ee7b6f84aea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:18:36.787139 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-841eaa30-89da-4ef3-b67d-ee7b6f84aea4 None None] MFA Rules not processed for user `fbecfbbf24fd425ca99499fd44d8c7a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:18:36.788326 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-841eaa30-89da-4ef3-b67d-ee7b6f84aea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:18:36.808885 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:18:36.863768 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 746/1474] 10.222.0.33 () {58 vars in 1059 bytes} [Tue Sep 20 22:18:36 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:18:36.871484 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c31eb5-9e4c-4684-a597-6207ce9961ff None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:18:36.872976 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-43c31eb5-9e4c-4684-a597-6207ce9961ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:18:36.975762 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c31eb5-9e4c-4684-a597-6207ce9961ff None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:18:37.049946 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fde306-db5b-453b-8b61-89e2f29dbac4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbecfbbf24fd425ca99499fd44d8c7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:18:37.050578 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fde306-db5b-453b-8b61-89e2f29dbac4 service glance] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:18:37.050853 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fde306-db5b-453b-8b61-89e2f29dbac4 service glance] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:18:37.051118 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fde306-db5b-453b-8b61-89e2f29dbac4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:18:37.052686 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-b5fde306-db5b-453b-8b61-89e2f29dbac4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:18:37.105397 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:18:37.159166 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fde306-db5b-453b-8b61-89e2f29dbac4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:18:37.160581 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fde306-db5b-453b-8b61-89e2f29dbac4 service glance] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:18:37.179136 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 729/1475] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:18:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:18:39.425253 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bcc284-25b9-449f-aca5-440927367ab2 None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:18:39.425813 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bcc284-25b9-449f-aca5-440927367ab2 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:18:39.425813 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bcc284-25b9-449f-aca5-440927367ab2 None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:18:39.427193 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 747/1476] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:18:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:18:39.432535 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5343882f-f05d-4e17-9273-2fc681015030 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:18:39.432934 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5343882f-f05d-4e17-9273-2fc681015030 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:18:39.433088 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5343882f-f05d-4e17-9273-2fc681015030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:18:39.497685 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-5343882f-f05d-4e17-9273-2fc681015030 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:18:39.498925 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-5343882f-f05d-4e17-9273-2fc681015030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:18:39.593845 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 730/1477] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:18:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:18:39.873953 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bcc284-25b9-449f-aca5-440927367ab2 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:18:39.875467 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-78bcc284-25b9-449f-aca5-440927367ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:18:40.002118 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bcc284-25b9-449f-aca5-440927367ab2 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:18:40.051712 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:18:40.095061 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf40607-32eb-413f-b7c3-1e783ba0cd60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:18:40.096235 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf40607-32eb-413f-b7c3-1e783ba0cd60 admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:18:40.096512 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf40607-32eb-413f-b7c3-1e783ba0cd60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:18:40.096783 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf40607-32eb-413f-b7c3-1e783ba0cd60 admin admin] PATH_INFO: `/v3/projects` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:18:40.097419 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf40607-32eb-413f-b7c3-1e783ba0cd60 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:18:40.099184 dv-cinder-858276-1-smb devstack@keystone.service[81306]: WARNING py.warnings [None req-abf40607-32eb-413f-b7c3-1e783ba0cd60 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 20 22:18:40.099184 dv-cinder-858276-1-smb devstack@keystone.service[81306]: warnings.warn(msg) Sep 20 22:18:40.099184 dv-cinder-858276-1-smb devstack@keystone.service[81306]: Sep 20 22:18:40.100328 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf40607-32eb-413f-b7c3-1e783ba0cd60 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:18:40.119687 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 748/1478] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Sep 20 22:18:39 2022] GET /identity/v3/projects => generated 2553 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:18:42.265497 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a89575c-a168-4a16-b26b-41f99440f305 None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:18:42.266104 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a89575c-a168-4a16-b26b-41f99440f305 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:18:42.266104 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a89575c-a168-4a16-b26b-41f99440f305 None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:18:42.267990 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 731/1479] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:18:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:18:42.273498 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c39e6b6-5439-4d87-959c-4728ab231ad8 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:18:42.273932 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c39e6b6-5439-4d87-959c-4728ab231ad8 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:18:42.274059 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c39e6b6-5439-4d87-959c-4728ab231ad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:18:42.340020 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-3c39e6b6-5439-4d87-959c-4728ab231ad8 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:18:42.341229 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-3c39e6b6-5439-4d87-959c-4728ab231ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:18:42.436964 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 749/1480] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:18:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 22:18:42.728091 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a89575c-a168-4a16-b26b-41f99440f305 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:18:42.729655 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-6a89575c-a168-4a16-b26b-41f99440f305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:18:42.740031 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:18:42.877575 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a89575c-a168-4a16-b26b-41f99440f305 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:18:42.959968 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:18:42.992980 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56453b68-7106-404c-8c83-0b1f5096f48f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db7eed561e99452289a662ad326cf919', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:18:42.993582 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56453b68-7106-404c-8c83-0b1f5096f48f service nova] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:18:42.993857 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56453b68-7106-404c-8c83-0b1f5096f48f service nova] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:18:42.994128 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56453b68-7106-404c-8c83-0b1f5096f48f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:18:42.995760 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-56453b68-7106-404c-8c83-0b1f5096f48f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:18:43.082407 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56453b68-7106-404c-8c83-0b1f5096f48f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:18:43.084033 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56453b68-7106-404c-8c83-0b1f5096f48f service nova] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:18:43.101957 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 732/1481] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:18:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:18:45.424310 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4727cd0a-3ada-4010-b2e1-528cb9de850d None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:18:45.424856 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4727cd0a-3ada-4010-b2e1-528cb9de850d None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:18:45.424856 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4727cd0a-3ada-4010-b2e1-528cb9de850d None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:18:45.426203 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 750/1482] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:18:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:18:45.431413 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ee5786-9a00-40eb-bc74-92232268805a None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:18:45.431808 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ee5786-9a00-40eb-bc74-92232268805a None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:18:45.431998 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ee5786-9a00-40eb-bc74-92232268805a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:18:45.497571 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-c6ee5786-9a00-40eb-bc74-92232268805a None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:18:45.498805 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-c6ee5786-9a00-40eb-bc74-92232268805a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:18:45.544610 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:18:45.595593 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 733/1483] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:18:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 22:18:45.883726 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4727cd0a-3ada-4010-b2e1-528cb9de850d None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:18:45.885564 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-4727cd0a-3ada-4010-b2e1-528cb9de850d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:18:45.909924 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:18:45.994929 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4727cd0a-3ada-4010-b2e1-528cb9de850d None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:18:46.068517 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8fdd11-1f42-451a-bec5-1ca78fe02f84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b0b3ca4ecd41aaba9cf8e0f91fbf54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:18:46.069145 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8fdd11-1f42-451a-bec5-1ca78fe02f84 service neutron] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:18:46.069422 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8fdd11-1f42-451a-bec5-1ca78fe02f84 service neutron] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:18:46.069689 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8fdd11-1f42-451a-bec5-1ca78fe02f84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:18:46.071324 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-3c8fdd11-1f42-451a-bec5-1ca78fe02f84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:18:46.144900 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:18:46.180091 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8fdd11-1f42-451a-bec5-1ca78fe02f84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:18:46.181512 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8fdd11-1f42-451a-bec5-1ca78fe02f84 service neutron] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:18:46.199179 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 751/1484] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:18:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:18:48.418486 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522ef7ff-1f1c-4841-93b5-262620c873cc None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:18:48.419075 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522ef7ff-1f1c-4841-93b5-262620c873cc None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:18:48.419075 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522ef7ff-1f1c-4841-93b5-262620c873cc None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:18:48.420620 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 734/1485] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:18:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:18:48.426698 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ed8cb4-3405-4a83-a68e-8dc1c9fb1252 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:18:48.427124 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ed8cb4-3405-4a83-a68e-8dc1c9fb1252 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:18:48.427239 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ed8cb4-3405-4a83-a68e-8dc1c9fb1252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:18:48.491920 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-39ed8cb4-3405-4a83-a68e-8dc1c9fb1252 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:18:48.493124 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-39ed8cb4-3405-4a83-a68e-8dc1c9fb1252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:18:48.590372 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 752/1486] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:18:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:18:48.886998 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522ef7ff-1f1c-4841-93b5-262620c873cc None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:18:48.888551 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-522ef7ff-1f1c-4841-93b5-262620c873cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:18:48.992776 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522ef7ff-1f1c-4841-93b5-262620c873cc None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:18:49.069716 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:18:49.071217 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580e6d80-ab2f-40ff-947b-739c034c8163 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b0b3ca4ecd41aaba9cf8e0f91fbf54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:18:49.071832 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580e6d80-ab2f-40ff-947b-739c034c8163 service neutron] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:18:49.072303 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580e6d80-ab2f-40ff-947b-739c034c8163 service neutron] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:18:49.072740 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580e6d80-ab2f-40ff-947b-739c034c8163 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:18:49.074586 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-580e6d80-ab2f-40ff-947b-739c034c8163 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:18:49.181747 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580e6d80-ab2f-40ff-947b-739c034c8163 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:18:49.183145 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580e6d80-ab2f-40ff-947b-739c034c8163 service neutron] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:18:49.201198 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 735/1487] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:18:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:18:51.449111 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24badde5-b953-452c-aabc-ba4f90cac63d None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:18:51.449659 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24badde5-b953-452c-aabc-ba4f90cac63d None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:18:51.449659 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24badde5-b953-452c-aabc-ba4f90cac63d None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:18:51.451015 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 753/1488] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:18:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:18:51.456856 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51693c5c-b1c3-4bf3-a76b-e154f6756f18 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:18:51.457302 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51693c5c-b1c3-4bf3-a76b-e154f6756f18 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:18:51.457401 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51693c5c-b1c3-4bf3-a76b-e154f6756f18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:18:51.523079 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-51693c5c-b1c3-4bf3-a76b-e154f6756f18 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:18:51.524287 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-51693c5c-b1c3-4bf3-a76b-e154f6756f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:18:51.576832 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:18:51.620269 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 736/1489] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:18:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:18:51.918038 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24badde5-b953-452c-aabc-ba4f90cac63d None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:18:51.919633 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-24badde5-b953-452c-aabc-ba4f90cac63d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:18:51.956654 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:18:52.026370 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24badde5-b953-452c-aabc-ba4f90cac63d None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:18:52.099606 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c71336-e824-4a14-826c-75992180c1bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b0b3ca4ecd41aaba9cf8e0f91fbf54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:18:52.100205 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c71336-e824-4a14-826c-75992180c1bc service neutron] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:18:52.100476 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c71336-e824-4a14-826c-75992180c1bc service neutron] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:18:52.100740 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c71336-e824-4a14-826c-75992180c1bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:18:52.102312 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-b9c71336-e824-4a14-826c-75992180c1bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:18:52.182410 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:18:52.210484 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c71336-e824-4a14-826c-75992180c1bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:18:52.211934 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c71336-e824-4a14-826c-75992180c1bc service neutron] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:18:52.229982 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 754/1490] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:18:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:18:54.576562 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4a2314-6aed-41e5-8996-b38b7c781939 None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:18:54.577082 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4a2314-6aed-41e5-8996-b38b7c781939 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:18:54.577082 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4a2314-6aed-41e5-8996-b38b7c781939 None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:18:54.578361 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 737/1491] 10.222.0.33 () {54 vars in 927 bytes} [Tue Sep 20 22:18:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:18:54.583611 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b71bf9c-b959-4e75-a387-b7245886e9d1 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:18:54.584021 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b71bf9c-b959-4e75-a387-b7245886e9d1 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:18:54.584151 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b71bf9c-b959-4e75-a387-b7245886e9d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:18:54.653330 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-1b71bf9c-b959-4e75-a387-b7245886e9d1 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:18:54.654556 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-1b71bf9c-b959-4e75-a387-b7245886e9d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:18:54.748913 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 755/1492] 10.222.0.33 () {58 vars in 1024 bytes} [Tue Sep 20 22:18:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:18:55.041788 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4a2314-6aed-41e5-8996-b38b7c781939 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:18:55.043413 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-cb4a2314-6aed-41e5-8996-b38b7c781939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:18:55.145766 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4a2314-6aed-41e5-8996-b38b7c781939 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:18:55.218419 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed3d3b5-6ff0-4270-b707-ce6d4bbd0665 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b0b3ca4ecd41aaba9cf8e0f91fbf54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:18:55.219048 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed3d3b5-6ff0-4270-b707-ce6d4bbd0665 service neutron] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:18:55.219324 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed3d3b5-6ff0-4270-b707-ce6d4bbd0665 service neutron] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:18:55.219594 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed3d3b5-6ff0-4270-b707-ce6d4bbd0665 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:18:55.221753 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-8ed3d3b5-6ff0-4270-b707-ce6d4bbd0665 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:18:55.230104 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:18:55.330271 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed3d3b5-6ff0-4270-b707-ce6d4bbd0665 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:18:55.332275 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed3d3b5-6ff0-4270-b707-ce6d4bbd0665 service neutron] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:18:55.350345 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 738/1493] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:18:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:19:04.747108 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=82 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:19:05.348144 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=50 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:20:12.850288 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d29e835-7064-474d-9139-141420318f2d None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:20:12.850848 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d29e835-7064-474d-9139-141420318f2d None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:20:12.850848 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d29e835-7064-474d-9139-141420318f2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:20:12.928763 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-7d29e835-7064-474d-9139-141420318f2d None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:20:12.930441 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-7d29e835-7064-474d-9139-141420318f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:20:13.032162 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 756/1494] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:20:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:20:13.040006 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feca6f35-3033-4ba0-83f4-7473f7f0c775 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:20:13.040510 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feca6f35-3033-4ba0-83f4-7473f7f0c775 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:20:13.040615 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feca6f35-3033-4ba0-83f4-7473f7f0c775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:20:13.116162 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-feca6f35-3033-4ba0-83f4-7473f7f0c775 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:20:13.117357 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-feca6f35-3033-4ba0-83f4-7473f7f0c775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:20:13.212308 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 739/1495] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:20:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:20:13.216922 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d29e835-7064-474d-9139-141420318f2d None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:20:13.218189 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-7d29e835-7064-474d-9139-141420318f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:20:13.229503 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d29e835-7064-474d-9139-141420318f2d None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:20:13.290941 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:20:13.327331 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86e9e48-0e1f-4346-967e-b909895e70a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:20:13.327939 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86e9e48-0e1f-4346-967e-b909895e70a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:20:13.328218 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86e9e48-0e1f-4346-967e-b909895e70a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:20:13.328488 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86e9e48-0e1f-4346-967e-b909895e70a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:20:13.329129 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86e9e48-0e1f-4346-967e-b909895e70a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:20:13.329460 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86e9e48-0e1f-4346-967e-b909895e70a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:20:13.330462 dv-cinder-858276-1-smb devstack@keystone.service[81306]: WARNING py.warnings [None req-c86e9e48-0e1f-4346-967e-b909895e70a8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 20 22:20:13.330462 dv-cinder-858276-1-smb devstack@keystone.service[81306]: warnings.warn(msg) Sep 20 22:20:13.330462 dv-cinder-858276-1-smb devstack@keystone.service[81306]: Sep 20 22:20:13.331378 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86e9e48-0e1f-4346-967e-b909895e70a8 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:20:13.342404 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 757/1496] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 20 22:20:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:20:13.351157 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feca6f35-3033-4ba0-83f4-7473f7f0c775 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:20:13.363598 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feca6f35-3033-4ba0-83f4-7473f7f0c775 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:20:13.423920 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:20:13.457359 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea25675-c851-4520-87d2-d52821fee3bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:20:13.457959 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea25675-c851-4520-87d2-d52821fee3bd admin admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:20:13.458238 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea25675-c851-4520-87d2-d52821fee3bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:20:13.458525 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea25675-c851-4520-87d2-d52821fee3bd admin admin] PATH_INFO: `/v3/projects` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:20:13.459151 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea25675-c851-4520-87d2-d52821fee3bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:20:13.460852 dv-cinder-858276-1-smb devstack@keystone.service[81307]: WARNING py.warnings [None req-4ea25675-c851-4520-87d2-d52821fee3bd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 20 22:20:13.460852 dv-cinder-858276-1-smb devstack@keystone.service[81307]: warnings.warn(msg) Sep 20 22:20:13.460852 dv-cinder-858276-1-smb devstack@keystone.service[81307]: Sep 20 22:20:13.462040 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea25675-c851-4520-87d2-d52821fee3bd admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:20:13.516927 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 740/1497] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 20 22:20:13 2022] POST /identity/v3/projects => generated 379 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:20:13.521174 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86e9e48-0e1f-4346-967e-b909895e70a8 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:20:13.522761 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-c86e9e48-0e1f-4346-967e-b909895e70a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:20:13.556055 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86e9e48-0e1f-4346-967e-b909895e70a8 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:20:13.648361 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65c1518-6f68-4605-9561-94b6b40a8ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:20:13.648960 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65c1518-6f68-4605-9561-94b6b40a8ff0 admin admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:20:13.649235 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65c1518-6f68-4605-9561-94b6b40a8ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:20:13.649511 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65c1518-6f68-4605-9561-94b6b40a8ff0 admin admin] PATH_INFO: `/v3/users` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:20:13.650131 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65c1518-6f68-4605-9561-94b6b40a8ff0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:20:13.651169 dv-cinder-858276-1-smb devstack@keystone.service[81306]: WARNING py.warnings [None req-f65c1518-6f68-4605-9561-94b6b40a8ff0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 20 22:20:13.651169 dv-cinder-858276-1-smb devstack@keystone.service[81306]: warnings.warn(msg) Sep 20 22:20:13.651169 dv-cinder-858276-1-smb devstack@keystone.service[81306]: Sep 20 22:20:13.652380 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65c1518-6f68-4605-9561-94b6b40a8ff0 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:20:13.695403 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 758/1498] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 20 22:20:13 2022] POST /identity/v3/users => generated 290 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:20:13.699584 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea25675-c851-4520-87d2-d52821fee3bd admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:20:13.701178 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-4ea25675-c851-4520-87d2-d52821fee3bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:20:13.763486 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea25675-c851-4520-87d2-d52821fee3bd admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:20:13.846050 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:20:13.857354 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3bc941-2946-4f1d-9fb0-a3732d1fed2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:20:13.857954 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3bc941-2946-4f1d-9fb0-a3732d1fed2d admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:20:13.858232 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3bc941-2946-4f1d-9fb0-a3732d1fed2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:20:13.858499 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3bc941-2946-4f1d-9fb0-a3732d1fed2d admin admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:20:13.859159 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3bc941-2946-4f1d-9fb0-a3732d1fed2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:20:13.860161 dv-cinder-858276-1-smb devstack@keystone.service[81307]: WARNING py.warnings [None req-0f3bc941-2946-4f1d-9fb0-a3732d1fed2d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 20 22:20:13.860161 dv-cinder-858276-1-smb devstack@keystone.service[81307]: warnings.warn(msg) Sep 20 22:20:13.860161 dv-cinder-858276-1-smb devstack@keystone.service[81307]: Sep 20 22:20:13.861649 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3bc941-2946-4f1d-9fb0-a3732d1fed2d admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:20:13.873723 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 741/1499] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:20:13 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 20 22:20:13.877792 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65c1518-6f68-4605-9561-94b6b40a8ff0 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:20:13.879328 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-f65c1518-6f68-4605-9561-94b6b40a8ff0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:20:13.890528 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65c1518-6f68-4605-9561-94b6b40a8ff0 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:20:13.916033 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:20:13.985194 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac5ce82-a2d9-49ca-a988-2d7a79f70b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:20:13.986378 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac5ce82-a2d9-49ca-a988-2d7a79f70b0e admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:20:13.986674 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac5ce82-a2d9-49ca-a988-2d7a79f70b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:20:13.986944 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac5ce82-a2d9-49ca-a988-2d7a79f70b0e admin admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:20:13.987578 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac5ce82-a2d9-49ca-a988-2d7a79f70b0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:20:13.988658 dv-cinder-858276-1-smb devstack@keystone.service[81306]: WARNING py.warnings [None req-bac5ce82-a2d9-49ca-a988-2d7a79f70b0e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 20 22:20:13.988658 dv-cinder-858276-1-smb devstack@keystone.service[81306]: warnings.warn(msg) Sep 20 22:20:13.988658 dv-cinder-858276-1-smb devstack@keystone.service[81306]: Sep 20 22:20:13.989620 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac5ce82-a2d9-49ca-a988-2d7a79f70b0e admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:20:14.001994 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 759/1500] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:20:13 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:20:14.006139 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3bc941-2946-4f1d-9fb0-a3732d1fed2d admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:20:14.007773 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-0f3bc941-2946-4f1d-9fb0-a3732d1fed2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:20:14.041470 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3bc941-2946-4f1d-9fb0-a3732d1fed2d admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:20:14.132556 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632c1ea1-6e70-411d-bf99-efc5817fd841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:20:14.133135 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632c1ea1-6e70-411d-bf99-efc5817fd841 admin admin] REQUEST_METHOD: `PUT` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:20:14.133414 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632c1ea1-6e70-411d-bf99-efc5817fd841 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:20:14.133682 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632c1ea1-6e70-411d-bf99-efc5817fd841 admin admin] PATH_INFO: `/v3/projects/1cc554471a6d4c4ebbedda904907e5c8/users/31108aaf5e62496591cfbd3b92debedd/roles/604444e7ad0d437dbd1f5a6e02b761f5` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:20:14.155979 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632c1ea1-6e70-411d-bf99-efc5817fd841 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cc554471a6d4c4ebbedda904907e5c8, user_id=31108aaf5e62496591cfbd3b92debedd, role_id=604444e7ad0d437dbd1f5a6e02b761f5)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:20:14.157002 dv-cinder-858276-1-smb devstack@keystone.service[81307]: WARNING py.warnings [None req-632c1ea1-6e70-411d-bf99-efc5817fd841 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 20 22:20:14.157002 dv-cinder-858276-1-smb devstack@keystone.service[81307]: warnings.warn(msg) Sep 20 22:20:14.157002 dv-cinder-858276-1-smb devstack@keystone.service[81307]: Sep 20 22:20:14.159563 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632c1ea1-6e70-411d-bf99-efc5817fd841 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:20:14.182910 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 742/1501] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:20:14 2022] PUT /identity/v3/projects/1cc554471a6d4c4ebbedda904907e5c8/users/31108aaf5e62496591cfbd3b92debedd/roles/604444e7ad0d437dbd1f5a6e02b761f5 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:20:14.194873 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd0d7d4-c40d-4df9-a0c2-b3983f230829 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:20:14.195159 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd0d7d4-c40d-4df9-a0c2-b3983f230829 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:20:14.195433 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd0d7d4-c40d-4df9-a0c2-b3983f230829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:20:14.250947 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-1bd0d7d4-c40d-4df9-a0c2-b3983f230829 None None] MFA Rules not processed for user `31108aaf5e62496591cfbd3b92debedd`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:20:14.252155 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-1bd0d7d4-c40d-4df9-a0c2-b3983f230829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:20:14.335909 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 760/1502] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:20:14 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:20:14.349602 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e753e2-30ee-4539-9a91-6d321f5a9998 None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:20:14.349890 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e753e2-30ee-4539-9a91-6d321f5a9998 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:20:14.350169 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e753e2-30ee-4539-9a91-6d321f5a9998 None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:20:14.351545 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 743/1503] 10.222.0.33 () {54 vars in 962 bytes} [Tue Sep 20 22:20:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:20:14.356529 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2580fce-eff6-404d-a4ea-c16b3f8a0a22 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:20:14.356847 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2580fce-eff6-404d-a4ea-c16b3f8a0a22 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:20:14.357124 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2580fce-eff6-404d-a4ea-c16b3f8a0a22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:20:14.392246 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:20:14.438100 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-d2580fce-eff6-404d-a4ea-c16b3f8a0a22 None None] MFA Rules not processed for user `6577c8b14c1f4279beac13b9ba11aba1`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:20:14.439355 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-d2580fce-eff6-404d-a4ea-c16b3f8a0a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:20:14.511728 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 761/1504] 10.222.0.33 () {58 vars in 1059 bytes} [Tue Sep 20 22:20:14 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:20:14.519630 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e753e2-30ee-4539-9a91-6d321f5a9998 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:20:14.521173 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-24e753e2-30ee-4539-9a91-6d321f5a9998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:20:14.572496 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:20:14.625905 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e753e2-30ee-4539-9a91-6d321f5a9998 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:20:14.697886 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532a1035-6a46-4703-b7a2-0f7628d51726 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577c8b14c1f4279beac13b9ba11aba1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:20:14.698419 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532a1035-6a46-4703-b7a2-0f7628d51726 service cinder] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:20:14.698722 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532a1035-6a46-4703-b7a2-0f7628d51726 service cinder] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:20:14.698996 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532a1035-6a46-4703-b7a2-0f7628d51726 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:20:14.700622 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-532a1035-6a46-4703-b7a2-0f7628d51726 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:20:14.798603 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532a1035-6a46-4703-b7a2-0f7628d51726 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:20:14.800018 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532a1035-6a46-4703-b7a2-0f7628d51726 service cinder] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:20:14.803425 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:20:14.818132 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 744/1505] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:20:14 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:20:14.863157 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440646d4-ae3c-4512-a9d2-2c35c59de00f None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:20:14.863442 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440646d4-ae3c-4512-a9d2-2c35c59de00f None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:20:14.863716 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440646d4-ae3c-4512-a9d2-2c35c59de00f None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:20:14.864988 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 762/1506] 10.222.0.33 () {52 vars in 830 bytes} [Tue Sep 20 22:20:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:20:14.868524 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532a1035-6a46-4703-b7a2-0f7628d51726 service cinder] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:20:14.869722 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-532a1035-6a46-4703-b7a2-0f7628d51726 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:20:14.969613 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532a1035-6a46-4703-b7a2-0f7628d51726 service cinder] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:20:15.062924 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3368da-837c-4f7b-a615-82236df512a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:20:15.063580 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3368da-837c-4f7b-a615-82236df512a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:20:15.064389 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3368da-837c-4f7b-a615-82236df512a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:20:15.064661 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3368da-837c-4f7b-a615-82236df512a0 admin admin] PATH_INFO: `/v3/users/31108aaf5e62496591cfbd3b92debedd` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:20:15.077264 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3368da-837c-4f7b-a615-82236df512a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31108aaf5e62496591cfbd3b92debedd)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:20:15.078277 dv-cinder-858276-1-smb devstack@keystone.service[81307]: WARNING py.warnings [None req-da3368da-837c-4f7b-a615-82236df512a0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 20 22:20:15.078277 dv-cinder-858276-1-smb devstack@keystone.service[81307]: warnings.warn(msg) Sep 20 22:20:15.078277 dv-cinder-858276-1-smb devstack@keystone.service[81307]: Sep 20 22:20:15.079523 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3368da-837c-4f7b-a615-82236df512a0 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:20:15.089183 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:20:15.144382 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-da3368da-837c-4f7b-a615-82236df512a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31108aaf5e62496591cfbd3b92debedd'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:20:15.153084 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-da3368da-837c-4f7b-a615-82236df512a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31108aaf5e62496591cfbd3b92debedd'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:20:15.153592 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-da3368da-837c-4f7b-a615-82236df512a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31108aaf5e62496591cfbd3b92debedd'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:20:15.154015 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-da3368da-837c-4f7b-a615-82236df512a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31108aaf5e62496591cfbd3b92debedd'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:20:15.168115 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-da3368da-837c-4f7b-a615-82236df512a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31108aaf5e62496591cfbd3b92debedd'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:20:15.195875 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 745/1507] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 20 22:20:14 2022] DELETE /identity/v3/users/31108aaf5e62496591cfbd3b92debedd => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:20:15.200363 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30942bb-cb35-400a-a9a2-946b299dbb46 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:20:15.200873 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30942bb-cb35-400a-a9a2-946b299dbb46 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:20:15.200976 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30942bb-cb35-400a-a9a2-946b299dbb46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:20:15.257602 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-f30942bb-cb35-400a-a9a2-946b299dbb46 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:20:15.258771 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-f30942bb-cb35-400a-a9a2-946b299dbb46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:20:15.334360 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:20:15.346986 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 763/1508] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:20:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:20:15.357183 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3368da-837c-4f7b-a615-82236df512a0 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:20:15.358402 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-da3368da-837c-4f7b-a615-82236df512a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:20:15.458256 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3368da-837c-4f7b-a615-82236df512a0 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:20:15.511499 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:20:15.532399 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b2b469-7889-4961-b7a9-6d784471f5b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b0b3ca4ecd41aaba9cf8e0f91fbf54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:20:15.533008 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b2b469-7889-4961-b7a9-6d784471f5b3 service neutron] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:20:15.533286 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b2b469-7889-4961-b7a9-6d784471f5b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:20:15.533556 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b2b469-7889-4961-b7a9-6d784471f5b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:20:15.535176 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-76b2b469-7889-4961-b7a9-6d784471f5b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:20:15.642418 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b2b469-7889-4961-b7a9-6d784471f5b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:20:15.643917 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b2b469-7889-4961-b7a9-6d784471f5b3 service neutron] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:20:15.661352 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 746/1509] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:20:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:20:16.026424 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30942bb-cb35-400a-a9a2-946b299dbb46 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:20:16.027797 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-f30942bb-cb35-400a-a9a2-946b299dbb46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:20:16.040630 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30942bb-cb35-400a-a9a2-946b299dbb46 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:20:16.138265 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b0c5b2-ebcb-44db-bbe3-8e0c00a0a870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:20:16.138927 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b0c5b2-ebcb-44db-bbe3-8e0c00a0a870 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:20:16.139212 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b0c5b2-ebcb-44db-bbe3-8e0c00a0a870 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:20:16.139484 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b0c5b2-ebcb-44db-bbe3-8e0c00a0a870 admin admin] PATH_INFO: `/v3/projects/1cc554471a6d4c4ebbedda904907e5c8` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:20:16.149857 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b0c5b2-ebcb-44db-bbe3-8e0c00a0a870 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cc554471a6d4c4ebbedda904907e5c8)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:20:16.150911 dv-cinder-858276-1-smb devstack@keystone.service[81306]: WARNING py.warnings [None req-63b0c5b2-ebcb-44db-bbe3-8e0c00a0a870 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 20 22:20:16.150911 dv-cinder-858276-1-smb devstack@keystone.service[81306]: warnings.warn(msg) Sep 20 22:20:16.150911 dv-cinder-858276-1-smb devstack@keystone.service[81306]: Sep 20 22:20:16.152121 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b0c5b2-ebcb-44db-bbe3-8e0c00a0a870 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:20:16.210067 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-63b0c5b2-ebcb-44db-bbe3-8e0c00a0a870 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cc554471a6d4c4ebbedda904907e5c8', 'request_id': 'req-63b0c5b2-ebcb-44db-bbe3-8e0c00a0a870'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:20:16.224850 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-63b0c5b2-ebcb-44db-bbe3-8e0c00a0a870 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cc554471a6d4c4ebbedda904907e5c8', 'request_id': 'req-63b0c5b2-ebcb-44db-bbe3-8e0c00a0a870'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:20:16.233920 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-63b0c5b2-ebcb-44db-bbe3-8e0c00a0a870 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cc554471a6d4c4ebbedda904907e5c8', 'request_id': 'req-63b0c5b2-ebcb-44db-bbe3-8e0c00a0a870'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:20:16.257290 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-63b0c5b2-ebcb-44db-bbe3-8e0c00a0a870 admin admin] The token cache is being invalidate because project 1cc554471a6d4c4ebbedda904907e5c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81306) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 22:20:16.257574 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-63b0c5b2-ebcb-44db-bbe3-8e0c00a0a870 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:20:16.258082 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-63b0c5b2-ebcb-44db-bbe3-8e0c00a0a870 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:20:16.259399 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 764/1510] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 20 22:20:16 2022] DELETE /identity/v3/projects/1cc554471a6d4c4ebbedda904907e5c8 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:20:25.659206 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=62 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:20:26.255343 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:21:48.808854 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc05a3b-dd3a-4b10-ac94-aa01adb34eb3 None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:21:48.809416 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc05a3b-dd3a-4b10-ac94-aa01adb34eb3 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:21:48.809416 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc05a3b-dd3a-4b10-ac94-aa01adb34eb3 None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:21:48.810901 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 747/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 20 22:21:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:21:48.816434 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e5277-983f-4cf0-8c33-3f8a04712374 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:21:48.816892 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e5277-983f-4cf0-8c33-3f8a04712374 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:21:48.816998 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e5277-983f-4cf0-8c33-3f8a04712374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:21:48.899926 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-bb3e5277-983f-4cf0-8c33-3f8a04712374 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:21:48.901154 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-bb3e5277-983f-4cf0-8c33-3f8a04712374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:21:49.002808 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 765/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 20 22:21:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:21:49.168855 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc05a3b-dd3a-4b10-ac94-aa01adb34eb3 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:21:49.171608 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-8dc05a3b-dd3a-4b10-ac94-aa01adb34eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:21:49.287240 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc05a3b-dd3a-4b10-ac94-aa01adb34eb3 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:21:49.292840 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c32ee70-64a3-4a00-bf84-0234203c50ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db7eed561e99452289a662ad326cf919', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:21:49.293457 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c32ee70-64a3-4a00-bf84-0234203c50ee service nova] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:21:49.293739 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c32ee70-64a3-4a00-bf84-0234203c50ee service nova] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:21:49.294010 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c32ee70-64a3-4a00-bf84-0234203c50ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:21:49.303049 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c32ee70-64a3-4a00-bf84-0234203c50ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:21:49.304627 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c32ee70-64a3-4a00-bf84-0234203c50ee service nova] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:21:49.313990 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 748/1513] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:21:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:21:50.399230 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57532bab-fff5-4cf8-86d4-d645bdea2da1 None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:21:50.399805 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57532bab-fff5-4cf8-86d4-d645bdea2da1 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:21:50.399805 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57532bab-fff5-4cf8-86d4-d645bdea2da1 None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:21:50.401133 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 766/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 20 22:21:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:21:50.407979 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d580487-a24c-4add-bdcb-44503267db02 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:21:50.408424 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d580487-a24c-4add-bdcb-44503267db02 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:21:50.408527 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d580487-a24c-4add-bdcb-44503267db02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:21:50.428191 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-2d580487-a24c-4add-bdcb-44503267db02 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:21:50.429390 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-2d580487-a24c-4add-bdcb-44503267db02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:21:50.437740 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 749/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 20 22:21:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:21:50.590210 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57532bab-fff5-4cf8-86d4-d645bdea2da1 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:21:50.604273 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57532bab-fff5-4cf8-86d4-d645bdea2da1 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:21:50.609612 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745ac225-a4c4-4017-9c92-e2a8464d58eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db7eed561e99452289a662ad326cf919', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:21:50.610200 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ac225-a4c4-4017-9c92-e2a8464d58eb service nova] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:21:50.610481 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ac225-a4c4-4017-9c92-e2a8464d58eb service nova] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:21:50.610780 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ac225-a4c4-4017-9c92-e2a8464d58eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:21:50.618729 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745ac225-a4c4-4017-9c92-e2a8464d58eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:21:50.620295 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745ac225-a4c4-4017-9c92-e2a8464d58eb service nova] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:21:50.630029 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 767/1516] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:21:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:21:51.362852 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb1c23f-f86a-48cb-b16f-7873e07e1258 None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:21:51.363120 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb1c23f-f86a-48cb-b16f-7873e07e1258 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:21:51.363392 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb1c23f-f86a-48cb-b16f-7873e07e1258 None None] PATH_INFO: `/v3` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:21:51.364687 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 750/1517] 10.222.0.50 () {54 vars in 925 bytes} [Tue Sep 20 22:21:51 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:21:51.391442 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936be377-4945-419f-af00-da9aa7f130fe None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:21:51.391729 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936be377-4945-419f-af00-da9aa7f130fe None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:21:51.392006 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936be377-4945-419f-af00-da9aa7f130fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:21:51.450745 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-936be377-4945-419f-af00-da9aa7f130fe None None] MFA Rules not processed for user `c79676ee86294dab92ba732e38d6fa74`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:21:51.451957 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-936be377-4945-419f-af00-da9aa7f130fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:21:51.468846 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:21:51.522581 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 768/1518] 10.222.0.50 () {58 vars in 1015 bytes} [Tue Sep 20 22:21:51 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:21:55.168592 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47a9d08-c32b-4074-a015-5dbc49b0b65a None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:21:55.169011 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47a9d08-c32b-4074-a015-5dbc49b0b65a None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:21:55.169137 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47a9d08-c32b-4074-a015-5dbc49b0b65a None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:21:55.170465 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 751/1519] 10.222.0.33 () {54 vars in 961 bytes} [Tue Sep 20 22:21:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:21:55.175759 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce3b95d-1451-42fd-bad3-c701a8583bcb None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:21:55.176201 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce3b95d-1451-42fd-bad3-c701a8583bcb None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:21:55.176332 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce3b95d-1451-42fd-bad3-c701a8583bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:21:55.195861 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-1ce3b95d-1451-42fd-bad3-c701a8583bcb None None] MFA Rules not processed for user `c79676ee86294dab92ba732e38d6fa74`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:21:55.197041 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-1ce3b95d-1451-42fd-bad3-c701a8583bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:21:55.206105 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 769/1520] 10.222.0.33 () {58 vars in 1058 bytes} [Tue Sep 20 22:21:55 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:21:55.213658 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47a9d08-c32b-4074-a015-5dbc49b0b65a None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:21:55.227362 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47a9d08-c32b-4074-a015-5dbc49b0b65a None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:21:55.232209 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7bb03a-321b-42e2-9d46-41dfb428db31 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c79676ee86294dab92ba732e38d6fa74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:21:55.232788 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7bb03a-321b-42e2-9d46-41dfb428db31 service placement] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:21:55.233067 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7bb03a-321b-42e2-9d46-41dfb428db31 service placement] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:21:55.233344 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7bb03a-321b-42e2-9d46-41dfb428db31 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:21:55.241371 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7bb03a-321b-42e2-9d46-41dfb428db31 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:21:55.242967 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7bb03a-321b-42e2-9d46-41dfb428db31 service placement] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:21:55.252325 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 752/1521] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:21:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:22:02.108572 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b561a7f-adc7-4095-88f4-574686fbcc90 None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:22:02.109749 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b561a7f-adc7-4095-88f4-574686fbcc90 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:22:02.109749 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b561a7f-adc7-4095-88f4-574686fbcc90 None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:22:02.111012 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 770/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 20 22:22:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:22:02.116982 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d315f65c-11ad-4dd0-92c4-27edb57658a1 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:22:02.117402 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d315f65c-11ad-4dd0-92c4-27edb57658a1 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:22:02.117533 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d315f65c-11ad-4dd0-92c4-27edb57658a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:22:02.136814 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-d315f65c-11ad-4dd0-92c4-27edb57658a1 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:22:02.137998 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-d315f65c-11ad-4dd0-92c4-27edb57658a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:22:02.145628 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 753/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 20 22:22:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:22:02.299901 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b561a7f-adc7-4095-88f4-574686fbcc90 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:22:02.315068 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b561a7f-adc7-4095-88f4-574686fbcc90 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:22:02.320376 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f16aedd-c341-4e2e-b58c-370da35fc4c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db7eed561e99452289a662ad326cf919', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:22:02.320964 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f16aedd-c341-4e2e-b58c-370da35fc4c8 service nova] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:22:02.321238 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f16aedd-c341-4e2e-b58c-370da35fc4c8 service nova] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:22:02.321512 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f16aedd-c341-4e2e-b58c-370da35fc4c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:22:02.329373 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f16aedd-c341-4e2e-b58c-370da35fc4c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:22:02.330979 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f16aedd-c341-4e2e-b58c-370da35fc4c8 service nova] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:22:02.340008 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 771/1524] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:22:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 20 22:22:03.404674 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c2cfa9-c9e7-42e6-a10c-b6a6b5e2ac0d None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:22:03.405223 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c2cfa9-c9e7-42e6-a10c-b6a6b5e2ac0d None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:22:03.405223 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c2cfa9-c9e7-42e6-a10c-b6a6b5e2ac0d None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:22:03.407898 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 754/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 20 22:22:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:22:03.414255 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53250559-4d43-4615-8f1c-b62828e0610f None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:22:03.414774 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53250559-4d43-4615-8f1c-b62828e0610f None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:22:03.414880 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53250559-4d43-4615-8f1c-b62828e0610f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:22:03.434136 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-53250559-4d43-4615-8f1c-b62828e0610f None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:22:03.435353 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-53250559-4d43-4615-8f1c-b62828e0610f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:22:03.443042 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 772/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 20 22:22:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:22:03.595710 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c2cfa9-c9e7-42e6-a10c-b6a6b5e2ac0d None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:22:03.610241 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c2cfa9-c9e7-42e6-a10c-b6a6b5e2ac0d None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:22:03.615638 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84068695-e86d-48d5-bb27-552a038f3e4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db7eed561e99452289a662ad326cf919', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:22:03.616223 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84068695-e86d-48d5-bb27-552a038f3e4a service nova] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:22:03.616504 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84068695-e86d-48d5-bb27-552a038f3e4a service nova] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:22:03.616771 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84068695-e86d-48d5-bb27-552a038f3e4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:22:03.625160 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84068695-e86d-48d5-bb27-552a038f3e4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:22:03.626742 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84068695-e86d-48d5-bb27-552a038f3e4a service nova] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:22:03.636221 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 755/1527] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:22:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:22:07.491339 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76710c2e-14e6-4782-85dc-f655455cdb3d None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:22:07.491910 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76710c2e-14e6-4782-85dc-f655455cdb3d None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:22:07.491910 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76710c2e-14e6-4782-85dc-f655455cdb3d None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:22:07.493243 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 773/1528] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 20 22:22:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:22:07.498523 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0666992-2ace-42a9-a870-a1ede7b2511b None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:22:07.498968 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0666992-2ace-42a9-a870-a1ede7b2511b None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:22:07.499082 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0666992-2ace-42a9-a870-a1ede7b2511b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:22:07.517950 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-f0666992-2ace-42a9-a870-a1ede7b2511b None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:22:07.519175 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-f0666992-2ace-42a9-a870-a1ede7b2511b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:22:07.527024 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 756/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 20 22:22:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:22:07.817010 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76710c2e-14e6-4782-85dc-f655455cdb3d None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:22:07.818769 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-76710c2e-14e6-4782-85dc-f655455cdb3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:22:07.896974 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76710c2e-14e6-4782-85dc-f655455cdb3d None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:22:07.900534 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de91728-d13f-4280-8ffc-5ef3c5de509c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b0b3ca4ecd41aaba9cf8e0f91fbf54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:22:07.901144 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de91728-d13f-4280-8ffc-5ef3c5de509c service neutron] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:22:07.901426 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de91728-d13f-4280-8ffc-5ef3c5de509c service neutron] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:22:07.901700 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de91728-d13f-4280-8ffc-5ef3c5de509c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:22:07.911036 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de91728-d13f-4280-8ffc-5ef3c5de509c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:22:07.912466 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de91728-d13f-4280-8ffc-5ef3c5de509c service neutron] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:22:07.921761 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 774/1530] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:22:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:22:10.051737 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51b2af6-de01-4fd2-bee8-764f96c1eac4 None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:22:10.052274 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51b2af6-de01-4fd2-bee8-764f96c1eac4 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:22:10.052274 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51b2af6-de01-4fd2-bee8-764f96c1eac4 None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:22:10.053630 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 757/1531] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 20 22:22:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:22:10.059282 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79262d90-3732-450b-a14c-f97821d43536 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:22:10.059701 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79262d90-3732-450b-a14c-f97821d43536 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:22:10.059815 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79262d90-3732-450b-a14c-f97821d43536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:22:10.079678 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-79262d90-3732-450b-a14c-f97821d43536 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:22:10.080878 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-79262d90-3732-450b-a14c-f97821d43536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:22:10.088660 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 775/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 20 22:22:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 22:22:10.389826 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51b2af6-de01-4fd2-bee8-764f96c1eac4 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:22:10.391563 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-b51b2af6-de01-4fd2-bee8-764f96c1eac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:22:10.404640 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51b2af6-de01-4fd2-bee8-764f96c1eac4 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:22:10.408663 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4ef3df-ae26-4a5d-b641-e101376e58db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b0b3ca4ecd41aaba9cf8e0f91fbf54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:22:10.409264 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4ef3df-ae26-4a5d-b641-e101376e58db service neutron] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:22:10.409546 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4ef3df-ae26-4a5d-b641-e101376e58db service neutron] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:22:10.409819 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4ef3df-ae26-4a5d-b641-e101376e58db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:22:10.418647 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4ef3df-ae26-4a5d-b641-e101376e58db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:22:10.420062 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4ef3df-ae26-4a5d-b641-e101376e58db service neutron] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:22:10.430199 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 758/1533] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:22:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:22:13.946928 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0665fe38-796c-4383-944e-29219d357597 None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:22:13.947490 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0665fe38-796c-4383-944e-29219d357597 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:22:13.947490 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0665fe38-796c-4383-944e-29219d357597 None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:22:13.948804 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 776/1534] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 20 22:22:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:22:13.954490 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949f4170-b7e5-46a5-86e5-2a832f398bf9 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:22:13.954939 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949f4170-b7e5-46a5-86e5-2a832f398bf9 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:22:13.955102 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949f4170-b7e5-46a5-86e5-2a832f398bf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:22:13.975172 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-949f4170-b7e5-46a5-86e5-2a832f398bf9 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:22:13.976378 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-949f4170-b7e5-46a5-86e5-2a832f398bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:22:13.984273 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 759/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 20 22:22:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:22:14.293471 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0665fe38-796c-4383-944e-29219d357597 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:22:14.295183 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-0665fe38-796c-4383-944e-29219d357597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:22:14.358716 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:22:14.372778 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0665fe38-796c-4383-944e-29219d357597 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:22:14.376301 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95ee9a3-ed32-4cde-a858-a5026e7ea45c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577c8b14c1f4279beac13b9ba11aba1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:22:14.376898 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95ee9a3-ed32-4cde-a858-a5026e7ea45c service cinder] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:22:14.377176 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95ee9a3-ed32-4cde-a858-a5026e7ea45c service cinder] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:22:14.377447 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95ee9a3-ed32-4cde-a858-a5026e7ea45c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:22:14.386134 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95ee9a3-ed32-4cde-a858-a5026e7ea45c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:22:14.387574 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95ee9a3-ed32-4cde-a858-a5026e7ea45c service cinder] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:22:14.396773 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 777/1536] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:22:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:22:16.518847 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727a806d-4c25-4636-8ab0-3872b2f51028 None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:22:16.519397 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727a806d-4c25-4636-8ab0-3872b2f51028 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:22:16.519397 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727a806d-4c25-4636-8ab0-3872b2f51028 None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:22:16.520732 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 760/1537] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 20 22:22:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:22:16.526003 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e742a-c6fa-48b3-8868-581ec79e74fa None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:22:16.526406 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e742a-c6fa-48b3-8868-581ec79e74fa None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:22:16.526573 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e742a-c6fa-48b3-8868-581ec79e74fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:22:16.545724 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-cd5e742a-c6fa-48b3-8868-581ec79e74fa None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:22:16.546891 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-cd5e742a-c6fa-48b3-8868-581ec79e74fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:22:16.554771 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 778/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 20 22:22:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:22:16.855842 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727a806d-4c25-4636-8ab0-3872b2f51028 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:22:16.857531 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-727a806d-4c25-4636-8ab0-3872b2f51028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:22:16.864973 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=84 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:22:16.871389 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727a806d-4c25-4636-8ab0-3872b2f51028 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:22:16.874936 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9148a9-5e04-48a1-b82e-d863671bc5f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577c8b14c1f4279beac13b9ba11aba1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:22:16.875554 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9148a9-5e04-48a1-b82e-d863671bc5f5 service cinder] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:22:16.875837 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9148a9-5e04-48a1-b82e-d863671bc5f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:22:16.876106 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9148a9-5e04-48a1-b82e-d863671bc5f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:22:16.884836 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9148a9-5e04-48a1-b82e-d863671bc5f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:22:16.886250 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9148a9-5e04-48a1-b82e-d863671bc5f5 service cinder] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:22:16.895991 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 761/1539] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:22:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:22:26.540826 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=11 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:22:26.891929 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=5 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:23:45.193066 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bdd3b0-8b3b-4863-91c3-905f99ce2178 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:45.193717 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bdd3b0-8b3b-4863-91c3-905f99ce2178 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:45.193717 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bdd3b0-8b3b-4863-91c3-905f99ce2178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:45.223403 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-38bdd3b0-8b3b-4863-91c3-905f99ce2178 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:23:45.224770 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-38bdd3b0-8b3b-4863-91c3-905f99ce2178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:23:45.242990 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 779/1540] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:23:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:23:45.251849 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6638264-51e0-42cf-9ee1-cd1053a731a5 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:45.252864 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6638264-51e0-42cf-9ee1-cd1053a731a5 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:45.253362 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6638264-51e0-42cf-9ee1-cd1053a731a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:45.280284 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-e6638264-51e0-42cf-9ee1-cd1053a731a5 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:23:45.281921 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-e6638264-51e0-42cf-9ee1-cd1053a731a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:23:45.302490 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 762/1541] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:23:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:23:45.307755 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bdd3b0-8b3b-4863-91c3-905f99ce2178 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:23:45.324213 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bdd3b0-8b3b-4863-91c3-905f99ce2178 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:23:45.338691 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930b923b-c1be-462b-8fe5-4f74904752be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:23:45.339317 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930b923b-c1be-462b-8fe5-4f74904752be admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:45.339596 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930b923b-c1be-462b-8fe5-4f74904752be admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:45.339858 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930b923b-c1be-462b-8fe5-4f74904752be admin admin] PATH_INFO: `/v3/domains` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:45.340513 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930b923b-c1be-462b-8fe5-4f74904752be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:23:45.341451 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930b923b-c1be-462b-8fe5-4f74904752be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:23:45.343123 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930b923b-c1be-462b-8fe5-4f74904752be admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:23:45.360933 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 780/1542] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 20 22:23:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:23:45.369829 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6638264-51e0-42cf-9ee1-cd1053a731a5 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:23:45.383894 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6638264-51e0-42cf-9ee1-cd1053a731a5 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:23:45.389737 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bffb69d-23b3-440d-825e-0f35c62b1fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:23:45.390817 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bffb69d-23b3-440d-825e-0f35c62b1fd8 admin admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:45.391362 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bffb69d-23b3-440d-825e-0f35c62b1fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:45.391865 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bffb69d-23b3-440d-825e-0f35c62b1fd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:45.392722 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bffb69d-23b3-440d-825e-0f35c62b1fd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:23:45.395063 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bffb69d-23b3-440d-825e-0f35c62b1fd8 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:23:45.456661 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 763/1543] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 20 22:23:45 2022] POST /identity/v3/projects => generated 363 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:23:45.462772 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930b923b-c1be-462b-8fe5-4f74904752be admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:23:45.472867 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922378ea-2654-4681-b909-39b38394e120 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:45.473208 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922378ea-2654-4681-b909-39b38394e120 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:45.473418 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922378ea-2654-4681-b909-39b38394e120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:45.475459 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930b923b-c1be-462b-8fe5-4f74904752be admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:23:45.507708 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-922378ea-2654-4681-b909-39b38394e120 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:23:45.509261 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-922378ea-2654-4681-b909-39b38394e120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:23:45.606900 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f488db66-4229-4e65-bb61-c586f91e5227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:23:45.607543 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f488db66-4229-4e65-bb61-c586f91e5227 admin admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:45.607823 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f488db66-4229-4e65-bb61-c586f91e5227 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:45.608094 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f488db66-4229-4e65-bb61-c586f91e5227 admin admin] PATH_INFO: `/v3/users` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:45.609047 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f488db66-4229-4e65-bb61-c586f91e5227 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:23:45.611109 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f488db66-4229-4e65-bb61-c586f91e5227 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:23:45.633110 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 764/1544] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:23:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:23:45.643610 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0616f21a-9e64-4166-aba7-8530b49413a8 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:45.643881 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0616f21a-9e64-4166-aba7-8530b49413a8 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:45.644159 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0616f21a-9e64-4166-aba7-8530b49413a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:45.658474 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 781/1545] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 20 22:23:45 2022] POST /identity/v3/users => generated 282 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:23:45.662902 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f488db66-4229-4e65-bb61-c586f91e5227 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:23:45.679566 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-0616f21a-9e64-4166-aba7-8530b49413a8 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:23:45.680782 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-0616f21a-9e64-4166-aba7-8530b49413a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:23:45.681384 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f488db66-4229-4e65-bb61-c586f91e5227 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:23:45.693303 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5bc7fc-2e05-413d-8af2-6b1df38d26fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:23:45.693932 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5bc7fc-2e05-413d-8af2-6b1df38d26fb admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:45.694210 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5bc7fc-2e05-413d-8af2-6b1df38d26fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:45.694482 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5bc7fc-2e05-413d-8af2-6b1df38d26fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:45.695150 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5bc7fc-2e05-413d-8af2-6b1df38d26fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:23:45.696756 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5bc7fc-2e05-413d-8af2-6b1df38d26fb admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:23:45.697109 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 765/1546] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:23:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 22:23:45.704601 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0616f21a-9e64-4166-aba7-8530b49413a8 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:23:45.716951 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 782/1547] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:23:45 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 20 22:23:45.718773 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0616f21a-9e64-4166-aba7-8530b49413a8 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:23:45.721500 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbedd58-bfb6-4aed-9e1e-45c7286fe3a9 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:45.721787 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbedd58-bfb6-4aed-9e1e-45c7286fe3a9 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:45.722065 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbedd58-bfb6-4aed-9e1e-45c7286fe3a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:45.731932 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cac0151-baa1-438b-96bd-05d6eabfeb98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:23:45.732555 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cac0151-baa1-438b-96bd-05d6eabfeb98 admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:45.732958 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cac0151-baa1-438b-96bd-05d6eabfeb98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:45.733234 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cac0151-baa1-438b-96bd-05d6eabfeb98 admin admin] PATH_INFO: `/v3/domains` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:45.733882 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cac0151-baa1-438b-96bd-05d6eabfeb98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:23:45.734180 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cac0151-baa1-438b-96bd-05d6eabfeb98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:23:45.735228 dv-cinder-858276-1-smb devstack@keystone.service[81307]: WARNING py.warnings [None req-1cac0151-baa1-438b-96bd-05d6eabfeb98 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 20 22:23:45.735228 dv-cinder-858276-1-smb devstack@keystone.service[81307]: warnings.warn(msg) Sep 20 22:23:45.735228 dv-cinder-858276-1-smb devstack@keystone.service[81307]: Sep 20 22:23:45.736108 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cac0151-baa1-438b-96bd-05d6eabfeb98 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:23:45.764292 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-bbbedd58-bfb6-4aed-9e1e-45c7286fe3a9 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:23:45.765550 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 766/1548] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 20 22:23:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 22:23:45.765687 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-bbbedd58-bfb6-4aed-9e1e-45c7286fe3a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:23:45.766245 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cac0151-baa1-438b-96bd-05d6eabfeb98 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:23:45.788251 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 783/1549] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:23:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 22:23:45.788966 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbedd58-bfb6-4aed-9e1e-45c7286fe3a9 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:23:45.789289 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cac0151-baa1-438b-96bd-05d6eabfeb98 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:23:45.803458 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1de4c2-f9f2-4700-a3ff-5c560ecf3e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:23:45.804080 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1de4c2-f9f2-4700-a3ff-5c560ecf3e90 admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:45.804504 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1de4c2-f9f2-4700-a3ff-5c560ecf3e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:45.804627 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1de4c2-f9f2-4700-a3ff-5c560ecf3e90 admin admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:45.805260 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1de4c2-f9f2-4700-a3ff-5c560ecf3e90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:23:45.806386 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbedd58-bfb6-4aed-9e1e-45c7286fe3a9 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:23:45.806902 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1de4c2-f9f2-4700-a3ff-5c560ecf3e90 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:23:45.823896 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be9f9cb-756a-4862-9f05-4e46d0c4e87e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:23:45.824241 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 767/1550] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:23:45 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:23:45.824797 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be9f9cb-756a-4862-9f05-4e46d0c4e87e admin admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:45.825644 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be9f9cb-756a-4862-9f05-4e46d0c4e87e admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:45.825920 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be9f9cb-756a-4862-9f05-4e46d0c4e87e admin admin] PATH_INFO: `/v3/projects` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:45.826155 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11262b9e-a8e0-4d52-b6cd-51e7366b612e None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:45.826445 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11262b9e-a8e0-4d52-b6cd-51e7366b612e None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:45.826753 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11262b9e-a8e0-4d52-b6cd-51e7366b612e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:45.829392 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be9f9cb-756a-4862-9f05-4e46d0c4e87e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:23:45.831183 dv-cinder-858276-1-smb devstack@keystone.service[81306]: WARNING py.warnings [None req-1be9f9cb-756a-4862-9f05-4e46d0c4e87e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 20 22:23:45.831183 dv-cinder-858276-1-smb devstack@keystone.service[81306]: warnings.warn(msg) Sep 20 22:23:45.831183 dv-cinder-858276-1-smb devstack@keystone.service[81306]: Sep 20 22:23:45.832387 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be9f9cb-756a-4862-9f05-4e46d0c4e87e admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:23:45.874401 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-11262b9e-a8e0-4d52-b6cd-51e7366b612e None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:23:45.876451 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-11262b9e-a8e0-4d52-b6cd-51e7366b612e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:23:45.894915 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 768/1551] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:23:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:23:45.896627 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c8a718-143a-45c2-a571-054e082641aa None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:45.896921 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c8a718-143a-45c2-a571-054e082641aa None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:45.897290 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c8a718-143a-45c2-a571-054e082641aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:45.903368 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 784/1552] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 20 22:23:45 2022] POST /identity/v3/projects => generated 385 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:23:45.904144 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be9f9cb-756a-4862-9f05-4e46d0c4e87e admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:23:45.927319 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-d2c8a718-143a-45c2-a571-054e082641aa None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:23:45.928554 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-d2c8a718-143a-45c2-a571-054e082641aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:23:45.984929 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be9f9cb-756a-4862-9f05-4e46d0c4e87e admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:23:45.990115 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a637e7d9-8580-4727-a771-45fc12c566d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:23:45.990811 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a637e7d9-8580-4727-a771-45fc12c566d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:45.991092 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a637e7d9-8580-4727-a771-45fc12c566d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:45.991365 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a637e7d9-8580-4727-a771-45fc12c566d4 admin admin] PATH_INFO: `/v3/projects/24cf58807c92441fa8e4f3de54862b7f/users/47769e166f644729b5e1c726c3fa171e/roles/604444e7ad0d437dbd1f5a6e02b761f5` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:45.998822 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 769/1553] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:23:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:23:46.003383 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c8a718-143a-45c2-a571-054e082641aa None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:23:46.007456 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a637e7d9-8580-4727-a771-45fc12c566d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24cf58807c92441fa8e4f3de54862b7f, user_id=47769e166f644729b5e1c726c3fa171e, role_id=604444e7ad0d437dbd1f5a6e02b761f5)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:23:46.008586 dv-cinder-858276-1-smb devstack@keystone.service[81306]: WARNING py.warnings [None req-a637e7d9-8580-4727-a771-45fc12c566d4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 20 22:23:46.008586 dv-cinder-858276-1-smb devstack@keystone.service[81306]: warnings.warn(msg) Sep 20 22:23:46.008586 dv-cinder-858276-1-smb devstack@keystone.service[81306]: Sep 20 22:23:46.011345 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a637e7d9-8580-4727-a771-45fc12c566d4 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:23:46.014709 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c8a718-143a-45c2-a571-054e082641aa None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:23:46.020115 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ff0af7-c89a-43e6-b6ca-35c8b97fb7d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:23:46.020840 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff0af7-c89a-43e6-b6ca-35c8b97fb7d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:46.021124 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff0af7-c89a-43e6-b6ca-35c8b97fb7d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:46.021393 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff0af7-c89a-43e6-b6ca-35c8b97fb7d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:46.022038 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ff0af7-c89a-43e6-b6ca-35c8b97fb7d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:23:46.022338 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ff0af7-c89a-43e6-b6ca-35c8b97fb7d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:23:46.023952 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ff0af7-c89a-43e6-b6ca-35c8b97fb7d7 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:23:46.025470 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 785/1554] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:23:45 2022] PUT /identity/v3/projects/24cf58807c92441fa8e4f3de54862b7f/users/47769e166f644729b5e1c726c3fa171e/roles/604444e7ad0d437dbd1f5a6e02b761f5 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:23:46.026332 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a637e7d9-8580-4727-a771-45fc12c566d4 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:23:46.044795 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:23:46.047040 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 770/1555] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 20 22:23:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:23:46.048431 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c182f5fe-820d-4c13-a1e6-6f0552df0c03 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:46.048810 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c182f5fe-820d-4c13-a1e6-6f0552df0c03 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:46.049156 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c182f5fe-820d-4c13-a1e6-6f0552df0c03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:46.069952 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-c182f5fe-820d-4c13-a1e6-6f0552df0c03 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:23:46.071190 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-c182f5fe-820d-4c13-a1e6-6f0552df0c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:23:46.079617 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:23:46.096005 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a637e7d9-8580-4727-a771-45fc12c566d4 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:23:46.100763 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd06028-a904-4f09-a6ef-8c8f5a49b1b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:23:46.101366 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd06028-a904-4f09-a6ef-8c8f5a49b1b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:46.101642 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd06028-a904-4f09-a6ef-8c8f5a49b1b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:46.101914 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd06028-a904-4f09-a6ef-8c8f5a49b1b2 admin admin] PATH_INFO: `/v3/users` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:46.102555 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd06028-a904-4f09-a6ef-8c8f5a49b1b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:23:46.104520 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd06028-a904-4f09-a6ef-8c8f5a49b1b2 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:23:46.129819 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 786/1556] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 20 22:23:46 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:23:46.129819 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6672edda-8091-4c35-9211-9628a898b595 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:46.129819 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6672edda-8091-4c35-9211-9628a898b595 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:46.129819 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6672edda-8091-4c35-9211-9628a898b595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:46.134199 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 771/1557] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:23:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:23:46.135468 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b57ce1-8d6a-4c94-8cf2-8bfd75ab2978 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:46.135757 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b57ce1-8d6a-4c94-8cf2-8bfd75ab2978 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:46.136032 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b57ce1-8d6a-4c94-8cf2-8bfd75ab2978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:46.149411 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-6672edda-8091-4c35-9211-9628a898b595 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:23:46.151118 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-6672edda-8091-4c35-9211-9628a898b595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:23:46.155346 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-e9b57ce1-8d6a-4c94-8cf2-8bfd75ab2978 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:23:46.156606 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-e9b57ce1-8d6a-4c94-8cf2-8bfd75ab2978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:23:46.159952 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 787/1558] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:23:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:23:46.161126 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de1fe3e-d398-4d82-b91e-f97cea11c8bf None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:46.161402 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de1fe3e-d398-4d82-b91e-f97cea11c8bf None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:46.161676 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de1fe3e-d398-4d82-b91e-f97cea11c8bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:46.170878 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 772/1559] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:23:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:23:46.172607 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1455a74e-6533-4ebe-b9aa-097983044fc7 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:46.172893 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1455a74e-6533-4ebe-b9aa-097983044fc7 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:46.173165 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1455a74e-6533-4ebe-b9aa-097983044fc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:46.182354 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-5de1fe3e-d398-4d82-b91e-f97cea11c8bf None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:23:46.183569 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-5de1fe3e-d398-4d82-b91e-f97cea11c8bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:23:46.192026 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 788/1560] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:23:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:23:46.193284 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e7823c-7d7e-4388-a847-0c34c6c52242 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:46.193890 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e7823c-7d7e-4388-a847-0c34c6c52242 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:46.193987 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-1455a74e-6533-4ebe-b9aa-097983044fc7 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:23:46.194078 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e7823c-7d7e-4388-a847-0c34c6c52242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:46.195245 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-1455a74e-6533-4ebe-b9aa-097983044fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:23:46.203487 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 773/1561] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:23:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:23:46.204308 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1455a74e-6533-4ebe-b9aa-097983044fc7 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:23:46.213803 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1455a74e-6533-4ebe-b9aa-097983044fc7 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:23:46.218316 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aa1672-cb13-427b-af5a-1be13b29bfc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:23:46.218932 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aa1672-cb13-427b-af5a-1be13b29bfc0 admin admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:46.219206 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aa1672-cb13-427b-af5a-1be13b29bfc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:46.219476 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aa1672-cb13-427b-af5a-1be13b29bfc0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:46.220089 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aa1672-cb13-427b-af5a-1be13b29bfc0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:23:46.221967 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aa1672-cb13-427b-af5a-1be13b29bfc0 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:23:46.222895 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-c7e7823c-7d7e-4388-a847-0c34c6c52242 None None] MFA Rules not processed for user `47769e166f644729b5e1c726c3fa171e`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:23:46.224179 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-c7e7823c-7d7e-4388-a847-0c34c6c52242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:23:46.251867 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 774/1562] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 20 22:23:46 2022] POST /identity/v3/projects => generated 379 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:23:46.252781 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aa1672-cb13-427b-af5a-1be13b29bfc0 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:23:46.290546 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 789/1563] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:23:46 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:23:46.291806 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1bd79a-fa43-4626-bd00-74bc64debd56 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:46.292095 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1bd79a-fa43-4626-bd00-74bc64debd56 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:46.292404 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1bd79a-fa43-4626-bd00-74bc64debd56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:46.313641 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-1d1bd79a-fa43-4626-bd00-74bc64debd56 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:23:46.314915 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-1d1bd79a-fa43-4626-bd00-74bc64debd56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:23:46.322301 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aa1672-cb13-427b-af5a-1be13b29bfc0 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:23:46.322831 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 790/1564] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:23:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:23:46.324006 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c627d-6d05-4811-b9ee-8d50df511721 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:46.324290 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c627d-6d05-4811-b9ee-8d50df511721 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:46.324571 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c627d-6d05-4811-b9ee-8d50df511721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:46.329381 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0c6fb3-37c3-4a81-b19d-8b020c95f7e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:23:46.330037 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0c6fb3-37c3-4a81-b19d-8b020c95f7e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:46.330323 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0c6fb3-37c3-4a81-b19d-8b020c95f7e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:46.330675 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0c6fb3-37c3-4a81-b19d-8b020c95f7e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:46.331321 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0c6fb3-37c3-4a81-b19d-8b020c95f7e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:23:46.332910 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0c6fb3-37c3-4a81-b19d-8b020c95f7e3 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:23:46.346776 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 775/1565] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:23:46 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:23:46.346995 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-2c6c627d-6d05-4811-b9ee-8d50df511721 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:23:46.347104 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2112eefd-2d43-4381-aa1d-6c2fae8674f2 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:46.347104 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2112eefd-2d43-4381-aa1d-6c2fae8674f2 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:46.347104 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2112eefd-2d43-4381-aa1d-6c2fae8674f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:46.347382 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-2c6c627d-6d05-4811-b9ee-8d50df511721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:23:46.353672 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 791/1566] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:23:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:23:46.354892 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fce84ae-0ce6-4082-9f0b-c608127df380 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:46.355179 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fce84ae-0ce6-4082-9f0b-c608127df380 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:46.355478 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fce84ae-0ce6-4082-9f0b-c608127df380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:46.376767 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-2112eefd-2d43-4381-aa1d-6c2fae8674f2 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:23:46.377017 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-2fce84ae-0ce6-4082-9f0b-c608127df380 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:23:46.377973 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-2112eefd-2d43-4381-aa1d-6c2fae8674f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:23:46.378152 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-2fce84ae-0ce6-4082-9f0b-c608127df380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:23:46.385958 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 792/1567] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:23:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:23:46.386213 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 776/1568] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:23:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:23:46.386762 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fce84ae-0ce6-4082-9f0b-c608127df380 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:23:46.387337 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2112eefd-2d43-4381-aa1d-6c2fae8674f2 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:23:46.399229 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fce84ae-0ce6-4082-9f0b-c608127df380 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:23:46.400112 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2112eefd-2d43-4381-aa1d-6c2fae8674f2 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:23:46.404338 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d76efca-356b-423e-8d5b-c40016aae5cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:23:46.404929 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d76efca-356b-423e-8d5b-c40016aae5cd admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:46.405160 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3201809-14a1-4fec-aa87-f6d8469598f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:23:46.405272 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d76efca-356b-423e-8d5b-c40016aae5cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:46.405469 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d76efca-356b-423e-8d5b-c40016aae5cd admin admin] PATH_INFO: `/v3/domains` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:46.405746 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3201809-14a1-4fec-aa87-f6d8469598f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:46.406024 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3201809-14a1-4fec-aa87-f6d8469598f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:46.406146 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d76efca-356b-423e-8d5b-c40016aae5cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:23:46.406300 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3201809-14a1-4fec-aa87-f6d8469598f5 admin admin] PATH_INFO: `/v3/users` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:46.406444 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d76efca-356b-423e-8d5b-c40016aae5cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:23:46.406951 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3201809-14a1-4fec-aa87-f6d8469598f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:23:46.407987 dv-cinder-858276-1-smb devstack@keystone.service[81307]: WARNING py.warnings [None req-c3201809-14a1-4fec-aa87-f6d8469598f5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 20 22:23:46.407987 dv-cinder-858276-1-smb devstack@keystone.service[81307]: warnings.warn(msg) Sep 20 22:23:46.407987 dv-cinder-858276-1-smb devstack@keystone.service[81307]: Sep 20 22:23:46.408267 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d76efca-356b-423e-8d5b-c40016aae5cd admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:23:46.409171 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3201809-14a1-4fec-aa87-f6d8469598f5 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:23:46.420127 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 793/1569] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 20 22:23:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:23:46.420898 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d76efca-356b-423e-8d5b-c40016aae5cd admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:23:46.432291 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d76efca-356b-423e-8d5b-c40016aae5cd admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:23:46.433650 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 777/1570] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 20 22:23:46 2022] POST /identity/v3/users => generated 290 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:23:46.434557 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3201809-14a1-4fec-aa87-f6d8469598f5 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:23:46.437382 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ca69b5-0795-47b0-bf3c-e4d33a87f9f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:23:46.437974 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ca69b5-0795-47b0-bf3c-e4d33a87f9f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:46.438251 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ca69b5-0795-47b0-bf3c-e4d33a87f9f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:46.438554 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ca69b5-0795-47b0-bf3c-e4d33a87f9f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:46.439181 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ca69b5-0795-47b0-bf3c-e4d33a87f9f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:23:46.441072 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ca69b5-0795-47b0-bf3c-e4d33a87f9f4 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:23:46.444595 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3201809-14a1-4fec-aa87-f6d8469598f5 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:23:46.450424 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945bbaf0-d63a-4c64-9c0a-8052ec59ef2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:23:46.451088 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945bbaf0-d63a-4c64-9c0a-8052ec59ef2f admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:46.452075 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945bbaf0-d63a-4c64-9c0a-8052ec59ef2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:46.452369 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945bbaf0-d63a-4c64-9c0a-8052ec59ef2f admin admin] PATH_INFO: `/v3/domains` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:46.453021 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945bbaf0-d63a-4c64-9c0a-8052ec59ef2f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:23:46.453715 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945bbaf0-d63a-4c64-9c0a-8052ec59ef2f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:23:46.455368 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945bbaf0-d63a-4c64-9c0a-8052ec59ef2f admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:23:46.469664 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 778/1571] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 20 22:23:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:23:46.472702 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 794/1572] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 20 22:23:46 2022] POST /identity/v3/projects => generated 365 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:23:46.472847 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945bbaf0-d63a-4c64-9c0a-8052ec59ef2f admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:23:46.472932 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ca69b5-0795-47b0-bf3c-e4d33a87f9f4 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:23:46.484719 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945bbaf0-d63a-4c64-9c0a-8052ec59ef2f admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:23:46.501827 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:23:46.519890 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:23:46.539683 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ca69b5-0795-47b0-bf3c-e4d33a87f9f4 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:23:46.544693 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b48843-403c-4e61-93db-217bec610edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:23:46.544830 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520f0e13-9b7d-42a4-bf47-fa275bd333a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:23:46.545302 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b48843-403c-4e61-93db-217bec610edb admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:46.545460 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520f0e13-9b7d-42a4-bf47-fa275bd333a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:46.545594 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b48843-403c-4e61-93db-217bec610edb admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:46.545735 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520f0e13-9b7d-42a4-bf47-fa275bd333a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:46.545868 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b48843-403c-4e61-93db-217bec610edb admin admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:46.545970 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520f0e13-9b7d-42a4-bf47-fa275bd333a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:46.546793 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b48843-403c-4e61-93db-217bec610edb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:23:46.546919 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520f0e13-9b7d-42a4-bf47-fa275bd333a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:23:46.547199 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520f0e13-9b7d-42a4-bf47-fa275bd333a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:23:46.548406 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b48843-403c-4e61-93db-217bec610edb admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:23:46.548787 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520f0e13-9b7d-42a4-bf47-fa275bd333a7 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:23:46.558080 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 779/1573] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:23:46 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:23:46.558915 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b48843-403c-4e61-93db-217bec610edb admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:23:46.560981 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 795/1574] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 20 22:23:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:23:46.561958 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520f0e13-9b7d-42a4-bf47-fa275bd333a7 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:23:46.568502 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b48843-403c-4e61-93db-217bec610edb admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:23:46.572614 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520f0e13-9b7d-42a4-bf47-fa275bd333a7 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:23:46.573106 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7b11c9-7b81-4d0c-8776-2215e714f47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:23:46.573700 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b11c9-7b81-4d0c-8776-2215e714f47c admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:46.573985 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b11c9-7b81-4d0c-8776-2215e714f47c admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:46.574262 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b11c9-7b81-4d0c-8776-2215e714f47c admin admin] PATH_INFO: `/v3/domains` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:46.574964 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7b11c9-7b81-4d0c-8776-2215e714f47c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:23:46.575271 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7b11c9-7b81-4d0c-8776-2215e714f47c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:23:46.576887 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7b11c9-7b81-4d0c-8776-2215e714f47c admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:23:46.577264 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d2cfc5-0677-4846-9f8f-f62bf0d56338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:23:46.577872 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d2cfc5-0677-4846-9f8f-f62bf0d56338 admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:46.578285 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d2cfc5-0677-4846-9f8f-f62bf0d56338 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:46.578408 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d2cfc5-0677-4846-9f8f-f62bf0d56338 admin admin] PATH_INFO: `/v3/domains` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:46.579480 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d2cfc5-0677-4846-9f8f-f62bf0d56338 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:23:46.579480 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d2cfc5-0677-4846-9f8f-f62bf0d56338 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:23:46.580938 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d2cfc5-0677-4846-9f8f-f62bf0d56338 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:23:46.588967 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 780/1575] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 20 22:23:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:23:46.589893 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7b11c9-7b81-4d0c-8776-2215e714f47c admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:23:46.593385 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 796/1576] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 20 22:23:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:23:46.594337 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d2cfc5-0677-4846-9f8f-f62bf0d56338 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:23:46.600390 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7b11c9-7b81-4d0c-8776-2215e714f47c admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:23:46.604986 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd86fecc-be4d-4e22-b1dd-c2428b16db17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:23:46.605749 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd86fecc-be4d-4e22-b1dd-c2428b16db17 admin admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:46.606052 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd86fecc-be4d-4e22-b1dd-c2428b16db17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:46.607014 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd86fecc-be4d-4e22-b1dd-c2428b16db17 admin admin] PATH_INFO: `/v3/projects` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:46.607739 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd86fecc-be4d-4e22-b1dd-c2428b16db17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:23:46.609824 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd86fecc-be4d-4e22-b1dd-c2428b16db17 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:23:46.610494 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d2cfc5-0677-4846-9f8f-f62bf0d56338 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:23:46.615591 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea0a3aa-d8a9-4a45-aeb2-631c6076afaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:23:46.616178 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea0a3aa-d8a9-4a45-aeb2-631c6076afaa admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:46.616459 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea0a3aa-d8a9-4a45-aeb2-631c6076afaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:46.616731 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea0a3aa-d8a9-4a45-aeb2-631c6076afaa admin admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:46.617360 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea0a3aa-d8a9-4a45-aeb2-631c6076afaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:23:46.618971 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea0a3aa-d8a9-4a45-aeb2-631c6076afaa admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:23:46.630569 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 797/1577] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:23:46 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:23:46.631453 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea0a3aa-d8a9-4a45-aeb2-631c6076afaa admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:23:46.636979 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 781/1578] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 20 22:23:46 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:23:46.640261 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd86fecc-be4d-4e22-b1dd-c2428b16db17 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:23:46.641231 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea0a3aa-d8a9-4a45-aeb2-631c6076afaa admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:23:46.698044 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d32ed1d-dc15-4157-9500-7f46feabe754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:23:46.698686 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d32ed1d-dc15-4157-9500-7f46feabe754 admin admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:46.698965 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d32ed1d-dc15-4157-9500-7f46feabe754 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:46.699231 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d32ed1d-dc15-4157-9500-7f46feabe754 admin admin] PATH_INFO: `/v3/users` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:46.700378 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d32ed1d-dc15-4157-9500-7f46feabe754 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:23:46.702268 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d32ed1d-dc15-4157-9500-7f46feabe754 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:23:46.704527 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd86fecc-be4d-4e22-b1dd-c2428b16db17 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:23:46.709449 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b91289-8855-413d-9112-3a44c590534f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:23:46.710060 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b91289-8855-413d-9112-3a44c590534f admin admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:46.710343 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b91289-8855-413d-9112-3a44c590534f admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:46.710650 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b91289-8855-413d-9112-3a44c590534f admin admin] PATH_INFO: `/v3/projects` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:46.711285 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b91289-8855-413d-9112-3a44c590534f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:23:46.713260 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b91289-8855-413d-9112-3a44c590534f admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:23:46.723265 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 798/1579] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 20 22:23:46 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:23:46.724239 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d32ed1d-dc15-4157-9500-7f46feabe754 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:23:46.733673 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d32ed1d-dc15-4157-9500-7f46feabe754 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:23:46.738558 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eea478-e5fd-4889-b537-e477fe04a081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:23:46.739222 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eea478-e5fd-4889-b537-e477fe04a081 admin admin] REQUEST_METHOD: `PUT` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:46.739499 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eea478-e5fd-4889-b537-e477fe04a081 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:46.739768 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eea478-e5fd-4889-b537-e477fe04a081 admin admin] PATH_INFO: `/v3/projects/3b746b5c9b7548ab8fb16dca0ef7f227/users/c0a26034863a4590b4e2ec3a853a12b5/roles/604444e7ad0d437dbd1f5a6e02b761f5` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:46.746827 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 782/1580] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 20 22:23:46 2022] POST /identity/v3/projects => generated 405 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:23:46.746827 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b91289-8855-413d-9112-3a44c590534f admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:23:46.755087 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eea478-e5fd-4889-b537-e477fe04a081 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b746b5c9b7548ab8fb16dca0ef7f227, user_id=c0a26034863a4590b4e2ec3a853a12b5, role_id=604444e7ad0d437dbd1f5a6e02b761f5)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:23:46.757779 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eea478-e5fd-4889-b537-e477fe04a081 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:23:46.771659 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 799/1581] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:23:46 2022] PUT /identity/v3/projects/3b746b5c9b7548ab8fb16dca0ef7f227/users/c0a26034863a4590b4e2ec3a853a12b5/roles/604444e7ad0d437dbd1f5a6e02b761f5 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:23:46.772663 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eea478-e5fd-4889-b537-e477fe04a081 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:23:46.806999 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b91289-8855-413d-9112-3a44c590534f admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:23:46.837009 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:23:46.841189 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eea478-e5fd-4889-b537-e477fe04a081 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:23:46.847003 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02390724-dcc8-4a3c-a13c-d671b4ad383a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:23:46.847614 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02390724-dcc8-4a3c-a13c-d671b4ad383a admin admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:46.847893 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02390724-dcc8-4a3c-a13c-d671b4ad383a admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:46.848164 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02390724-dcc8-4a3c-a13c-d671b4ad383a admin admin] PATH_INFO: `/v3/projects` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:46.848797 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02390724-dcc8-4a3c-a13c-d671b4ad383a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:23:46.850709 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02390724-dcc8-4a3c-a13c-d671b4ad383a admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:23:46.855849 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:23:46.868257 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e0c3ac-f339-47c9-b5b3-e529e67efb93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:23:46.868515 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e0c3ac-f339-47c9-b5b3-e529e67efb93 admin admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:46.868798 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e0c3ac-f339-47c9-b5b3-e529e67efb93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:46.869073 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e0c3ac-f339-47c9-b5b3-e529e67efb93 admin admin] PATH_INFO: `/v3/projects` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:46.869722 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e0c3ac-f339-47c9-b5b3-e529e67efb93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:23:46.871672 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e0c3ac-f339-47c9-b5b3-e529e67efb93 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:23:46.879582 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 800/1582] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 20 22:23:46 2022] POST /identity/v3/projects => generated 389 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:23:46.880219 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02390724-dcc8-4a3c-a13c-d671b4ad383a admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:23:46.901256 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 783/1583] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 20 22:23:46 2022] POST /identity/v3/projects => generated 393 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:23:46.905802 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e0c3ac-f339-47c9-b5b3-e529e67efb93 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:23:46.945207 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02390724-dcc8-4a3c-a13c-d671b4ad383a admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:23:46.968556 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e0c3ac-f339-47c9-b5b3-e529e67efb93 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:23:46.973138 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8798e85-2fad-470b-8849-e0f19f03d37b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:23:46.973743 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8798e85-2fad-470b-8849-e0f19f03d37b admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:46.974019 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8798e85-2fad-470b-8849-e0f19f03d37b admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:46.974289 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8798e85-2fad-470b-8849-e0f19f03d37b admin admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:46.974957 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8798e85-2fad-470b-8849-e0f19f03d37b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:23:46.976541 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8798e85-2fad-470b-8849-e0f19f03d37b admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:23:46.986462 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 784/1584] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:23:46 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:23:46.987323 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8798e85-2fad-470b-8849-e0f19f03d37b admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:23:46.996539 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8798e85-2fad-470b-8849-e0f19f03d37b admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:23:47.001157 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaaffca-86a0-4ef8-a76d-81efd62f5d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:23:47.001733 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaaffca-86a0-4ef8-a76d-81efd62f5d6a admin admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:47.001855 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e67f7b-501c-4914-a741-fcc9d38d8c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:23:47.002014 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaaffca-86a0-4ef8-a76d-81efd62f5d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:47.002284 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaaffca-86a0-4ef8-a76d-81efd62f5d6a admin admin] PATH_INFO: `/v3/users` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:47.002392 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e67f7b-501c-4914-a741-fcc9d38d8c13 admin admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:47.002695 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e67f7b-501c-4914-a741-fcc9d38d8c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:47.002937 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaaffca-86a0-4ef8-a76d-81efd62f5d6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:23:47.003051 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e67f7b-501c-4914-a741-fcc9d38d8c13 admin admin] PATH_INFO: `/v3/projects` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:47.003582 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e67f7b-501c-4914-a741-fcc9d38d8c13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:23:47.004824 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaaffca-86a0-4ef8-a76d-81efd62f5d6a admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:23:47.005913 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e67f7b-501c-4914-a741-fcc9d38d8c13 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:23:47.029675 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 785/1585] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 20 22:23:46 2022] POST /identity/v3/users => generated 292 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:23:47.030421 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaaffca-86a0-4ef8-a76d-81efd62f5d6a admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:23:47.035023 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 801/1586] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 20 22:23:46 2022] POST /identity/v3/projects => generated 381 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:23:47.036034 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e67f7b-501c-4914-a741-fcc9d38d8c13 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:23:47.040001 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaaffca-86a0-4ef8-a76d-81efd62f5d6a admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:23:47.097923 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e67f7b-501c-4914-a741-fcc9d38d8c13 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:23:47.098175 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8f95fe-61b5-4ee0-8f50-2cac9a85996e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:23:47.098748 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8f95fe-61b5-4ee0-8f50-2cac9a85996e admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:47.099023 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8f95fe-61b5-4ee0-8f50-2cac9a85996e admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:47.099315 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8f95fe-61b5-4ee0-8f50-2cac9a85996e admin admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:47.100071 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8f95fe-61b5-4ee0-8f50-2cac9a85996e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:23:47.101753 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8f95fe-61b5-4ee0-8f50-2cac9a85996e admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:23:47.103032 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7519a2a-072f-4749-be57-b29036a53321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:23:47.103998 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7519a2a-072f-4749-be57-b29036a53321 admin admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:47.104296 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7519a2a-072f-4749-be57-b29036a53321 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:47.104569 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7519a2a-072f-4749-be57-b29036a53321 admin admin] PATH_INFO: `/v3/users` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:47.105200 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7519a2a-072f-4749-be57-b29036a53321 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:23:47.108575 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7519a2a-072f-4749-be57-b29036a53321 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:23:47.112702 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 786/1587] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:23:47 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:23:47.113904 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77351b11-e482-4a68-8ed3-fae5f5c6f744 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:47.114195 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77351b11-e482-4a68-8ed3-fae5f5c6f744 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:47.114472 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77351b11-e482-4a68-8ed3-fae5f5c6f744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:47.135421 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 802/1588] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 20 22:23:47 2022] POST /identity/v3/users => generated 303 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:23:47.135421 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7519a2a-072f-4749-be57-b29036a53321 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:23:47.135716 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-77351b11-e482-4a68-8ed3-fae5f5c6f744 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:23:47.136510 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-77351b11-e482-4a68-8ed3-fae5f5c6f744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:23:47.142660 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7519a2a-072f-4749-be57-b29036a53321 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:23:47.144194 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 787/1589] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:23:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:23:47.144940 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77351b11-e482-4a68-8ed3-fae5f5c6f744 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:23:47.150706 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9946e386-3653-431d-a56d-82094c3c3e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:23:47.151382 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9946e386-3653-431d-a56d-82094c3c3e42 admin admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:47.151756 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9946e386-3653-431d-a56d-82094c3c3e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:47.152110 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9946e386-3653-431d-a56d-82094c3c3e42 admin admin] PATH_INFO: `/v3/users` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:47.152825 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9946e386-3653-431d-a56d-82094c3c3e42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:23:47.155347 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9946e386-3653-431d-a56d-82094c3c3e42 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:23:47.157832 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77351b11-e482-4a68-8ed3-fae5f5c6f744 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:23:47.162489 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1745df5e-d57a-4266-b7de-c02ca073db34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:23:47.163111 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1745df5e-d57a-4266-b7de-c02ca073db34 admin admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:47.163394 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1745df5e-d57a-4266-b7de-c02ca073db34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:47.163674 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1745df5e-d57a-4266-b7de-c02ca073db34 admin admin] PATH_INFO: `/v3/users` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:47.163923 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:23:47.164297 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1745df5e-d57a-4266-b7de-c02ca073db34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:23:47.166371 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1745df5e-d57a-4266-b7de-c02ca073db34 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:23:47.181377 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 803/1590] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 20 22:23:47 2022] POST /identity/v3/users => generated 295 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:23:47.182293 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9946e386-3653-431d-a56d-82094c3c3e42 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:23:47.190706 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 788/1591] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 20 22:23:47 2022] POST /identity/v3/users => generated 297 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:23:47.191616 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1745df5e-d57a-4266-b7de-c02ca073db34 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:23:47.192872 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9946e386-3653-431d-a56d-82094c3c3e42 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:23:47.197948 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc6b5a9-e66b-4810-87a9-6470901d9723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:23:47.198634 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc6b5a9-e66b-4810-87a9-6470901d9723 admin admin] REQUEST_METHOD: `PUT` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:47.198919 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc6b5a9-e66b-4810-87a9-6470901d9723 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:47.199198 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc6b5a9-e66b-4810-87a9-6470901d9723 admin admin] PATH_INFO: `/v3/projects/29c58350c4b045148c31235e6dddc47b/users/738e985e59b54da6b729bc8007eb7f3d/roles/604444e7ad0d437dbd1f5a6e02b761f5` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:47.201248 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1745df5e-d57a-4266-b7de-c02ca073db34 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:23:47.206824 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3378d56-9b9e-400f-95c8-f9e897e07b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:23:47.207411 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3378d56-9b9e-400f-95c8-f9e897e07b44 admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:47.207684 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3378d56-9b9e-400f-95c8-f9e897e07b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:47.207951 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3378d56-9b9e-400f-95c8-f9e897e07b44 admin admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:47.208581 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3378d56-9b9e-400f-95c8-f9e897e07b44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:23:47.210165 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3378d56-9b9e-400f-95c8-f9e897e07b44 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:23:47.211538 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:23:47.216794 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc6b5a9-e66b-4810-87a9-6470901d9723 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29c58350c4b045148c31235e6dddc47b, user_id=738e985e59b54da6b729bc8007eb7f3d, role_id=604444e7ad0d437dbd1f5a6e02b761f5)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:23:47.219464 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc6b5a9-e66b-4810-87a9-6470901d9723 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:23:47.223000 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 789/1592] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:23:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:23:47.223845 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3378d56-9b9e-400f-95c8-f9e897e07b44 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:23:47.233991 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 804/1593] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:23:47 2022] PUT /identity/v3/projects/29c58350c4b045148c31235e6dddc47b/users/738e985e59b54da6b729bc8007eb7f3d/roles/604444e7ad0d437dbd1f5a6e02b761f5 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:23:47.234302 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3378d56-9b9e-400f-95c8-f9e897e07b44 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:23:47.234630 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc6b5a9-e66b-4810-87a9-6470901d9723 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:23:47.290774 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274ece67-fba5-409c-9d51-486aa8d726ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:23:47.291313 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274ece67-fba5-409c-9d51-486aa8d726ec admin admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:47.291576 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274ece67-fba5-409c-9d51-486aa8d726ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:47.291849 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274ece67-fba5-409c-9d51-486aa8d726ec admin admin] PATH_INFO: `/v3/users` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:47.292493 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274ece67-fba5-409c-9d51-486aa8d726ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:23:47.295184 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274ece67-fba5-409c-9d51-486aa8d726ec admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:23:47.299631 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc6b5a9-e66b-4810-87a9-6470901d9723 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:23:47.304351 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0412964-7456-4221-bd68-9a6a0302986d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:23:47.305020 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0412964-7456-4221-bd68-9a6a0302986d admin admin] REQUEST_METHOD: `PUT` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:47.305300 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0412964-7456-4221-bd68-9a6a0302986d admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:47.305601 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0412964-7456-4221-bd68-9a6a0302986d admin admin] PATH_INFO: `/v3/projects/f4e9697050574a698db82cb1066e1882/users/add49883cb644f549b73e3928ff1ed69/roles/8a829170b29d42d6af589399e51edb0f` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:47.319742 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 790/1594] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 20 22:23:47 2022] POST /identity/v3/users => generated 291 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:23:47.319742 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274ece67-fba5-409c-9d51-486aa8d726ec admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:23:47.321719 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0412964-7456-4221-bd68-9a6a0302986d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4e9697050574a698db82cb1066e1882, user_id=add49883cb644f549b73e3928ff1ed69, role_id=8a829170b29d42d6af589399e51edb0f)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:23:47.325300 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0412964-7456-4221-bd68-9a6a0302986d admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:23:47.327067 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274ece67-fba5-409c-9d51-486aa8d726ec admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:23:47.331723 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d101e6df-75ef-40b7-81c3-b64db62c63f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:23:47.332312 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d101e6df-75ef-40b7-81c3-b64db62c63f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:47.332576 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d101e6df-75ef-40b7-81c3-b64db62c63f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:47.332852 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d101e6df-75ef-40b7-81c3-b64db62c63f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:47.333493 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d101e6df-75ef-40b7-81c3-b64db62c63f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:23:47.335111 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d101e6df-75ef-40b7-81c3-b64db62c63f9 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:23:47.341541 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 805/1595] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:23:47 2022] PUT /identity/v3/projects/f4e9697050574a698db82cb1066e1882/users/add49883cb644f549b73e3928ff1ed69/roles/8a829170b29d42d6af589399e51edb0f => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:23:47.341541 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0412964-7456-4221-bd68-9a6a0302986d admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:23:47.347361 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 791/1596] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:23:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:23:47.348530 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d101e6df-75ef-40b7-81c3-b64db62c63f9 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:23:47.359116 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d101e6df-75ef-40b7-81c3-b64db62c63f9 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:23:47.396772 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0412964-7456-4221-bd68-9a6a0302986d admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:23:47.400748 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db71f64-6236-43ee-a731-7d3c41518ece service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b0b3ca4ecd41aaba9cf8e0f91fbf54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:23:47.401477 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db71f64-6236-43ee-a731-7d3c41518ece service neutron] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:47.401857 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db71f64-6236-43ee-a731-7d3c41518ece service neutron] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:47.402282 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db71f64-6236-43ee-a731-7d3c41518ece service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:47.422912 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c254f6-6665-4735-96bd-279c874bf615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:23:47.423523 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c254f6-6665-4735-96bd-279c874bf615 admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:47.423806 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c254f6-6665-4735-96bd-279c874bf615 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:47.424088 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c254f6-6665-4735-96bd-279c874bf615 admin admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:47.424718 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c254f6-6665-4735-96bd-279c874bf615 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:23:47.426322 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c254f6-6665-4735-96bd-279c874bf615 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:23:47.437136 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 792/1597] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:23:47 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:23:47.437923 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c254f6-6665-4735-96bd-279c874bf615 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:23:47.447350 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c254f6-6665-4735-96bd-279c874bf615 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:23:47.452538 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09e4614-b78d-47a8-89a5-84c39a5ae0c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:23:47.453117 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09e4614-b78d-47a8-89a5-84c39a5ae0c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:47.453401 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09e4614-b78d-47a8-89a5-84c39a5ae0c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:47.453676 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09e4614-b78d-47a8-89a5-84c39a5ae0c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:47.454301 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09e4614-b78d-47a8-89a5-84c39a5ae0c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:23:47.455901 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09e4614-b78d-47a8-89a5-84c39a5ae0c2 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:23:47.464062 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db71f64-6236-43ee-a731-7d3c41518ece service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:23:47.466085 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db71f64-6236-43ee-a731-7d3c41518ece service neutron] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:23:47.466854 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 793/1598] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:23:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:23:47.467618 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09e4614-b78d-47a8-89a5-84c39a5ae0c2 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:23:47.470404 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:23:47.477050 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09e4614-b78d-47a8-89a5-84c39a5ae0c2 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:23:47.477351 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 806/1599] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:23:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:23:47.478852 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12f55a6-c27d-4b6f-bcdb-cd960499d602 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:47.479351 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12f55a6-c27d-4b6f-bcdb-cd960499d602 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:47.479786 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12f55a6-c27d-4b6f-bcdb-cd960499d602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:47.481970 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08bdc8e-fc91-4c80-972f-6d575e98dca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:23:47.482589 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08bdc8e-fc91-4c80-972f-6d575e98dca7 admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:47.482881 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08bdc8e-fc91-4c80-972f-6d575e98dca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:47.483154 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08bdc8e-fc91-4c80-972f-6d575e98dca7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:47.483791 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08bdc8e-fc91-4c80-972f-6d575e98dca7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:23:47.485382 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08bdc8e-fc91-4c80-972f-6d575e98dca7 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:23:47.499746 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 794/1600] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:23:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:23:47.499746 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08bdc8e-fc91-4c80-972f-6d575e98dca7 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:23:47.501085 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-c12f55a6-c27d-4b6f-bcdb-cd960499d602 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:23:47.502361 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-c12f55a6-c27d-4b6f-bcdb-cd960499d602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:23:47.507281 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08bdc8e-fc91-4c80-972f-6d575e98dca7 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:23:47.511194 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 807/1601] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:23:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:23:47.512071 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12f55a6-c27d-4b6f-bcdb-cd960499d602 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:23:47.515967 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2200ec-d675-4b94-8db3-155d2de341f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:23:47.516667 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2200ec-d675-4b94-8db3-155d2de341f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:47.517057 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2200ec-d675-4b94-8db3-155d2de341f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:47.517362 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2200ec-d675-4b94-8db3-155d2de341f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:47.518088 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2200ec-d675-4b94-8db3-155d2de341f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:23:47.519789 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2200ec-d675-4b94-8db3-155d2de341f2 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:23:47.522995 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12f55a6-c27d-4b6f-bcdb-cd960499d602 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:23:47.527939 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284b89d8-25b9-4728-9720-9c1db821cc9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:23:47.529303 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284b89d8-25b9-4728-9720-9c1db821cc9c admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:47.529476 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284b89d8-25b9-4728-9720-9c1db821cc9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:47.529834 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284b89d8-25b9-4728-9720-9c1db821cc9c admin admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:47.530565 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284b89d8-25b9-4728-9720-9c1db821cc9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:23:47.532216 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284b89d8-25b9-4728-9720-9c1db821cc9c admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:23:47.535579 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 795/1602] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:23:47 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:23:47.535579 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2200ec-d675-4b94-8db3-155d2de341f2 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:23:47.543743 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2200ec-d675-4b94-8db3-155d2de341f2 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:23:47.545113 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 808/1603] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:23:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:23:47.546010 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284b89d8-25b9-4728-9720-9c1db821cc9c admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:23:47.549012 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09144f14-584f-434e-b2ed-60f3d353f232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:23:47.549614 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09144f14-584f-434e-b2ed-60f3d353f232 admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:47.549974 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09144f14-584f-434e-b2ed-60f3d353f232 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:47.550324 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09144f14-584f-434e-b2ed-60f3d353f232 admin admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:47.551071 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09144f14-584f-434e-b2ed-60f3d353f232 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:23:47.552740 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09144f14-584f-434e-b2ed-60f3d353f232 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:23:47.556760 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284b89d8-25b9-4728-9720-9c1db821cc9c admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:23:47.562035 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc9cf14-fdbe-4c19-9535-c3a55de99506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:23:47.562752 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc9cf14-fdbe-4c19-9535-c3a55de99506 admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:47.563092 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc9cf14-fdbe-4c19-9535-c3a55de99506 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:47.566719 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc9cf14-fdbe-4c19-9535-c3a55de99506 admin admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:47.566878 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 796/1604] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:23:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:23:47.566982 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc9cf14-fdbe-4c19-9535-c3a55de99506 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:23:47.567089 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09144f14-584f-434e-b2ed-60f3d353f232 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:23:47.567221 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc9cf14-fdbe-4c19-9535-c3a55de99506 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:23:47.574096 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09144f14-584f-434e-b2ed-60f3d353f232 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:23:47.579410 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 809/1605] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:23:47 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:23:47.579575 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1215d1-8022-4408-a5d6-aaa256c12897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:23:47.579879 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1215d1-8022-4408-a5d6-aaa256c12897 admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:47.580156 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1215d1-8022-4408-a5d6-aaa256c12897 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:47.580270 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc9cf14-fdbe-4c19-9535-c3a55de99506 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:23:47.580707 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1215d1-8022-4408-a5d6-aaa256c12897 admin admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:47.581082 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1215d1-8022-4408-a5d6-aaa256c12897 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:23:47.582816 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1215d1-8022-4408-a5d6-aaa256c12897 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:23:47.591527 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc9cf14-fdbe-4c19-9535-c3a55de99506 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:23:47.599577 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 797/1606] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:23:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:23:47.599731 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819f9a61-163e-424c-98db-cb1d2fef7479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:23:47.599851 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1215d1-8022-4408-a5d6-aaa256c12897 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:23:47.599945 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819f9a61-163e-424c-98db-cb1d2fef7479 admin admin] REQUEST_METHOD: `PUT` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:47.599945 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819f9a61-163e-424c-98db-cb1d2fef7479 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:47.599945 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819f9a61-163e-424c-98db-cb1d2fef7479 admin admin] PATH_INFO: `/v3/projects/be6e291a2d02434b848aa4e27f3c2491/users/0dd93368b00d4fd08700dfc0d85c489e/roles/604444e7ad0d437dbd1f5a6e02b761f5` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:47.611372 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1215d1-8022-4408-a5d6-aaa256c12897 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:23:47.615148 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819f9a61-163e-424c-98db-cb1d2fef7479 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be6e291a2d02434b848aa4e27f3c2491, user_id=0dd93368b00d4fd08700dfc0d85c489e, role_id=604444e7ad0d437dbd1f5a6e02b761f5)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:23:47.615559 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1145922f-14ce-487c-b00a-57fc23f36175 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b0b3ca4ecd41aaba9cf8e0f91fbf54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:23:47.616226 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1145922f-14ce-487c-b00a-57fc23f36175 service neutron] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:47.616573 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1145922f-14ce-487c-b00a-57fc23f36175 service neutron] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:47.616912 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1145922f-14ce-487c-b00a-57fc23f36175 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:47.618180 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819f9a61-163e-424c-98db-cb1d2fef7479 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:23:47.628310 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1145922f-14ce-487c-b00a-57fc23f36175 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:23:47.630136 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1145922f-14ce-487c-b00a-57fc23f36175 service neutron] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:23:47.632226 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 810/1607] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:23:47 2022] PUT /identity/v3/projects/be6e291a2d02434b848aa4e27f3c2491/users/0dd93368b00d4fd08700dfc0d85c489e/roles/604444e7ad0d437dbd1f5a6e02b761f5 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:23:47.633193 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819f9a61-163e-424c-98db-cb1d2fef7479 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:23:47.646705 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 798/1608] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:23:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:23:47.647683 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1145922f-14ce-487c-b00a-57fc23f36175 service neutron] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:23:47.652833 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:23:47.659086 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1145922f-14ce-487c-b00a-57fc23f36175 service neutron] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:23:47.720997 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819f9a61-163e-424c-98db-cb1d2fef7479 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:23:47.727014 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6d6b9c-05f2-4142-be6d-46fda3324cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:23:47.727608 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6d6b9c-05f2-4142-be6d-46fda3324cae admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:47.727892 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6d6b9c-05f2-4142-be6d-46fda3324cae admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:47.728163 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6d6b9c-05f2-4142-be6d-46fda3324cae admin admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:47.728812 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6d6b9c-05f2-4142-be6d-46fda3324cae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:23:47.730461 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6d6b9c-05f2-4142-be6d-46fda3324cae admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:23:47.730721 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b847f2ee-956a-4cd4-8bd9-5c14ad42ecc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:23:47.731994 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b847f2ee-956a-4cd4-8bd9-5c14ad42ecc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:47.732215 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b847f2ee-956a-4cd4-8bd9-5c14ad42ecc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:47.732502 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b847f2ee-956a-4cd4-8bd9-5c14ad42ecc6 admin admin] PATH_INFO: `/v3/projects/f4e9697050574a698db82cb1066e1882/users/add49883cb644f549b73e3928ff1ed69/roles/8a829170b29d42d6af589399e51edb0f` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:47.735280 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b847f2ee-956a-4cd4-8bd9-5c14ad42ecc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4e9697050574a698db82cb1066e1882, user_id=add49883cb644f549b73e3928ff1ed69, role_id=8a829170b29d42d6af589399e51edb0f)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:23:47.738822 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b847f2ee-956a-4cd4-8bd9-5c14ad42ecc6 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:23:47.745515 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 811/1609] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:23:47 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:23:47.745515 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6d6b9c-05f2-4142-be6d-46fda3324cae admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:23:47.752978 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 799/1610] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:23:47 2022] PUT /identity/v3/projects/f4e9697050574a698db82cb1066e1882/users/add49883cb644f549b73e3928ff1ed69/roles/8a829170b29d42d6af589399e51edb0f => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:23:47.755552 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b847f2ee-956a-4cd4-8bd9-5c14ad42ecc6 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:23:47.755929 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6d6b9c-05f2-4142-be6d-46fda3324cae admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:23:47.827330 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb13fa6-2a9c-4d9a-be81-c12615a51996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:23:47.828070 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb13fa6-2a9c-4d9a-be81-c12615a51996 admin admin] REQUEST_METHOD: `PUT` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:47.828450 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb13fa6-2a9c-4d9a-be81-c12615a51996 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:47.828850 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb13fa6-2a9c-4d9a-be81-c12615a51996 admin admin] PATH_INFO: `/v3/projects/34394b9f99624a5eaf60a37516232f40/users/06e92decadca4eb09f7046deefaf652b/roles/604444e7ad0d437dbd1f5a6e02b761f5` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:47.845086 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb13fa6-2a9c-4d9a-be81-c12615a51996 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34394b9f99624a5eaf60a37516232f40, user_id=06e92decadca4eb09f7046deefaf652b, role_id=604444e7ad0d437dbd1f5a6e02b761f5)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:23:47.845741 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b847f2ee-956a-4cd4-8bd9-5c14ad42ecc6 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:23:47.848138 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb13fa6-2a9c-4d9a-be81-c12615a51996 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:23:47.852918 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a7aa13-c8b7-464f-ae6c-3413c57f4ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:23:47.854048 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a7aa13-c8b7-464f-ae6c-3413c57f4ee2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:47.854480 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a7aa13-c8b7-464f-ae6c-3413c57f4ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:47.854856 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a7aa13-c8b7-464f-ae6c-3413c57f4ee2 admin admin] PATH_INFO: `/v3/projects/6f8903954d88410db9298a159c3e8cc1/users/3eed1b62f00a4dbc98524c44147c3b72/roles/604444e7ad0d437dbd1f5a6e02b761f5` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:47.868117 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 812/1611] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:23:47 2022] PUT /identity/v3/projects/34394b9f99624a5eaf60a37516232f40/users/06e92decadca4eb09f7046deefaf652b/roles/604444e7ad0d437dbd1f5a6e02b761f5 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:23:47.868117 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb13fa6-2a9c-4d9a-be81-c12615a51996 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:23:47.876287 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a7aa13-c8b7-464f-ae6c-3413c57f4ee2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f8903954d88410db9298a159c3e8cc1, user_id=3eed1b62f00a4dbc98524c44147c3b72, role_id=604444e7ad0d437dbd1f5a6e02b761f5)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:23:47.878978 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a7aa13-c8b7-464f-ae6c-3413c57f4ee2 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:23:47.896608 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 800/1612] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:23:47 2022] PUT /identity/v3/projects/6f8903954d88410db9298a159c3e8cc1/users/3eed1b62f00a4dbc98524c44147c3b72/roles/604444e7ad0d437dbd1f5a6e02b761f5 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:23:47.898398 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b81d0fc-6a50-461f-80a7-1cdab2a33341 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:47.899053 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b81d0fc-6a50-461f-80a7-1cdab2a33341 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:47.899346 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b81d0fc-6a50-461f-80a7-1cdab2a33341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:47.901579 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:23:47.932165 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-6b81d0fc-6a50-461f-80a7-1cdab2a33341 None None] MFA Rules not processed for user `0dd93368b00d4fd08700dfc0d85c489e`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:23:47.933728 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-6b81d0fc-6a50-461f-80a7-1cdab2a33341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:23:47.947006 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb13fa6-2a9c-4d9a-be81-c12615a51996 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:23:48.029554 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 801/1613] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:23:47 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:23:48.030559 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b81d0fc-6a50-461f-80a7-1cdab2a33341 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:23:48.031638 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3fb4f5-9e24-457e-aa39-4e7739424b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:23:48.035639 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3fb4f5-9e24-457e-aa39-4e7739424b04 admin admin] REQUEST_METHOD: `PUT` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:48.035991 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3fb4f5-9e24-457e-aa39-4e7739424b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:48.036279 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3fb4f5-9e24-457e-aa39-4e7739424b04 admin admin] PATH_INFO: `/v3/projects/4708dc014c4348209f5ab0fb93f7d96d/users/fb0b83edd8754e659729e05787f3bf4d/roles/604444e7ad0d437dbd1f5a6e02b761f5` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:48.045224 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b81d0fc-6a50-461f-80a7-1cdab2a33341 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:23:48.051783 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90506293-75db-4f96-bf83-f1fa0f33ee34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:23:48.053121 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90506293-75db-4f96-bf83-f1fa0f33ee34 admin admin] REQUEST_METHOD: `PUT` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:48.053121 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90506293-75db-4f96-bf83-f1fa0f33ee34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:48.053491 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90506293-75db-4f96-bf83-f1fa0f33ee34 admin admin] PATH_INFO: `/v3/projects/05609b83fc784467bbf955dc65ae043f/users/bce5254e95a946aea6fb0c4d934dbd0d/roles/604444e7ad0d437dbd1f5a6e02b761f5` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:48.054938 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3fb4f5-9e24-457e-aa39-4e7739424b04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4708dc014c4348209f5ab0fb93f7d96d, user_id=fb0b83edd8754e659729e05787f3bf4d, role_id=604444e7ad0d437dbd1f5a6e02b761f5)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:23:48.058785 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:23:48.060788 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3fb4f5-9e24-457e-aa39-4e7739424b04 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:23:48.085080 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 813/1614] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:23:47 2022] PUT /identity/v3/projects/4708dc014c4348209f5ab0fb93f7d96d/users/fb0b83edd8754e659729e05787f3bf4d/roles/604444e7ad0d437dbd1f5a6e02b761f5 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:23:48.087273 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ab8a17-ce9b-4de5-b34a-4ea90b5f7129 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:48.087569 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ab8a17-ce9b-4de5-b34a-4ea90b5f7129 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:48.088004 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ab8a17-ce9b-4de5-b34a-4ea90b5f7129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:48.091547 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90506293-75db-4f96-bf83-f1fa0f33ee34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05609b83fc784467bbf955dc65ae043f, user_id=bce5254e95a946aea6fb0c4d934dbd0d, role_id=604444e7ad0d437dbd1f5a6e02b761f5)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:23:48.095400 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90506293-75db-4f96-bf83-f1fa0f33ee34 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:23:48.125692 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 802/1615] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:23:48 2022] PUT /identity/v3/projects/05609b83fc784467bbf955dc65ae043f/users/bce5254e95a946aea6fb0c4d934dbd0d/roles/604444e7ad0d437dbd1f5a6e02b761f5 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:23:48.126985 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae33b22-3c7a-483e-90ba-7247681db262 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:48.127319 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae33b22-3c7a-483e-90ba-7247681db262 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:48.127524 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae33b22-3c7a-483e-90ba-7247681db262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:48.158314 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-a9ab8a17-ce9b-4de5-b34a-4ea90b5f7129 None None] MFA Rules not processed for user `add49883cb644f549b73e3928ff1ed69`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:23:48.160866 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-a9ab8a17-ce9b-4de5-b34a-4ea90b5f7129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:23:48.171862 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-8ae33b22-3c7a-483e-90ba-7247681db262 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:23:48.173367 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-8ae33b22-3c7a-483e-90ba-7247681db262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:23:48.259812 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 814/1616] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:23:48 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:23:48.259812 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed499938-f02f-4b84-89d1-c9c46cc2b23e None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:48.259812 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed499938-f02f-4b84-89d1-c9c46cc2b23e None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:48.259812 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed499938-f02f-4b84-89d1-c9c46cc2b23e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:48.274085 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 803/1617] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:23:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:23:48.275588 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b995bb2-af53-498f-9e68-a9e4b4768212 None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:48.275885 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b995bb2-af53-498f-9e68-a9e4b4768212 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:48.276298 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b995bb2-af53-498f-9e68-a9e4b4768212 None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:48.277639 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 804/1618] 10.222.0.33 () {54 vars in 965 bytes} [Tue Sep 20 22:23:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:23:48.279406 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae7ffb-7e90-404f-b50d-851f625bb17a None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:48.279692 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae7ffb-7e90-404f-b50d-851f625bb17a None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:48.279976 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae7ffb-7e90-404f-b50d-851f625bb17a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:48.284599 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-ed499938-f02f-4b84-89d1-c9c46cc2b23e None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:23:48.285924 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-ed499938-f02f-4b84-89d1-c9c46cc2b23e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:23:48.303664 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 815/1619] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:23:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:23:48.305208 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999257aa-e4e3-4151-8a27-068cb27cba7e None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:48.305545 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999257aa-e4e3-4151-8a27-068cb27cba7e None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:48.305828 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999257aa-e4e3-4151-8a27-068cb27cba7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:48.314034 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-06ae7ffb-7e90-404f-b50d-851f625bb17a None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:23:48.315237 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-06ae7ffb-7e90-404f-b50d-851f625bb17a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:23:48.335009 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 805/1620] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:23:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:23:48.338804 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ae7ffb-7e90-404f-b50d-851f625bb17a None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:23:48.343281 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-999257aa-e4e3-4151-8a27-068cb27cba7e None None] MFA Rules not processed for user `bce5254e95a946aea6fb0c4d934dbd0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:23:48.344641 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-999257aa-e4e3-4151-8a27-068cb27cba7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:23:48.371047 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:23:48.423115 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ae7ffb-7e90-404f-b50d-851f625bb17a None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:23:48.431658 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668eeb39-ea6c-4099-bfbe-dcb3f3346417 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577c8b14c1f4279beac13b9ba11aba1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:23:48.432293 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668eeb39-ea6c-4099-bfbe-dcb3f3346417 service cinder] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:48.432571 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668eeb39-ea6c-4099-bfbe-dcb3f3346417 service cinder] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:48.432840 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668eeb39-ea6c-4099-bfbe-dcb3f3346417 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:48.438304 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 816/1621] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:23:48 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:23:48.438870 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cce9a7-ba63-41d3-b06b-5b8727ecc40e None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:48.439296 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cce9a7-ba63-41d3-b06b-5b8727ecc40e None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:48.439576 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cce9a7-ba63-41d3-b06b-5b8727ecc40e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:48.449049 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668eeb39-ea6c-4099-bfbe-dcb3f3346417 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:23:48.450336 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668eeb39-ea6c-4099-bfbe-dcb3f3346417 service cinder] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:23:48.461927 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 806/1622] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:23:48 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:23:48.462672 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668eeb39-ea6c-4099-bfbe-dcb3f3346417 service cinder] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:23:48.500975 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-94cce9a7-ba63-41d3-b06b-5b8727ecc40e None None] MFA Rules not processed for user `db7eed561e99452289a662ad326cf919`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:23:48.502144 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-94cce9a7-ba63-41d3-b06b-5b8727ecc40e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:23:48.552415 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668eeb39-ea6c-4099-bfbe-dcb3f3346417 service cinder] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:23:48.557310 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3c5615-d9f3-4fe7-93f4-e050f7a85b6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b0b3ca4ecd41aaba9cf8e0f91fbf54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:23:48.558008 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3c5615-d9f3-4fe7-93f4-e050f7a85b6e service neutron] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:48.558361 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3c5615-d9f3-4fe7-93f4-e050f7a85b6e service neutron] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:48.558758 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3c5615-d9f3-4fe7-93f4-e050f7a85b6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:48.569753 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3c5615-d9f3-4fe7-93f4-e050f7a85b6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:23:48.571613 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3c5615-d9f3-4fe7-93f4-e050f7a85b6e service neutron] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:23:48.592729 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 807/1623] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:23:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:23:48.592729 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3c5615-d9f3-4fe7-93f4-e050f7a85b6e service neutron] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:23:48.606674 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3c5615-d9f3-4fe7-93f4-e050f7a85b6e service neutron] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:23:48.607889 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 817/1624] 10.222.0.33 () {58 vars in 1062 bytes} [Tue Sep 20 22:23:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:23:48.609001 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cce9a7-ba63-41d3-b06b-5b8727ecc40e None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:23:48.611855 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55314d5b-510d-45be-994e-30aa28d5b4ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b0b3ca4ecd41aaba9cf8e0f91fbf54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:23:48.612621 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55314d5b-510d-45be-994e-30aa28d5b4ad service neutron] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:48.613040 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55314d5b-510d-45be-994e-30aa28d5b4ad service neutron] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:48.613407 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55314d5b-510d-45be-994e-30aa28d5b4ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:48.626229 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55314d5b-510d-45be-994e-30aa28d5b4ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:23:48.628670 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55314d5b-510d-45be-994e-30aa28d5b4ad service neutron] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:23:48.634735 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cce9a7-ba63-41d3-b06b-5b8727ecc40e None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:23:48.640832 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e487fb3-fe66-4488-8b84-8cc9396ddc1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b0b3ca4ecd41aaba9cf8e0f91fbf54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:23:48.641778 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 808/1625] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:23:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:23:48.643073 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55314d5b-510d-45be-994e-30aa28d5b4ad service neutron] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:23:48.643336 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e487fb3-fe66-4488-8b84-8cc9396ddc1f service neutron] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:48.643700 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e487fb3-fe66-4488-8b84-8cc9396ddc1f service neutron] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:48.644077 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e487fb3-fe66-4488-8b84-8cc9396ddc1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:48.656928 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e487fb3-fe66-4488-8b84-8cc9396ddc1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:23:48.657923 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55314d5b-510d-45be-994e-30aa28d5b4ad service neutron] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:23:48.659079 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e487fb3-fe66-4488-8b84-8cc9396ddc1f service neutron] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:23:48.675927 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 818/1626] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:23:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:23:48.677381 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e487fb3-fe66-4488-8b84-8cc9396ddc1f service neutron] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:23:48.686263 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5663d43-a9aa-44bb-a12a-998bef886a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:23:48.686919 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5663d43-a9aa-44bb-a12a-998bef886a17 admin admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:48.687205 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5663d43-a9aa-44bb-a12a-998bef886a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:48.690418 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5663d43-a9aa-44bb-a12a-998bef886a17 admin admin] PATH_INFO: `/v3/projects` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:48.691508 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5663d43-a9aa-44bb-a12a-998bef886a17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:23:48.697381 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e487fb3-fe66-4488-8b84-8cc9396ddc1f service neutron] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:23:48.699092 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5663d43-a9aa-44bb-a12a-998bef886a17 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:23:48.706243 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0797b794-9763-4aa9-a6f3-56dea9e43ce1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db7eed561e99452289a662ad326cf919', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:23:48.707300 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0797b794-9763-4aa9-a6f3-56dea9e43ce1 service nova] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:48.713003 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0797b794-9763-4aa9-a6f3-56dea9e43ce1 service nova] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:48.713003 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0797b794-9763-4aa9-a6f3-56dea9e43ce1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:48.729130 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:23:48.759383 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 809/1627] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 20 22:23:48 2022] POST /identity/v3/projects => generated 379 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:23:48.763985 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5663d43-a9aa-44bb-a12a-998bef886a17 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:23:48.905244 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0797b794-9763-4aa9-a6f3-56dea9e43ce1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:23:48.907761 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0797b794-9763-4aa9-a6f3-56dea9e43ce1 service nova] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:23:48.943151 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 819/1628] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:23:48 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:23:48.953617 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5663d43-a9aa-44bb-a12a-998bef886a17 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:23:48.973641 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef6ff85-42a0-475f-bd54-15a6d467375f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:23:48.974282 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef6ff85-42a0-475f-bd54-15a6d467375f admin admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:48.974588 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef6ff85-42a0-475f-bd54-15a6d467375f admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:48.974864 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef6ff85-42a0-475f-bd54-15a6d467375f admin admin] PATH_INFO: `/v3/users` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:48.975505 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef6ff85-42a0-475f-bd54-15a6d467375f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:23:48.977548 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef6ff85-42a0-475f-bd54-15a6d467375f admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:23:49.025134 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 810/1629] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 20 22:23:48 2022] POST /identity/v3/users => generated 296 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 20 22:23:49.026548 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0797b794-9763-4aa9-a6f3-56dea9e43ce1 service nova] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:23:49.045106 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0797b794-9763-4aa9-a6f3-56dea9e43ce1 service nova] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:23:49.058648 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9151a424-a35f-4f6c-970d-5555ea437cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:23:49.059339 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9151a424-a35f-4f6c-970d-5555ea437cc1 admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:49.059619 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9151a424-a35f-4f6c-970d-5555ea437cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:49.059927 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9151a424-a35f-4f6c-970d-5555ea437cc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:49.060520 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9151a424-a35f-4f6c-970d-5555ea437cc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:23:49.062114 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9151a424-a35f-4f6c-970d-5555ea437cc1 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:23:49.080435 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 820/1630] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:23:49 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:23:49.082214 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef6ff85-42a0-475f-bd54-15a6d467375f admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:23:49.095011 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef6ff85-42a0-475f-bd54-15a6d467375f admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:23:49.107686 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8215bf94-9f74-423f-a7bc-33c2416e1a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:23:49.109188 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8215bf94-9f74-423f-a7bc-33c2416e1a5c admin admin] REQUEST_METHOD: `PUT` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:49.109645 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8215bf94-9f74-423f-a7bc-33c2416e1a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:49.109934 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8215bf94-9f74-423f-a7bc-33c2416e1a5c admin admin] PATH_INFO: `/v3/projects/cb594f7c81a74ff7bc9b0885b77489d5/users/336f2bfb5b8e4bc3be051e5363b4185f/roles/8a829170b29d42d6af589399e51edb0f` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:49.171818 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8215bf94-9f74-423f-a7bc-33c2416e1a5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb594f7c81a74ff7bc9b0885b77489d5, user_id=336f2bfb5b8e4bc3be051e5363b4185f, role_id=8a829170b29d42d6af589399e51edb0f)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:23:49.174613 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8215bf94-9f74-423f-a7bc-33c2416e1a5c admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:23:49.210875 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 811/1631] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:23:49 2022] PUT /identity/v3/projects/cb594f7c81a74ff7bc9b0885b77489d5/users/336f2bfb5b8e4bc3be051e5363b4185f/roles/8a829170b29d42d6af589399e51edb0f => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 22:23:49.212283 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9151a424-a35f-4f6c-970d-5555ea437cc1 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:23:49.226240 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9151a424-a35f-4f6c-970d-5555ea437cc1 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:23:49.253485 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:23:49.288592 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8215bf94-9f74-423f-a7bc-33c2416e1a5c admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:23:49.342095 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eeac07-34b6-42ac-97f9-6aa634b5e693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:23:49.342749 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eeac07-34b6-42ac-97f9-6aa634b5e693 admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:49.343033 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eeac07-34b6-42ac-97f9-6aa634b5e693 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:49.343337 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eeac07-34b6-42ac-97f9-6aa634b5e693 admin admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:49.344128 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57eeac07-34b6-42ac-97f9-6aa634b5e693 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:23:49.346498 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57eeac07-34b6-42ac-97f9-6aa634b5e693 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:23:49.363086 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 821/1632] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:23:49 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:23:49.366795 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c98adf-74e2-4373-82c8-54fdc67241ae None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:49.366795 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c98adf-74e2-4373-82c8-54fdc67241ae None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:49.366795 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c98adf-74e2-4373-82c8-54fdc67241ae None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:49.367763 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 822/1633] 10.222.0.33 () {54 vars in 912 bytes} [Tue Sep 20 22:23:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:23:49.368861 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c98adf-74e2-4373-82c8-54fdc67241ae None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:23:49.386752 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c98adf-74e2-4373-82c8-54fdc67241ae None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:23:49.394179 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f44a97-fd83-4e74-98a7-f40c0864ee85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:23:49.395208 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f44a97-fd83-4e74-98a7-f40c0864ee85 admin admin] REQUEST_METHOD: `PUT` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:49.395856 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f44a97-fd83-4e74-98a7-f40c0864ee85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:49.396327 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f44a97-fd83-4e74-98a7-f40c0864ee85 admin admin] PATH_INFO: `/v3/projects/cb594f7c81a74ff7bc9b0885b77489d5/users/336f2bfb5b8e4bc3be051e5363b4185f/roles/8a829170b29d42d6af589399e51edb0f` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:49.399549 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f44a97-fd83-4e74-98a7-f40c0864ee85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb594f7c81a74ff7bc9b0885b77489d5, user_id=336f2bfb5b8e4bc3be051e5363b4185f, role_id=8a829170b29d42d6af589399e51edb0f)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:23:49.404511 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f44a97-fd83-4e74-98a7-f40c0864ee85 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:23:49.424451 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 823/1634] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:23:49 2022] PUT /identity/v3/projects/cb594f7c81a74ff7bc9b0885b77489d5/users/336f2bfb5b8e4bc3be051e5363b4185f/roles/8a829170b29d42d6af589399e51edb0f => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:23:49.426564 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50651262-c190-4db6-b36c-e0402e8a4384 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:49.427369 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50651262-c190-4db6-b36c-e0402e8a4384 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:49.427888 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50651262-c190-4db6-b36c-e0402e8a4384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:49.454100 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8215bf94-9f74-423f-a7bc-33c2416e1a5c admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:23:49.483262 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-50651262-c190-4db6-b36c-e0402e8a4384 None None] MFA Rules not processed for user `db7eed561e99452289a662ad326cf919`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:23:49.486402 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-50651262-c190-4db6-b36c-e0402e8a4384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:23:49.595899 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee952445-667c-4c80-8623-760433add444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:23:49.596604 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee952445-667c-4c80-8623-760433add444 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:49.596891 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee952445-667c-4c80-8623-760433add444 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:49.597376 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee952445-667c-4c80-8623-760433add444 admin admin] PATH_INFO: `/v3/users/47769e166f644729b5e1c726c3fa171e` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:49.600253 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee952445-667c-4c80-8623-760433add444 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47769e166f644729b5e1c726c3fa171e)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:23:49.604204 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee952445-667c-4c80-8623-760433add444 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:23:49.608598 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:23:49.659170 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 824/1635] 10.222.0.33 () {58 vars in 1009 bytes} [Tue Sep 20 22:23:49 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:23:49.663725 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de797da5-d1f4-45ac-85d8-7e70d9890662 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:49.664420 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de797da5-d1f4-45ac-85d8-7e70d9890662 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:49.665207 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de797da5-d1f4-45ac-85d8-7e70d9890662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:49.719952 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-ee952445-667c-4c80-8623-760433add444 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47769e166f644729b5e1c726c3fa171e'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:23:49.739443 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-ee952445-667c-4c80-8623-760433add444 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47769e166f644729b5e1c726c3fa171e'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:23:49.740179 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-ee952445-667c-4c80-8623-760433add444 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47769e166f644729b5e1c726c3fa171e'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:23:49.741256 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-ee952445-667c-4c80-8623-760433add444 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47769e166f644729b5e1c726c3fa171e'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:23:49.756103 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-de797da5-d1f4-45ac-85d8-7e70d9890662 None None] MFA Rules not processed for user `336f2bfb5b8e4bc3be051e5363b4185f`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:23:49.757552 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-de797da5-d1f4-45ac-85d8-7e70d9890662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:23:49.762004 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-ee952445-667c-4c80-8623-760433add444 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47769e166f644729b5e1c726c3fa171e'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:23:49.794620 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 812/1636] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 20 22:23:49 2022] DELETE /identity/v3/users/47769e166f644729b5e1c726c3fa171e => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 22:23:49.795844 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee952445-667c-4c80-8623-760433add444 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:23:49.799147 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-ee952445-667c-4c80-8623-760433add444 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:23:49.919021 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee952445-667c-4c80-8623-760433add444 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:23:49.924275 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 825/1637] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:23:49 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:23:49.926437 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ebbfa8-ba28-4243-b5d8-984583661682 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:49.927395 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ebbfa8-ba28-4243-b5d8-984583661682 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:49.927904 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32facb2-3066-468b-af61-f90321fd6938 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577c8b14c1f4279beac13b9ba11aba1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:23:49.928063 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ebbfa8-ba28-4243-b5d8-984583661682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:49.928532 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32facb2-3066-468b-af61-f90321fd6938 service cinder] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:49.928813 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32facb2-3066-468b-af61-f90321fd6938 service cinder] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:49.929084 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32facb2-3066-468b-af61-f90321fd6938 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:49.939813 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-f32facb2-3066-468b-af61-f90321fd6938 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:23:49.953544 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-d4ebbfa8-ba28-4243-b5d8-984583661682 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:23:49.956977 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-d4ebbfa8-ba28-4243-b5d8-984583661682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:23:49.974914 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:23:50.150084 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 826/1638] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:23:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:23:50.151396 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ebbfa8-ba28-4243-b5d8-984583661682 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:23:50.154767 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32facb2-3066-468b-af61-f90321fd6938 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:23:50.156345 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-d4ebbfa8-ba28-4243-b5d8-984583661682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:23:50.158850 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32facb2-3066-468b-af61-f90321fd6938 service cinder] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:23:50.173748 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ebbfa8-ba28-4243-b5d8-984583661682 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:23:50.180880 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6baedf5-c23e-4a14-a172-264b769c4f44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577c8b14c1f4279beac13b9ba11aba1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:23:50.181818 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6baedf5-c23e-4a14-a172-264b769c4f44 service cinder] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:50.189290 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 813/1639] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:23:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:23:50.203942 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32facb2-3066-468b-af61-f90321fd6938 service cinder] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:23:50.205607 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-f32facb2-3066-468b-af61-f90321fd6938 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:23:50.216745 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6baedf5-c23e-4a14-a172-264b769c4f44 service cinder] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:50.217740 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6baedf5-c23e-4a14-a172-264b769c4f44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:50.263008 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:23:50.354137 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32facb2-3066-468b-af61-f90321fd6938 service cinder] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:23:50.365978 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6baedf5-c23e-4a14-a172-264b769c4f44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:23:50.367565 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6baedf5-c23e-4a14-a172-264b769c4f44 service cinder] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:23:50.377082 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d17c833-ffdd-4180-934f-0227c2091678 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b0b3ca4ecd41aaba9cf8e0f91fbf54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:23:50.377716 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d17c833-ffdd-4180-934f-0227c2091678 service neutron] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:50.378059 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d17c833-ffdd-4180-934f-0227c2091678 service neutron] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:50.378252 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d17c833-ffdd-4180-934f-0227c2091678 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:50.401784 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d17c833-ffdd-4180-934f-0227c2091678 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:23:50.403741 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 827/1640] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:23:50 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:23:50.405811 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d17c833-ffdd-4180-934f-0227c2091678 service neutron] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:23:50.446911 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 814/1641] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:23:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 20 22:23:50.552640 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6baedf5-c23e-4a14-a172-264b769c4f44 service cinder] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:23:50.628997 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6baedf5-c23e-4a14-a172-264b769c4f44 service cinder] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:23:50.628997 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ad3f83-6bc8-4abe-9854-f2a46665c07c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577c8b14c1f4279beac13b9ba11aba1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:23:50.628997 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ad3f83-6bc8-4abe-9854-f2a46665c07c service cinder] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:50.628997 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ad3f83-6bc8-4abe-9854-f2a46665c07c service cinder] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:50.629871 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ad3f83-6bc8-4abe-9854-f2a46665c07c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:50.629871 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-18ad3f83-6bc8-4abe-9854-f2a46665c07c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:23:50.813140 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ad3f83-6bc8-4abe-9854-f2a46665c07c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:23:50.814730 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ad3f83-6bc8-4abe-9854-f2a46665c07c service cinder] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:23:50.827290 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 828/1642] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:23:50 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:23:51.841514 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e694870a-4f58-4ecb-9e5c-06a9d88b9686 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:51.842060 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e694870a-4f58-4ecb-9e5c-06a9d88b9686 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:51.842060 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e694870a-4f58-4ecb-9e5c-06a9d88b9686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:51.884217 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a13e706-6ccd-4438-87ab-e7593f11acac None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:51.884811 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a13e706-6ccd-4438-87ab-e7593f11acac None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:51.885092 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a13e706-6ccd-4438-87ab-e7593f11acac None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:51.886589 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 829/1643] 10.222.0.33 () {54 vars in 965 bytes} [Tue Sep 20 22:23:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 20 22:23:51.944105 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ac024-5201-45d5-85c8-5369050f1db0 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:51.944105 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ac024-5201-45d5-85c8-5369050f1db0 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:51.944105 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ac024-5201-45d5-85c8-5369050f1db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:51.944609 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-e694870a-4f58-4ecb-9e5c-06a9d88b9686 None None] MFA Rules not processed for user `06e92decadca4eb09f7046deefaf652b`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:23:51.944609 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-e694870a-4f58-4ecb-9e5c-06a9d88b9686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:23:51.949576 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-435ac024-5201-45d5-85c8-5369050f1db0 None None] MFA Rules not processed for user `db7eed561e99452289a662ad326cf919`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:23:51.949576 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-435ac024-5201-45d5-85c8-5369050f1db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:23:51.979485 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 830/1644] 10.222.0.33 () {58 vars in 1062 bytes} [Tue Sep 20 22:23:51 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 22:23:51.980934 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9473411-dec3-4322-8767-971763e08105 None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:51.981225 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9473411-dec3-4322-8767-971763e08105 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:51.981504 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9473411-dec3-4322-8767-971763e08105 None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:51.983562 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 831/1645] 10.222.0.33 () {54 vars in 912 bytes} [Tue Sep 20 22:23:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:23:51.990494 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e11aec-3bf2-4ad0-b82f-cba0275d3dbe None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:51.990844 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e11aec-3bf2-4ad0-b82f-cba0275d3dbe None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:51.991127 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e11aec-3bf2-4ad0-b82f-cba0275d3dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:52.039116 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-90e11aec-3bf2-4ad0-b82f-cba0275d3dbe None None] MFA Rules not processed for user `db7eed561e99452289a662ad326cf919`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:23:52.040717 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-90e11aec-3bf2-4ad0-b82f-cba0275d3dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:23:52.053985 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 815/1646] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:23:51 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:23:52.055023 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e694870a-4f58-4ecb-9e5c-06a9d88b9686 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:23:52.057693 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-e694870a-4f58-4ecb-9e5c-06a9d88b9686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:23:52.063835 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 832/1647] 10.222.0.33 () {58 vars in 1009 bytes} [Tue Sep 20 22:23:51 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 22:23:52.083736 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e11aec-3bf2-4ad0-b82f-cba0275d3dbe None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:23:52.085341 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e694870a-4f58-4ecb-9e5c-06a9d88b9686 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:23:52.091243 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c8a3c1-b204-4410-8e96-0cfd898c9200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:23:52.091925 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c8a3c1-b204-4410-8e96-0cfd898c9200 admin admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:52.092360 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c8a3c1-b204-4410-8e96-0cfd898c9200 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:52.093408 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c8a3c1-b204-4410-8e96-0cfd898c9200 admin admin] PATH_INFO: `/v3/projects` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:52.094065 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c8a3c1-b204-4410-8e96-0cfd898c9200 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:23:52.097031 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c8a3c1-b204-4410-8e96-0cfd898c9200 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:23:52.100332 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e11aec-3bf2-4ad0-b82f-cba0275d3dbe None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:23:52.107208 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1efc91-558c-4d18-98fb-87ccd29f9a5c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577c8b14c1f4279beac13b9ba11aba1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:23:52.108063 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1efc91-558c-4d18-98fb-87ccd29f9a5c service cinder] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:52.108357 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1efc91-558c-4d18-98fb-87ccd29f9a5c service cinder] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:52.108634 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1efc91-558c-4d18-98fb-87ccd29f9a5c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:52.137171 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1efc91-558c-4d18-98fb-87ccd29f9a5c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:23:52.139214 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1efc91-558c-4d18-98fb-87ccd29f9a5c service cinder] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:23:52.153337 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 816/1648] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 20 22:23:52 2022] POST /identity/v3/projects => generated 405 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:23:52.154859 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c8a3c1-b204-4410-8e96-0cfd898c9200 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:23:52.164631 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 833/1649] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:23:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 20 22:23:52.247891 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c8a3c1-b204-4410-8e96-0cfd898c9200 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:23:52.257017 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2277ce-f32f-4767-b914-325cf20795be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:23:52.257768 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2277ce-f32f-4767-b914-325cf20795be admin admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:52.259210 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2277ce-f32f-4767-b914-325cf20795be admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:52.259325 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2277ce-f32f-4767-b914-325cf20795be admin admin] PATH_INFO: `/v3/users` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:52.262027 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2277ce-f32f-4767-b914-325cf20795be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:23:52.265020 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2277ce-f32f-4767-b914-325cf20795be admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:23:52.334565 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 817/1650] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 20 22:23:52 2022] POST /identity/v3/users => generated 309 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:23:52.338904 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1efc91-558c-4d18-98fb-87ccd29f9a5c service cinder] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:23:52.350843 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1efc91-558c-4d18-98fb-87ccd29f9a5c service cinder] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:23:52.355871 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83085181-6c1e-4340-a1e1-bcdaa2ee9cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:23:52.357016 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83085181-6c1e-4340-a1e1-bcdaa2ee9cb3 admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:52.357295 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83085181-6c1e-4340-a1e1-bcdaa2ee9cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:52.357569 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83085181-6c1e-4340-a1e1-bcdaa2ee9cb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:52.358212 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83085181-6c1e-4340-a1e1-bcdaa2ee9cb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:23:52.359847 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83085181-6c1e-4340-a1e1-bcdaa2ee9cb3 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:23:52.370735 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 834/1651] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:23:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 20 22:23:52.375002 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2277ce-f32f-4767-b914-325cf20795be admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:23:52.388682 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2277ce-f32f-4767-b914-325cf20795be admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:23:52.400082 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d1ee6a-cdc1-418d-af1f-04e9f74b135f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:23:52.400849 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d1ee6a-cdc1-418d-af1f-04e9f74b135f admin admin] REQUEST_METHOD: `PUT` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:52.401131 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d1ee6a-cdc1-418d-af1f-04e9f74b135f admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:52.401405 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d1ee6a-cdc1-418d-af1f-04e9f74b135f admin admin] PATH_INFO: `/v3/projects/ecad345382b84bcb8e0b7664b79a4254/users/3945aaa89dd54656becb75c3f2c5de25/roles/8a829170b29d42d6af589399e51edb0f` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:52.439713 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d1ee6a-cdc1-418d-af1f-04e9f74b135f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecad345382b84bcb8e0b7664b79a4254, user_id=3945aaa89dd54656becb75c3f2c5de25, role_id=8a829170b29d42d6af589399e51edb0f)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:23:52.445722 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d1ee6a-cdc1-418d-af1f-04e9f74b135f admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:23:52.471997 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:23:52.475451 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83085181-6c1e-4340-a1e1-bcdaa2ee9cb3 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:23:52.478102 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-83085181-6c1e-4340-a1e1-bcdaa2ee9cb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:23:52.486553 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 818/1652] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:23:52 2022] PUT /identity/v3/projects/ecad345382b84bcb8e0b7664b79a4254/users/3945aaa89dd54656becb75c3f2c5de25/roles/8a829170b29d42d6af589399e51edb0f => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:23:52.488779 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d1ee6a-cdc1-418d-af1f-04e9f74b135f admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:23:52.520527 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83085181-6c1e-4340-a1e1-bcdaa2ee9cb3 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:23:52.543236 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:23:52.633009 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d1ee6a-cdc1-418d-af1f-04e9f74b135f admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:23:52.642902 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38353af5-a972-45ee-af84-40315edbba66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:23:52.643594 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38353af5-a972-45ee-af84-40315edbba66 admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:52.643880 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38353af5-a972-45ee-af84-40315edbba66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:52.644153 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38353af5-a972-45ee-af84-40315edbba66 admin admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:52.644818 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38353af5-a972-45ee-af84-40315edbba66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:23:52.646659 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38353af5-a972-45ee-af84-40315edbba66 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:23:52.671774 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 819/1653] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:23:52 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:23:52.674518 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38353af5-a972-45ee-af84-40315edbba66 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:23:52.698330 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38353af5-a972-45ee-af84-40315edbba66 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:23:52.703087 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dda95c9-4e8b-4504-9410-ae32031dc695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:23:52.703917 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda95c9-4e8b-4504-9410-ae32031dc695 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:52.704445 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda95c9-4e8b-4504-9410-ae32031dc695 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:52.704831 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda95c9-4e8b-4504-9410-ae32031dc695 admin admin] PATH_INFO: `/v3/projects/24cf58807c92441fa8e4f3de54862b7f` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:52.708456 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dda95c9-4e8b-4504-9410-ae32031dc695 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24cf58807c92441fa8e4f3de54862b7f)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:23:52.711342 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dda95c9-4e8b-4504-9410-ae32031dc695 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:23:52.711514 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba616ce-2465-4cff-ac4f-e6b163d85b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:23:52.712329 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba616ce-2465-4cff-ac4f-e6b163d85b4c admin admin] REQUEST_METHOD: `PUT` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:52.712607 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba616ce-2465-4cff-ac4f-e6b163d85b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:52.713313 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba616ce-2465-4cff-ac4f-e6b163d85b4c admin admin] PATH_INFO: `/v3/projects/ecad345382b84bcb8e0b7664b79a4254/users/3945aaa89dd54656becb75c3f2c5de25/roles/8a829170b29d42d6af589399e51edb0f` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:52.718863 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba616ce-2465-4cff-ac4f-e6b163d85b4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecad345382b84bcb8e0b7664b79a4254, user_id=3945aaa89dd54656becb75c3f2c5de25, role_id=8a829170b29d42d6af589399e51edb0f)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:23:52.721839 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba616ce-2465-4cff-ac4f-e6b163d85b4c admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:23:52.770841 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 820/1654] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:23:52 2022] PUT /identity/v3/projects/ecad345382b84bcb8e0b7664b79a4254/users/3945aaa89dd54656becb75c3f2c5de25/roles/8a829170b29d42d6af589399e51edb0f => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:23:52.906723 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-2dda95c9-4e8b-4504-9410-ae32031dc695 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24cf58807c92441fa8e4f3de54862b7f', 'request_id': 'req-2dda95c9-4e8b-4504-9410-ae32031dc695'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:23:52.917999 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-2dda95c9-4e8b-4504-9410-ae32031dc695 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24cf58807c92441fa8e4f3de54862b7f', 'request_id': 'req-2dda95c9-4e8b-4504-9410-ae32031dc695'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:23:52.935435 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-2dda95c9-4e8b-4504-9410-ae32031dc695 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24cf58807c92441fa8e4f3de54862b7f', 'request_id': 'req-2dda95c9-4e8b-4504-9410-ae32031dc695'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:23:52.951757 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-2dda95c9-4e8b-4504-9410-ae32031dc695 admin admin] The token cache is being invalidate because project 24cf58807c92441fa8e4f3de54862b7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81306) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 22:23:52.952363 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-2dda95c9-4e8b-4504-9410-ae32031dc695 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:23:52.953262 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-2dda95c9-4e8b-4504-9410-ae32031dc695 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:23:52.955393 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 835/1655] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 20 22:23:52 2022] DELETE /identity/v3/projects/24cf58807c92441fa8e4f3de54862b7f => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 22:23:52.960030 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba616ce-2465-4cff-ac4f-e6b163d85b4c admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:23:52.969169 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-eba616ce-2465-4cff-ac4f-e6b163d85b4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:23:53.095249 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba616ce-2465-4cff-ac4f-e6b163d85b4c admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:23:53.226825 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49c4a5b-ba1c-44d7-a89c-d9f5e6a9a04e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:23:53.227616 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49c4a5b-ba1c-44d7-a89c-d9f5e6a9a04e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:53.228008 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49c4a5b-ba1c-44d7-a89c-d9f5e6a9a04e admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:53.228306 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49c4a5b-ba1c-44d7-a89c-d9f5e6a9a04e admin admin] PATH_INFO: `/v3/users/add49883cb644f549b73e3928ff1ed69` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:53.230126 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49c4a5b-ba1c-44d7-a89c-d9f5e6a9a04e admin admin] RBAC: Authorizing `identity:delete_user(user_id=add49883cb644f549b73e3928ff1ed69)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:23:53.232583 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49c4a5b-ba1c-44d7-a89c-d9f5e6a9a04e admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:23:53.306106 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:23:53.329981 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-e49c4a5b-ba1c-44d7-a89c-d9f5e6a9a04e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'add49883cb644f549b73e3928ff1ed69'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:23:53.344402 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-e49c4a5b-ba1c-44d7-a89c-d9f5e6a9a04e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'add49883cb644f549b73e3928ff1ed69'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:23:53.345326 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-e49c4a5b-ba1c-44d7-a89c-d9f5e6a9a04e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'add49883cb644f549b73e3928ff1ed69'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:23:53.346789 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-e49c4a5b-ba1c-44d7-a89c-d9f5e6a9a04e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'add49883cb644f549b73e3928ff1ed69'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:23:53.361456 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-e49c4a5b-ba1c-44d7-a89c-d9f5e6a9a04e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'add49883cb644f549b73e3928ff1ed69'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:23:53.411991 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 821/1656] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 20 22:23:52 2022] DELETE /identity/v3/users/add49883cb644f549b73e3928ff1ed69 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:23:54.839013 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dda95c9-4e8b-4504-9410-ae32031dc695 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:23:54.852725 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dda95c9-4e8b-4504-9410-ae32031dc695 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:23:55.129509 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0aa8ce-bac1-46e1-9113-aece4d16de9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:23:55.130570 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0aa8ce-bac1-46e1-9113-aece4d16de9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:55.130570 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0aa8ce-bac1-46e1-9113-aece4d16de9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:55.130773 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0aa8ce-bac1-46e1-9113-aece4d16de9c admin admin] PATH_INFO: `/v3/projects/f4e9697050574a698db82cb1066e1882` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:55.139249 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0aa8ce-bac1-46e1-9113-aece4d16de9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4e9697050574a698db82cb1066e1882)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:23:55.152377 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0aa8ce-bac1-46e1-9113-aece4d16de9c admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:23:55.271119 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:23:55.279511 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-af0aa8ce-bac1-46e1-9113-aece4d16de9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4e9697050574a698db82cb1066e1882', 'request_id': 'req-af0aa8ce-bac1-46e1-9113-aece4d16de9c'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:23:55.294622 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-af0aa8ce-bac1-46e1-9113-aece4d16de9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4e9697050574a698db82cb1066e1882', 'request_id': 'req-af0aa8ce-bac1-46e1-9113-aece4d16de9c'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:23:55.317749 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-af0aa8ce-bac1-46e1-9113-aece4d16de9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4e9697050574a698db82cb1066e1882', 'request_id': 'req-af0aa8ce-bac1-46e1-9113-aece4d16de9c'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:23:55.347247 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-af0aa8ce-bac1-46e1-9113-aece4d16de9c admin admin] The token cache is being invalidate because project f4e9697050574a698db82cb1066e1882 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81306) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 22:23:55.348992 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-af0aa8ce-bac1-46e1-9113-aece4d16de9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:23:55.350875 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-af0aa8ce-bac1-46e1-9113-aece4d16de9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:23:55.358779 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 836/1657] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 20 22:23:54 2022] DELETE /identity/v3/projects/f4e9697050574a698db82cb1066e1882 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:23:55.361392 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8ef605-6275-4d36-b73d-f10a64504d98 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:55.362254 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8ef605-6275-4d36-b73d-f10a64504d98 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:55.362733 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8ef605-6275-4d36-b73d-f10a64504d98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:55.425753 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-de8ef605-6275-4d36-b73d-f10a64504d98 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:23:55.428134 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-de8ef605-6275-4d36-b73d-f10a64504d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:23:55.598792 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 822/1658] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:23:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:23:55.609505 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af87f505-5954-4e50-b467-c97da4407618 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:55.609798 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af87f505-5954-4e50-b467-c97da4407618 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:55.610125 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af87f505-5954-4e50-b467-c97da4407618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:55.691423 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-af87f505-5954-4e50-b467-c97da4407618 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:23:55.692753 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-af87f505-5954-4e50-b467-c97da4407618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:23:55.754187 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 837/1659] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:23:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:23:55.755524 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8ef605-6275-4d36-b73d-f10a64504d98 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:23:55.774609 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8ef605-6275-4d36-b73d-f10a64504d98 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:23:55.786001 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c99aa3-0c1b-4b3c-b87d-05c6759769fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:23:55.786807 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c99aa3-0c1b-4b3c-b87d-05c6759769fc admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:55.787333 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c99aa3-0c1b-4b3c-b87d-05c6759769fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:55.787703 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c99aa3-0c1b-4b3c-b87d-05c6759769fc admin admin] PATH_INFO: `/v3/domains` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:55.788463 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c99aa3-0c1b-4b3c-b87d-05c6759769fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:23:55.788865 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c99aa3-0c1b-4b3c-b87d-05c6759769fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:23:55.801675 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c99aa3-0c1b-4b3c-b87d-05c6759769fc admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:23:55.833848 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 823/1660] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 20 22:23:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:23:55.839206 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af87f505-5954-4e50-b467-c97da4407618 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:23:55.856632 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af87f505-5954-4e50-b467-c97da4407618 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:23:55.869670 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04b8774-c6bb-48f1-938f-1b30c69eed9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:23:55.871102 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04b8774-c6bb-48f1-938f-1b30c69eed9e admin admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:55.872343 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04b8774-c6bb-48f1-938f-1b30c69eed9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:55.873751 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04b8774-c6bb-48f1-938f-1b30c69eed9e admin admin] PATH_INFO: `/v3/projects` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:55.874670 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04b8774-c6bb-48f1-938f-1b30c69eed9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:23:55.879706 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04b8774-c6bb-48f1-938f-1b30c69eed9e admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:23:55.953264 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 838/1661] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 20 22:23:55 2022] POST /identity/v3/projects => generated 357 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:23:55.957073 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c99aa3-0c1b-4b3c-b87d-05c6759769fc admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:23:55.972126 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c99aa3-0c1b-4b3c-b87d-05c6759769fc admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:23:56.155514 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d50521-85ce-4bb1-95da-25a1929d1eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:23:56.157608 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d50521-85ce-4bb1-95da-25a1929d1eca admin admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:56.157903 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d50521-85ce-4bb1-95da-25a1929d1eca admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:56.158216 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d50521-85ce-4bb1-95da-25a1929d1eca admin admin] PATH_INFO: `/v3/users` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:56.159010 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d50521-85ce-4bb1-95da-25a1929d1eca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:23:56.168067 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d50521-85ce-4bb1-95da-25a1929d1eca admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:23:56.213512 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 824/1662] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 20 22:23:55 2022] POST /identity/v3/users => generated 279 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:23:56.215884 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04b8774-c6bb-48f1-938f-1b30c69eed9e admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:23:56.229820 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04b8774-c6bb-48f1-938f-1b30c69eed9e admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:23:56.241293 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e44411-46e0-4eff-9423-5a7fa0f9dff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:23:56.243125 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e44411-46e0-4eff-9423-5a7fa0f9dff1 admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:56.243247 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e44411-46e0-4eff-9423-5a7fa0f9dff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:56.243487 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e44411-46e0-4eff-9423-5a7fa0f9dff1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:56.245670 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e44411-46e0-4eff-9423-5a7fa0f9dff1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:23:56.255899 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e44411-46e0-4eff-9423-5a7fa0f9dff1 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:23:56.276139 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 839/1663] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:23:56 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 20 22:23:56.280552 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d50521-85ce-4bb1-95da-25a1929d1eca admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:23:56.293830 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d50521-85ce-4bb1-95da-25a1929d1eca admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:23:56.315717 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9927ac9-fa14-457d-8e1d-a8d7f2294cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:23:56.316481 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9927ac9-fa14-457d-8e1d-a8d7f2294cd4 admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:56.316879 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9927ac9-fa14-457d-8e1d-a8d7f2294cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:56.317245 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9927ac9-fa14-457d-8e1d-a8d7f2294cd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:56.318089 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9927ac9-fa14-457d-8e1d-a8d7f2294cd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:23:56.320428 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9927ac9-fa14-457d-8e1d-a8d7f2294cd4 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:23:56.344398 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 825/1664] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:23:56 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:23:56.348647 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e44411-46e0-4eff-9423-5a7fa0f9dff1 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:23:56.368985 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e44411-46e0-4eff-9423-5a7fa0f9dff1 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:23:56.374432 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd6992c-6dfd-475a-a2be-57a66ecc285f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:23:56.375601 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd6992c-6dfd-475a-a2be-57a66ecc285f admin admin] REQUEST_METHOD: `PUT` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:56.375601 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd6992c-6dfd-475a-a2be-57a66ecc285f admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:56.375809 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd6992c-6dfd-475a-a2be-57a66ecc285f admin admin] PATH_INFO: `/v3/projects/76922d67028b42ae881ef7e65a1285a4/users/bea159bc58024b59a5a206d0afb0c6a5/roles/604444e7ad0d437dbd1f5a6e02b761f5` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:56.409396 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd6992c-6dfd-475a-a2be-57a66ecc285f admin admin] RBAC: Authorizing `identity:create_grant(project_id=76922d67028b42ae881ef7e65a1285a4, user_id=bea159bc58024b59a5a206d0afb0c6a5, role_id=604444e7ad0d437dbd1f5a6e02b761f5)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:23:56.412128 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd6992c-6dfd-475a-a2be-57a66ecc285f admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:23:56.443472 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 840/1665] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:23:56 2022] PUT /identity/v3/projects/76922d67028b42ae881ef7e65a1285a4/users/bea159bc58024b59a5a206d0afb0c6a5/roles/604444e7ad0d437dbd1f5a6e02b761f5 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:23:56.454154 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e2e6df-668a-4504-9efb-1e0450d87d42 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:56.455044 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e2e6df-668a-4504-9efb-1e0450d87d42 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:56.455044 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e2e6df-668a-4504-9efb-1e0450d87d42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:56.503226 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:23:56.511044 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-15e2e6df-668a-4504-9efb-1e0450d87d42 None None] MFA Rules not processed for user `bea159bc58024b59a5a206d0afb0c6a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:23:56.514698 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-15e2e6df-668a-4504-9efb-1e0450d87d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:23:56.668910 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 826/1666] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:23:56 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:23:56.673445 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd6992c-6dfd-475a-a2be-57a66ecc285f admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:23:56.801733 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd6992c-6dfd-475a-a2be-57a66ecc285f admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:23:56.831273 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da27b2c-cc22-4db0-9139-1702c1aad800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:23:56.831919 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da27b2c-cc22-4db0-9139-1702c1aad800 admin admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:56.832433 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da27b2c-cc22-4db0-9139-1702c1aad800 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:56.832720 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da27b2c-cc22-4db0-9139-1702c1aad800 admin admin] PATH_INFO: `/v3/projects` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:56.833370 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da27b2c-cc22-4db0-9139-1702c1aad800 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:23:56.835367 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da27b2c-cc22-4db0-9139-1702c1aad800 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:23:56.913424 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 841/1667] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 20 22:23:56 2022] POST /identity/v3/projects => generated 355 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:23:56.917495 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e2e6df-668a-4504-9efb-1e0450d87d42 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:23:56.937473 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e2e6df-668a-4504-9efb-1e0450d87d42 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:23:57.086461 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c893711f-ecff-412d-999a-f03be6c20219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:23:57.087383 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c893711f-ecff-412d-999a-f03be6c20219 admin admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:57.088977 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c893711f-ecff-412d-999a-f03be6c20219 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:57.089402 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c893711f-ecff-412d-999a-f03be6c20219 admin admin] PATH_INFO: `/v3/users` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:57.090231 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c893711f-ecff-412d-999a-f03be6c20219 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:23:57.094539 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c893711f-ecff-412d-999a-f03be6c20219 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:23:57.154346 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 827/1668] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 20 22:23:56 2022] POST /identity/v3/users => generated 284 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:23:57.156301 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da27b2c-cc22-4db0-9139-1702c1aad800 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:23:57.169958 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da27b2c-cc22-4db0-9139-1702c1aad800 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:23:57.182258 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3385a50-0a1f-4653-bdf9-0a1cf317c192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:23:57.185591 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3385a50-0a1f-4653-bdf9-0a1cf317c192 admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:57.186214 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3385a50-0a1f-4653-bdf9-0a1cf317c192 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:57.186792 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3385a50-0a1f-4653-bdf9-0a1cf317c192 admin admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:57.188197 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3385a50-0a1f-4653-bdf9-0a1cf317c192 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:23:57.194752 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3385a50-0a1f-4653-bdf9-0a1cf317c192 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:23:57.233905 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 842/1669] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:23:57 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:23:57.238451 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c893711f-ecff-412d-999a-f03be6c20219 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:23:57.255516 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c893711f-ecff-412d-999a-f03be6c20219 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:23:57.267305 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7febde24-5e63-48e4-91bf-cdfaa48f2c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:23:57.268083 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7febde24-5e63-48e4-91bf-cdfaa48f2c9c admin admin] REQUEST_METHOD: `PUT` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:57.268369 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7febde24-5e63-48e4-91bf-cdfaa48f2c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:57.268684 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7febde24-5e63-48e4-91bf-cdfaa48f2c9c admin admin] PATH_INFO: `/v3/projects/5a331d79d8534851b6486a8af38bd14b/users/04cc6996303046babef83a9c7aab8fa6/roles/8a829170b29d42d6af589399e51edb0f` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:57.299085 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7febde24-5e63-48e4-91bf-cdfaa48f2c9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a331d79d8534851b6486a8af38bd14b, user_id=04cc6996303046babef83a9c7aab8fa6, role_id=8a829170b29d42d6af589399e51edb0f)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:23:57.311087 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7febde24-5e63-48e4-91bf-cdfaa48f2c9c admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:23:57.341365 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 828/1670] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:23:57 2022] PUT /identity/v3/projects/5a331d79d8534851b6486a8af38bd14b/users/04cc6996303046babef83a9c7aab8fa6/roles/8a829170b29d42d6af589399e51edb0f => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:23:57.345739 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3385a50-0a1f-4653-bdf9-0a1cf317c192 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:23:57.362610 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3385a50-0a1f-4653-bdf9-0a1cf317c192 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:23:57.458028 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:23:57.502416 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c306435c-90a7-4aa0-84f8-a637cba07131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:23:57.503084 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c306435c-90a7-4aa0-84f8-a637cba07131 admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:57.503369 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c306435c-90a7-4aa0-84f8-a637cba07131 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:57.503646 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c306435c-90a7-4aa0-84f8-a637cba07131 admin admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:57.508643 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c306435c-90a7-4aa0-84f8-a637cba07131 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:23:57.512950 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c306435c-90a7-4aa0-84f8-a637cba07131 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:23:57.549073 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 843/1671] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:23:57 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:23:57.553163 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7febde24-5e63-48e4-91bf-cdfaa48f2c9c admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:23:57.573546 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7febde24-5e63-48e4-91bf-cdfaa48f2c9c admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:23:57.587953 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f3eea4-e4a7-4b12-af97-4465c241ba38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:23:57.588779 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f3eea4-e4a7-4b12-af97-4465c241ba38 admin admin] REQUEST_METHOD: `PUT` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:57.589823 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f3eea4-e4a7-4b12-af97-4465c241ba38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:57.590787 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f3eea4-e4a7-4b12-af97-4465c241ba38 admin admin] PATH_INFO: `/v3/projects/5a331d79d8534851b6486a8af38bd14b/users/04cc6996303046babef83a9c7aab8fa6/roles/8a829170b29d42d6af589399e51edb0f` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:57.597577 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f3eea4-e4a7-4b12-af97-4465c241ba38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a331d79d8534851b6486a8af38bd14b, user_id=04cc6996303046babef83a9c7aab8fa6, role_id=8a829170b29d42d6af589399e51edb0f)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:23:57.617368 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f3eea4-e4a7-4b12-af97-4465c241ba38 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:23:57.645453 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d795e8ed-adb4-4bd5-a30a-a4d59315d893 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:57.645752 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d795e8ed-adb4-4bd5-a30a-a4d59315d893 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:57.646026 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d795e8ed-adb4-4bd5-a30a-a4d59315d893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:57.650581 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 829/1672] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:23:57 2022] PUT /identity/v3/projects/5a331d79d8534851b6486a8af38bd14b/users/04cc6996303046babef83a9c7aab8fa6/roles/8a829170b29d42d6af589399e51edb0f => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:23:57.694892 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-d795e8ed-adb4-4bd5-a30a-a4d59315d893 None None] MFA Rules not processed for user `04cc6996303046babef83a9c7aab8fa6`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:23:57.712543 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-d795e8ed-adb4-4bd5-a30a-a4d59315d893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:23:57.922437 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 844/1673] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:23:57 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 22:23:57.945594 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f3eea4-e4a7-4b12-af97-4465c241ba38 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:23:57.948759 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-85f3eea4-e4a7-4b12-af97-4465c241ba38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:23:58.104084 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f3eea4-e4a7-4b12-af97-4465c241ba38 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:23:58.108412 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbabd83-4352-45c7-9c04-326e1d4f79de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577c8b14c1f4279beac13b9ba11aba1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:23:58.109048 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbabd83-4352-45c7-9c04-326e1d4f79de service cinder] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:58.109331 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbabd83-4352-45c7-9c04-326e1d4f79de service cinder] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:58.109606 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbabd83-4352-45c7-9c04-326e1d4f79de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:58.121825 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbabd83-4352-45c7-9c04-326e1d4f79de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:23:58.123364 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbabd83-4352-45c7-9c04-326e1d4f79de service cinder] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:23:58.128623 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:23:58.155459 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 830/1674] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:23:57 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:23:58.283474 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d795e8ed-adb4-4bd5-a30a-a4d59315d893 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:23:58.285954 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-d795e8ed-adb4-4bd5-a30a-a4d59315d893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:23:58.314889 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d795e8ed-adb4-4bd5-a30a-a4d59315d893 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:23:58.327606 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f215fdf-c653-4b7b-8b10-7fc0249ce3d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577c8b14c1f4279beac13b9ba11aba1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:23:58.328449 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f215fdf-c653-4b7b-8b10-7fc0249ce3d0 service cinder] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:58.328915 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f215fdf-c653-4b7b-8b10-7fc0249ce3d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:58.329360 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f215fdf-c653-4b7b-8b10-7fc0249ce3d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:58.475164 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f215fdf-c653-4b7b-8b10-7fc0249ce3d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:23:58.476781 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f215fdf-c653-4b7b-8b10-7fc0249ce3d0 service cinder] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:23:58.517158 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 845/1675] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:23:58 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 20 22:23:58.544190 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba2430b-c98d-48d0-96cf-0b11d7f76a0a None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:58.544190 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba2430b-c98d-48d0-96cf-0b11d7f76a0a None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:58.544466 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba2430b-c98d-48d0-96cf-0b11d7f76a0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:58.605678 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f215fdf-c653-4b7b-8b10-7fc0249ce3d0 service cinder] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:23:58.607420 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-7f215fdf-c653-4b7b-8b10-7fc0249ce3d0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:23:58.663748 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-6ba2430b-c98d-48d0-96cf-0b11d7f76a0a None None] MFA Rules not processed for user `3945aaa89dd54656becb75c3f2c5de25`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:23:58.672856 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-6ba2430b-c98d-48d0-96cf-0b11d7f76a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:23:58.910215 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f215fdf-c653-4b7b-8b10-7fc0249ce3d0 service cinder] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:23:58.928921 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 831/1676] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:23:58 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 387 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:23:58.936694 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841ae13f-963e-4c61-8af3-06e34438b7a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:23:58.936694 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841ae13f-963e-4c61-8af3-06e34438b7a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:58.936694 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841ae13f-963e-4c61-8af3-06e34438b7a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:58.936694 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841ae13f-963e-4c61-8af3-06e34438b7a5 admin admin] PATH_INFO: `/v3/users/0dd93368b00d4fd08700dfc0d85c489e` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:58.937340 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841ae13f-963e-4c61-8af3-06e34438b7a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0dd93368b00d4fd08700dfc0d85c489e)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:23:58.937340 dv-cinder-858276-1-smb devstack@keystone.service[81306]: WARNING py.warnings [None req-841ae13f-963e-4c61-8af3-06e34438b7a5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 20 22:23:58.937340 dv-cinder-858276-1-smb devstack@keystone.service[81306]: warnings.warn(msg) Sep 20 22:23:58.937340 dv-cinder-858276-1-smb devstack@keystone.service[81306]: Sep 20 22:23:58.940958 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841ae13f-963e-4c61-8af3-06e34438b7a5 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:23:58.948632 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:23:59.101726 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-841ae13f-963e-4c61-8af3-06e34438b7a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0dd93368b00d4fd08700dfc0d85c489e'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:23:59.119681 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-841ae13f-963e-4c61-8af3-06e34438b7a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0dd93368b00d4fd08700dfc0d85c489e'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:23:59.120439 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-841ae13f-963e-4c61-8af3-06e34438b7a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0dd93368b00d4fd08700dfc0d85c489e'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:23:59.121457 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-841ae13f-963e-4c61-8af3-06e34438b7a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0dd93368b00d4fd08700dfc0d85c489e'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:23:59.147402 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-841ae13f-963e-4c61-8af3-06e34438b7a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0dd93368b00d4fd08700dfc0d85c489e'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:23:59.209047 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 846/1677] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 20 22:23:58 2022] DELETE /identity/v3/users/0dd93368b00d4fd08700dfc0d85c489e => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:23:59.214644 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9671aa7-44a8-4f4c-b241-3a3fca6a3e26 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:59.215473 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9671aa7-44a8-4f4c-b241-3a3fca6a3e26 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:59.215762 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9671aa7-44a8-4f4c-b241-3a3fca6a3e26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:59.266968 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-a9671aa7-44a8-4f4c-b241-3a3fca6a3e26 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:23:59.270857 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-a9671aa7-44a8-4f4c-b241-3a3fca6a3e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:23:59.437160 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 832/1678] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:23:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:23:59.655590 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841ae13f-963e-4c61-8af3-06e34438b7a5 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:23:59.657151 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-841ae13f-963e-4c61-8af3-06e34438b7a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:23:59.803030 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841ae13f-963e-4c61-8af3-06e34438b7a5 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:23:59.810152 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f82f03-5a2c-4c6b-a3af-21c687bb48cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b0b3ca4ecd41aaba9cf8e0f91fbf54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:23:59.812123 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f82f03-5a2c-4c6b-a3af-21c687bb48cf service neutron] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:23:59.812651 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f82f03-5a2c-4c6b-a3af-21c687bb48cf service neutron] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:23:59.813092 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f82f03-5a2c-4c6b-a3af-21c687bb48cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:23:59.833650 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f82f03-5a2c-4c6b-a3af-21c687bb48cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:23:59.836152 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f82f03-5a2c-4c6b-a3af-21c687bb48cf service neutron] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:23:59.857077 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 847/1679] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:23:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:24:00.953394 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9671aa7-44a8-4f4c-b241-3a3fca6a3e26 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:00.955057 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-a9671aa7-44a8-4f4c-b241-3a3fca6a3e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:00.978353 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9671aa7-44a8-4f4c-b241-3a3fca6a3e26 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:00.985443 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76ea7b3-31bc-468f-b0ce-8c691ee7c926 None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:00.985942 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76ea7b3-31bc-468f-b0ce-8c691ee7c926 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:00.986338 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76ea7b3-31bc-468f-b0ce-8c691ee7c926 None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:00.987978 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 848/1680] 10.222.0.33 () {54 vars in 921 bytes} [Tue Sep 20 22:24:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 20 22:24:00.994649 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7b8978-fa07-42fa-a1c5-ec50c798f6e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:00.995437 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7b8978-fa07-42fa-a1c5-ec50c798f6e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:00.995729 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7b8978-fa07-42fa-a1c5-ec50c798f6e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:00.996002 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7b8978-fa07-42fa-a1c5-ec50c798f6e1 admin admin] PATH_INFO: `/v3/users/bce5254e95a946aea6fb0c4d934dbd0d` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:00.998216 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7b8978-fa07-42fa-a1c5-ec50c798f6e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bce5254e95a946aea6fb0c4d934dbd0d)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:01.001281 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7b8978-fa07-42fa-a1c5-ec50c798f6e1 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:01.026775 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeff7eb-5c20-4357-9434-4b3f597b7f82 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:01.030682 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeff7eb-5c20-4357-9434-4b3f597b7f82 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:01.031275 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeff7eb-5c20-4357-9434-4b3f597b7f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:01.078241 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-0eeff7eb-5c20-4357-9434-4b3f597b7f82 None None] MFA Rules not processed for user `c79676ee86294dab92ba732e38d6fa74`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:24:01.087609 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-0eeff7eb-5c20-4357-9434-4b3f597b7f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:01.141936 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-1e7b8978-fa07-42fa-a1c5-ec50c798f6e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bce5254e95a946aea6fb0c4d934dbd0d'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:01.208943 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-1e7b8978-fa07-42fa-a1c5-ec50c798f6e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bce5254e95a946aea6fb0c4d934dbd0d'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:01.211442 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-1e7b8978-fa07-42fa-a1c5-ec50c798f6e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bce5254e95a946aea6fb0c4d934dbd0d'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:01.214172 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-1e7b8978-fa07-42fa-a1c5-ec50c798f6e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bce5254e95a946aea6fb0c4d934dbd0d'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:01.235941 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-1e7b8978-fa07-42fa-a1c5-ec50c798f6e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bce5254e95a946aea6fb0c4d934dbd0d'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:01.242450 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 849/1681] 10.222.0.33 () {58 vars in 1018 bytes} [Tue Sep 20 22:24:01 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:24:01.243928 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a39183-b4cd-40ff-ab63-81b69f14f0f8 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:01.248462 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a39183-b4cd-40ff-ab63-81b69f14f0f8 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:01.248964 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a39183-b4cd-40ff-ab63-81b69f14f0f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:01.353687 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-70a39183-b4cd-40ff-ab63-81b69f14f0f8 None None] MFA Rules not processed for user `c0a26034863a4590b4e2ec3a853a12b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:24:01.355092 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-70a39183-b4cd-40ff-ab63-81b69f14f0f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:01.380489 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:01.392935 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:01.407885 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 833/1682] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 20 22:24:00 2022] DELETE /identity/v3/users/bce5254e95a946aea6fb0c4d934dbd0d => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:24:01.408875 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7b8978-fa07-42fa-a1c5-ec50c798f6e1 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:01.415468 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-1e7b8978-fa07-42fa-a1c5-ec50c798f6e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:01.577731 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 850/1683] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:24:01 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:24:01.587748 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0e083b-934c-46aa-9595-dc1435609268 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:01.588235 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0e083b-934c-46aa-9595-dc1435609268 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:01.588659 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0e083b-934c-46aa-9595-dc1435609268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:01.648955 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-5b0e083b-934c-46aa-9595-dc1435609268 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:24:01.650207 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-5b0e083b-934c-46aa-9595-dc1435609268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:01.656022 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7b8978-fa07-42fa-a1c5-ec50c798f6e1 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:01.675063 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a107a8a-2008-417d-a06a-768ff03ed460 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c79676ee86294dab92ba732e38d6fa74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:01.675707 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a107a8a-2008-417d-a06a-768ff03ed460 service placement] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:01.676307 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a107a8a-2008-417d-a06a-768ff03ed460 service placement] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:01.676307 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a107a8a-2008-417d-a06a-768ff03ed460 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:01.702838 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a107a8a-2008-417d-a06a-768ff03ed460 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:01.704483 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a107a8a-2008-417d-a06a-768ff03ed460 service placement] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:01.738478 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 834/1684] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:24:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:24:01.757577 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a107a8a-2008-417d-a06a-768ff03ed460 service placement] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:01.764475 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-1a107a8a-2008-417d-a06a-768ff03ed460 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:01.843464 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 851/1685] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:24:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:24:01.844733 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0e083b-934c-46aa-9595-dc1435609268 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:01.853410 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-5b0e083b-934c-46aa-9595-dc1435609268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:01.967603 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a107a8a-2008-417d-a06a-768ff03ed460 service placement] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:01.986757 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bca1760-293b-4f90-a51d-42e91d2f6326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:01.989653 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bca1760-293b-4f90-a51d-42e91d2f6326 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:01.990826 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bca1760-293b-4f90-a51d-42e91d2f6326 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:01.992978 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bca1760-293b-4f90-a51d-42e91d2f6326 admin admin] PATH_INFO: `/v3/projects/be6e291a2d02434b848aa4e27f3c2491` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:01.996604 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bca1760-293b-4f90-a51d-42e91d2f6326 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be6e291a2d02434b848aa4e27f3c2491)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:01.997646 dv-cinder-858276-1-smb devstack@keystone.service[81307]: WARNING py.warnings [None req-7bca1760-293b-4f90-a51d-42e91d2f6326 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 20 22:24:01.997646 dv-cinder-858276-1-smb devstack@keystone.service[81307]: warnings.warn(msg) Sep 20 22:24:01.997646 dv-cinder-858276-1-smb devstack@keystone.service[81307]: Sep 20 22:24:02.003408 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bca1760-293b-4f90-a51d-42e91d2f6326 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:02.069028 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0e083b-934c-46aa-9595-dc1435609268 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:02.087997 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b27b55-a6c8-4da0-ae68-d64b10858ec3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db7eed561e99452289a662ad326cf919', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:02.092836 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b27b55-a6c8-4da0-ae68-d64b10858ec3 service nova] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:02.093199 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b27b55-a6c8-4da0-ae68-d64b10858ec3 service nova] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:02.093481 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b27b55-a6c8-4da0-ae68-d64b10858ec3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:02.173572 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-7bca1760-293b-4f90-a51d-42e91d2f6326 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be6e291a2d02434b848aa4e27f3c2491', 'request_id': 'req-7bca1760-293b-4f90-a51d-42e91d2f6326'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:02.226007 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-7bca1760-293b-4f90-a51d-42e91d2f6326 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be6e291a2d02434b848aa4e27f3c2491', 'request_id': 'req-7bca1760-293b-4f90-a51d-42e91d2f6326'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:02.260609 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-7bca1760-293b-4f90-a51d-42e91d2f6326 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be6e291a2d02434b848aa4e27f3c2491', 'request_id': 'req-7bca1760-293b-4f90-a51d-42e91d2f6326'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:02.306118 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:02.324237 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-7bca1760-293b-4f90-a51d-42e91d2f6326 admin admin] The token cache is being invalidate because project be6e291a2d02434b848aa4e27f3c2491 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81307) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 22:24:02.326361 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-7bca1760-293b-4f90-a51d-42e91d2f6326 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:02.327807 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-7bca1760-293b-4f90-a51d-42e91d2f6326 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:02.332752 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 835/1686] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 20 22:24:01 2022] DELETE /identity/v3/projects/be6e291a2d02434b848aa4e27f3c2491 => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:24:02.338841 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bca1760-293b-4f90-a51d-42e91d2f6326 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:02.344501 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-7bca1760-293b-4f90-a51d-42e91d2f6326 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:02.350897 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b27b55-a6c8-4da0-ae68-d64b10858ec3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:02.356287 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b27b55-a6c8-4da0-ae68-d64b10858ec3 service nova] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:02.401255 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 852/1687] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:24:01 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 557 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:24:02.402827 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a4585b-5a76-4e46-8976-56bd2189c11e None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:02.403120 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a4585b-5a76-4e46-8976-56bd2189c11e None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:02.403406 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a4585b-5a76-4e46-8976-56bd2189c11e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:02.415203 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:02.495088 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-d0a4585b-5a76-4e46-8976-56bd2189c11e None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:24:02.509627 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-d0a4585b-5a76-4e46-8976-56bd2189c11e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:02.601163 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bca1760-293b-4f90-a51d-42e91d2f6326 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:02.617310 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da9f3b2-667f-413e-b966-f972920d5030 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b0b3ca4ecd41aaba9cf8e0f91fbf54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:02.620138 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da9f3b2-667f-413e-b966-f972920d5030 service neutron] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:02.620388 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da9f3b2-667f-413e-b966-f972920d5030 service neutron] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:02.620632 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da9f3b2-667f-413e-b966-f972920d5030 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:02.636963 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-4da9f3b2-667f-413e-b966-f972920d5030 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:02.719968 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 853/1688] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:24:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:24:02.727769 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f9cc52-74f7-4aea-bf85-06f2c241fc5c None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:02.728307 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f9cc52-74f7-4aea-bf85-06f2c241fc5c None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:02.728718 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f9cc52-74f7-4aea-bf85-06f2c241fc5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:02.786890 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-10f9cc52-74f7-4aea-bf85-06f2c241fc5c None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:24:02.788138 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-10f9cc52-74f7-4aea-bf85-06f2c241fc5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:02.790772 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da9f3b2-667f-413e-b966-f972920d5030 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:02.793367 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da9f3b2-667f-413e-b966-f972920d5030 service neutron] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:02.812531 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 836/1689] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:24:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:24:02.814992 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 854/1690] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:24:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:24:02.819856 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da9f3b2-667f-413e-b966-f972920d5030 service neutron] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:02.833524 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da9f3b2-667f-413e-b966-f972920d5030 service neutron] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:02.841580 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7216eb80-6908-4d91-81d7-191f02a2df7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:02.842498 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7216eb80-6908-4d91-81d7-191f02a2df7c admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:02.843029 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7216eb80-6908-4d91-81d7-191f02a2df7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:02.843398 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7216eb80-6908-4d91-81d7-191f02a2df7c admin admin] PATH_INFO: `/v3/domains` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:02.844294 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7216eb80-6908-4d91-81d7-191f02a2df7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:24:02.844613 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7216eb80-6908-4d91-81d7-191f02a2df7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:02.846668 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7216eb80-6908-4d91-81d7-191f02a2df7c admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:02.865669 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 837/1691] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 20 22:24:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:24:02.867247 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f9cc52-74f7-4aea-bf85-06f2c241fc5c None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:02.886470 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f9cc52-74f7-4aea-bf85-06f2c241fc5c None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:02.902976 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ca7be9-3e25-40af-9ed8-cd2974963e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:02.903621 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ca7be9-3e25-40af-9ed8-cd2974963e86 admin admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:02.903903 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ca7be9-3e25-40af-9ed8-cd2974963e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:02.904175 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ca7be9-3e25-40af-9ed8-cd2974963e86 admin admin] PATH_INFO: `/v3/projects` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:02.904815 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ca7be9-3e25-40af-9ed8-cd2974963e86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:02.906762 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ca7be9-3e25-40af-9ed8-cd2974963e86 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:02.962220 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 855/1692] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 20 22:24:02 2022] POST /identity/v3/projects => generated 405 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:24:02.967092 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7216eb80-6908-4d91-81d7-191f02a2df7c admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:02.978854 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7216eb80-6908-4d91-81d7-191f02a2df7c admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:03.078632 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c666c2-6752-4eea-8d62-a94b228703cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:03.079795 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c666c2-6752-4eea-8d62-a94b228703cf admin admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:03.080281 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c666c2-6752-4eea-8d62-a94b228703cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:03.081248 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c666c2-6752-4eea-8d62-a94b228703cf admin admin] PATH_INFO: `/v3/users` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:03.082286 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c666c2-6752-4eea-8d62-a94b228703cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:03.086983 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c666c2-6752-4eea-8d62-a94b228703cf admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:03.125469 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 838/1693] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 20 22:24:02 2022] POST /identity/v3/users => generated 303 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:24:03.130197 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ca7be9-3e25-40af-9ed8-cd2974963e86 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:03.144310 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ca7be9-3e25-40af-9ed8-cd2974963e86 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:03.156312 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5610163a-331c-423a-91e4-342d554fb657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:03.156953 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5610163a-331c-423a-91e4-342d554fb657 admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:03.157327 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5610163a-331c-423a-91e4-342d554fb657 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:03.157606 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5610163a-331c-423a-91e4-342d554fb657 admin admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:03.158312 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5610163a-331c-423a-91e4-342d554fb657 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:03.159967 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5610163a-331c-423a-91e4-342d554fb657 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:03.177546 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 856/1694] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:24:03 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:24:03.178750 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c666c2-6752-4eea-8d62-a94b228703cf admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:03.190233 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c666c2-6752-4eea-8d62-a94b228703cf admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:03.211014 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c5ffb1-93a8-44fb-a7f5-869f70cb8546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:03.211971 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c5ffb1-93a8-44fb-a7f5-869f70cb8546 admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:03.212425 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c5ffb1-93a8-44fb-a7f5-869f70cb8546 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:03.212868 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c5ffb1-93a8-44fb-a7f5-869f70cb8546 admin admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:03.213739 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c5ffb1-93a8-44fb-a7f5-869f70cb8546 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:03.216043 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c5ffb1-93a8-44fb-a7f5-869f70cb8546 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:03.245298 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 839/1695] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:24:03 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:24:03.249411 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5610163a-331c-423a-91e4-342d554fb657 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:03.273121 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5610163a-331c-423a-91e4-342d554fb657 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:03.303675 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97e7251-8fda-4d78-952f-11b608d82039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:03.306009 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e7251-8fda-4d78-952f-11b608d82039 admin admin] REQUEST_METHOD: `PUT` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:03.306339 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e7251-8fda-4d78-952f-11b608d82039 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:03.309891 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e7251-8fda-4d78-952f-11b608d82039 admin admin] PATH_INFO: `/v3/projects/d05a7f9da7454f2fa9378ead3b932447/users/4943dd911f2b43d59513fe3e619fee58/roles/604444e7ad0d437dbd1f5a6e02b761f5` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:03.359128 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97e7251-8fda-4d78-952f-11b608d82039 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d05a7f9da7454f2fa9378ead3b932447, user_id=4943dd911f2b43d59513fe3e619fee58, role_id=604444e7ad0d437dbd1f5a6e02b761f5)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:03.367147 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97e7251-8fda-4d78-952f-11b608d82039 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:03.414703 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 857/1696] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:24:03 2022] PUT /identity/v3/projects/d05a7f9da7454f2fa9378ead3b932447/users/4943dd911f2b43d59513fe3e619fee58/roles/604444e7ad0d437dbd1f5a6e02b761f5 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:24:03.417143 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8750566-69a3-4387-8594-9d00efbb3ba9 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:03.417627 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8750566-69a3-4387-8594-9d00efbb3ba9 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:03.418071 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8750566-69a3-4387-8594-9d00efbb3ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:03.531380 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-b8750566-69a3-4387-8594-9d00efbb3ba9 None None] MFA Rules not processed for user `4943dd911f2b43d59513fe3e619fee58`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:24:03.533842 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-b8750566-69a3-4387-8594-9d00efbb3ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:03.635388 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:03.798360 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97e7251-8fda-4d78-952f-11b608d82039 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:03.801362 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-e97e7251-8fda-4d78-952f-11b608d82039 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:03.854571 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 840/1697] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:24:03 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 437 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:24:03.859644 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8750566-69a3-4387-8594-9d00efbb3ba9 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:04.054498 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8750566-69a3-4387-8594-9d00efbb3ba9 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:04.096611 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f488c556-8b23-436b-b52c-4f5ed2570d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:04.097375 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f488c556-8b23-436b-b52c-4f5ed2570d96 admin admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:04.098728 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f488c556-8b23-436b-b52c-4f5ed2570d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:04.100204 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f488c556-8b23-436b-b52c-4f5ed2570d96 admin admin] PATH_INFO: `/v3/projects` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:04.100889 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f488c556-8b23-436b-b52c-4f5ed2570d96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:04.111008 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97e7251-8fda-4d78-952f-11b608d82039 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:04.117098 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f488c556-8b23-436b-b52c-4f5ed2570d96 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:04.122969 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150a0d56-c37d-43d2-9d92-e40afabb443a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:04.124104 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150a0d56-c37d-43d2-9d92-e40afabb443a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:04.124540 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150a0d56-c37d-43d2-9d92-e40afabb443a admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:04.124965 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150a0d56-c37d-43d2-9d92-e40afabb443a admin admin] PATH_INFO: `/v3/users/06e92decadca4eb09f7046deefaf652b` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:04.126882 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150a0d56-c37d-43d2-9d92-e40afabb443a admin admin] RBAC: Authorizing `identity:delete_user(user_id=06e92decadca4eb09f7046deefaf652b)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:04.129525 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150a0d56-c37d-43d2-9d92-e40afabb443a admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:04.208306 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 841/1698] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 20 22:24:03 2022] POST /identity/v3/projects => generated 405 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 20 22:24:04.212345 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f488c556-8b23-436b-b52c-4f5ed2570d96 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:04.243585 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:04.295042 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-150a0d56-c37d-43d2-9d92-e40afabb443a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06e92decadca4eb09f7046deefaf652b'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:04.335037 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-150a0d56-c37d-43d2-9d92-e40afabb443a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06e92decadca4eb09f7046deefaf652b'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:04.336518 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-150a0d56-c37d-43d2-9d92-e40afabb443a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06e92decadca4eb09f7046deefaf652b'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:04.339024 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-150a0d56-c37d-43d2-9d92-e40afabb443a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06e92decadca4eb09f7046deefaf652b'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:04.365007 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-150a0d56-c37d-43d2-9d92-e40afabb443a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06e92decadca4eb09f7046deefaf652b'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:04.375562 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f488c556-8b23-436b-b52c-4f5ed2570d96 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:04.388601 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57160424-6bd8-43cf-8b2d-82f1b5031ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:04.388875 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57160424-6bd8-43cf-8b2d-82f1b5031ebf admin admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:04.389070 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57160424-6bd8-43cf-8b2d-82f1b5031ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:04.389379 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57160424-6bd8-43cf-8b2d-82f1b5031ebf admin admin] PATH_INFO: `/v3/users` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:04.389980 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57160424-6bd8-43cf-8b2d-82f1b5031ebf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:04.391970 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57160424-6bd8-43cf-8b2d-82f1b5031ebf admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:04.417597 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 858/1699] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 20 22:24:03 2022] DELETE /identity/v3/users/06e92decadca4eb09f7046deefaf652b => generated 0 bytes in 616 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:24:04.435639 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 842/1700] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 20 22:24:04 2022] POST /identity/v3/users => generated 309 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:24:04.439487 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150a0d56-c37d-43d2-9d92-e40afabb443a admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:04.441657 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-150a0d56-c37d-43d2-9d92-e40afabb443a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:04.590851 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150a0d56-c37d-43d2-9d92-e40afabb443a admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:04.590851 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cebb05d-6fb3-4570-8619-5cf1220a43e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:04.590851 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cebb05d-6fb3-4570-8619-5cf1220a43e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:04.590851 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cebb05d-6fb3-4570-8619-5cf1220a43e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:04.591118 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cebb05d-6fb3-4570-8619-5cf1220a43e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:04.591118 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cebb05d-6fb3-4570-8619-5cf1220a43e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:04.591523 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cebb05d-6fb3-4570-8619-5cf1220a43e5 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:04.609662 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 859/1701] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:24:04 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:24:04.610102 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57160424-6bd8-43cf-8b2d-82f1b5031ebf admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:04.623570 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57160424-6bd8-43cf-8b2d-82f1b5031ebf admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:04.633038 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0618f532-8857-40f6-b6f4-06f1e72c374d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:04.634315 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0618f532-8857-40f6-b6f4-06f1e72c374d admin admin] REQUEST_METHOD: `PUT` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:04.636892 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0618f532-8857-40f6-b6f4-06f1e72c374d admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:04.638233 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0618f532-8857-40f6-b6f4-06f1e72c374d admin admin] PATH_INFO: `/v3/projects/6d69d1e80f9b4ed0941706d458fd4727/users/8bf4562f75034fb39a281fb5cfa04a62/roles/8a829170b29d42d6af589399e51edb0f` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:04.665774 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0618f532-8857-40f6-b6f4-06f1e72c374d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d69d1e80f9b4ed0941706d458fd4727, user_id=8bf4562f75034fb39a281fb5cfa04a62, role_id=8a829170b29d42d6af589399e51edb0f)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:04.672525 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0618f532-8857-40f6-b6f4-06f1e72c374d admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:04.705720 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 843/1702] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:24:04 2022] PUT /identity/v3/projects/6d69d1e80f9b4ed0941706d458fd4727/users/8bf4562f75034fb39a281fb5cfa04a62/roles/8a829170b29d42d6af589399e51edb0f => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 22:24:04.709496 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cebb05d-6fb3-4570-8619-5cf1220a43e5 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:04.727028 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cebb05d-6fb3-4570-8619-5cf1220a43e5 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:04.887629 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04585bd6-7d68-4aaa-b0bc-9bb1adefe1d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:04.888283 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04585bd6-7d68-4aaa-b0bc-9bb1adefe1d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:04.889089 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04585bd6-7d68-4aaa-b0bc-9bb1adefe1d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:04.889383 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04585bd6-7d68-4aaa-b0bc-9bb1adefe1d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:04.890782 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04585bd6-7d68-4aaa-b0bc-9bb1adefe1d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:04.894039 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04585bd6-7d68-4aaa-b0bc-9bb1adefe1d3 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:04.926730 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0618f532-8857-40f6-b6f4-06f1e72c374d admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:04.936217 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 860/1703] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:24:04 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:24:04.942180 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0618f532-8857-40f6-b6f4-06f1e72c374d admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:04.952455 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39169994-a489-4faf-af77-60a6fe7b0896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:04.958176 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39169994-a489-4faf-af77-60a6fe7b0896 admin admin] REQUEST_METHOD: `PUT` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:04.958554 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39169994-a489-4faf-af77-60a6fe7b0896 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:04.959015 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39169994-a489-4faf-af77-60a6fe7b0896 admin admin] PATH_INFO: `/v3/projects/6d69d1e80f9b4ed0941706d458fd4727/users/8bf4562f75034fb39a281fb5cfa04a62/roles/8a829170b29d42d6af589399e51edb0f` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:04.967518 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39169994-a489-4faf-af77-60a6fe7b0896 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d69d1e80f9b4ed0941706d458fd4727, user_id=8bf4562f75034fb39a281fb5cfa04a62, role_id=8a829170b29d42d6af589399e51edb0f)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:04.975795 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39169994-a489-4faf-af77-60a6fe7b0896 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:04.997747 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:05.011407 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 844/1704] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:24:04 2022] PUT /identity/v3/projects/6d69d1e80f9b4ed0941706d458fd4727/users/8bf4562f75034fb39a281fb5cfa04a62/roles/8a829170b29d42d6af589399e51edb0f => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:24:05.027751 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87990009-2c19-4290-8eac-448fd54af742 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:05.028066 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87990009-2c19-4290-8eac-448fd54af742 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:05.028410 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87990009-2c19-4290-8eac-448fd54af742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:05.163423 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-87990009-2c19-4290-8eac-448fd54af742 None None] MFA Rules not processed for user `8bf4562f75034fb39a281fb5cfa04a62`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:24:05.175821 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-87990009-2c19-4290-8eac-448fd54af742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:05.268254 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:05.392359 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 861/1705] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:24:05 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:24:05.415523 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39169994-a489-4faf-af77-60a6fe7b0896 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:05.418359 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-39169994-a489-4faf-af77-60a6fe7b0896 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:05.560332 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39169994-a489-4faf-af77-60a6fe7b0896 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:05.568711 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae997d9c-d796-4476-8cc4-3106c777577a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577c8b14c1f4279beac13b9ba11aba1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:05.569364 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae997d9c-d796-4476-8cc4-3106c777577a service cinder] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:05.569651 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae997d9c-d796-4476-8cc4-3106c777577a service cinder] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:05.569930 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae997d9c-d796-4476-8cc4-3106c777577a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:05.594640 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae997d9c-d796-4476-8cc4-3106c777577a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:05.596119 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae997d9c-d796-4476-8cc4-3106c777577a service cinder] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:05.622940 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 845/1706] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:24:05 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:24:05.740776 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87990009-2c19-4290-8eac-448fd54af742 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:05.742715 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-87990009-2c19-4290-8eac-448fd54af742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:05.775351 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae997d9c-d796-4476-8cc4-3106c777577a service cinder] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:05.776854 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-ae997d9c-d796-4476-8cc4-3106c777577a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:05.959285 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae997d9c-d796-4476-8cc4-3106c777577a service cinder] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:05.968968 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4cb4c1-c4b0-40ff-9815-58ef7cce9b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:05.969639 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4cb4c1-c4b0-40ff-9815-58ef7cce9b41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:05.969917 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4cb4c1-c4b0-40ff-9815-58ef7cce9b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:05.970191 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4cb4c1-c4b0-40ff-9815-58ef7cce9b41 admin admin] PATH_INFO: `/v3/projects/34394b9f99624a5eaf60a37516232f40` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:05.973603 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4cb4c1-c4b0-40ff-9815-58ef7cce9b41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34394b9f99624a5eaf60a37516232f40)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:05.979422 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4cb4c1-c4b0-40ff-9815-58ef7cce9b41 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:06.021792 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87990009-2c19-4290-8eac-448fd54af742 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:06.047521 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afb9c8d-a728-4d8b-8e16-0d86b5bd49ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:06.050568 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb9c8d-a728-4d8b-8e16-0d86b5bd49ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:06.057783 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb9c8d-a728-4d8b-8e16-0d86b5bd49ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:06.060801 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb9c8d-a728-4d8b-8e16-0d86b5bd49ca admin admin] PATH_INFO: `/v3/projects/05609b83fc784467bbf955dc65ae043f` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:06.078231 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afb9c8d-a728-4d8b-8e16-0d86b5bd49ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=05609b83fc784467bbf955dc65ae043f)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:06.088719 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afb9c8d-a728-4d8b-8e16-0d86b5bd49ca admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:06.109954 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-af4cb4c1-c4b0-40ff-9815-58ef7cce9b41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34394b9f99624a5eaf60a37516232f40', 'request_id': 'req-af4cb4c1-c4b0-40ff-9815-58ef7cce9b41'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:06.124308 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-af4cb4c1-c4b0-40ff-9815-58ef7cce9b41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34394b9f99624a5eaf60a37516232f40', 'request_id': 'req-af4cb4c1-c4b0-40ff-9815-58ef7cce9b41'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:06.144738 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-af4cb4c1-c4b0-40ff-9815-58ef7cce9b41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34394b9f99624a5eaf60a37516232f40', 'request_id': 'req-af4cb4c1-c4b0-40ff-9815-58ef7cce9b41'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:06.167204 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-af4cb4c1-c4b0-40ff-9815-58ef7cce9b41 admin admin] The token cache is being invalidate because project 34394b9f99624a5eaf60a37516232f40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81307) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 22:24:06.167503 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-af4cb4c1-c4b0-40ff-9815-58ef7cce9b41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:06.168738 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-af4cb4c1-c4b0-40ff-9815-58ef7cce9b41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:06.170623 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 846/1707] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 20 22:24:05 2022] DELETE /identity/v3/projects/34394b9f99624a5eaf60a37516232f40 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:24:06.172388 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fca4e64-5f1a-4a2a-914b-adf683b909a4 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:06.172672 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fca4e64-5f1a-4a2a-914b-adf683b909a4 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:06.172942 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fca4e64-5f1a-4a2a-914b-adf683b909a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:06.195337 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-3afb9c8d-a728-4d8b-8e16-0d86b5bd49ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05609b83fc784467bbf955dc65ae043f', 'request_id': 'req-3afb9c8d-a728-4d8b-8e16-0d86b5bd49ca'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:06.239588 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-3afb9c8d-a728-4d8b-8e16-0d86b5bd49ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05609b83fc784467bbf955dc65ae043f', 'request_id': 'req-3afb9c8d-a728-4d8b-8e16-0d86b5bd49ca'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:06.239992 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-1fca4e64-5f1a-4a2a-914b-adf683b909a4 None None] MFA Rules not processed for user `fb0b83edd8754e659729e05787f3bf4d`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:24:06.245700 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-1fca4e64-5f1a-4a2a-914b-adf683b909a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:06.260426 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-3afb9c8d-a728-4d8b-8e16-0d86b5bd49ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05609b83fc784467bbf955dc65ae043f', 'request_id': 'req-3afb9c8d-a728-4d8b-8e16-0d86b5bd49ca'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:06.280017 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-3afb9c8d-a728-4d8b-8e16-0d86b5bd49ca admin admin] The token cache is being invalidate because project 05609b83fc784467bbf955dc65ae043f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81306) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 22:24:06.280650 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-3afb9c8d-a728-4d8b-8e16-0d86b5bd49ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:06.281376 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-3afb9c8d-a728-4d8b-8e16-0d86b5bd49ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:06.283685 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 862/1708] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 20 22:24:05 2022] DELETE /identity/v3/projects/05609b83fc784467bbf955dc65ae043f => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:24:06.284516 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afb9c8d-a728-4d8b-8e16-0d86b5bd49ca admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:06.288769 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-3afb9c8d-a728-4d8b-8e16-0d86b5bd49ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:06.355069 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:06.398754 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:06.427287 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afb9c8d-a728-4d8b-8e16-0d86b5bd49ca admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:06.433614 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca63a7a9-d797-4329-a966-6677c22a47f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:06.434158 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca63a7a9-d797-4329-a966-6677c22a47f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:06.434447 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca63a7a9-d797-4329-a966-6677c22a47f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:06.434987 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca63a7a9-d797-4329-a966-6677c22a47f1 admin admin] PATH_INFO: `/v3/users/4943dd911f2b43d59513fe3e619fee58` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:06.436138 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca63a7a9-d797-4329-a966-6677c22a47f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4943dd911f2b43d59513fe3e619fee58)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:06.438419 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca63a7a9-d797-4329-a966-6677c22a47f1 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:06.482144 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 847/1709] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:24:06 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:24:06.482839 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fca4e64-5f1a-4a2a-914b-adf683b909a4 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:06.484137 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-1fca4e64-5f1a-4a2a-914b-adf683b909a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:06.519110 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fca4e64-5f1a-4a2a-914b-adf683b909a4 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:06.528845 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc2f437-b213-4c59-8aea-c0df650e7be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:06.529538 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc2f437-b213-4c59-8aea-c0df650e7be9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:06.529818 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc2f437-b213-4c59-8aea-c0df650e7be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:06.530091 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc2f437-b213-4c59-8aea-c0df650e7be9 admin admin] PATH_INFO: `/v3/users/3945aaa89dd54656becb75c3f2c5de25` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:06.536868 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc2f437-b213-4c59-8aea-c0df650e7be9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3945aaa89dd54656becb75c3f2c5de25)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:06.538961 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc2f437-b213-4c59-8aea-c0df650e7be9 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:06.549145 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-ca63a7a9-d797-4329-a966-6677c22a47f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4943dd911f2b43d59513fe3e619fee58'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:06.561966 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-ca63a7a9-d797-4329-a966-6677c22a47f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4943dd911f2b43d59513fe3e619fee58'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:06.562897 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-ca63a7a9-d797-4329-a966-6677c22a47f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4943dd911f2b43d59513fe3e619fee58'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:06.563659 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-ca63a7a9-d797-4329-a966-6677c22a47f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4943dd911f2b43d59513fe3e619fee58'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:06.582797 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-ca63a7a9-d797-4329-a966-6677c22a47f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4943dd911f2b43d59513fe3e619fee58'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:06.613510 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 863/1710] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 20 22:24:06 2022] DELETE /identity/v3/users/4943dd911f2b43d59513fe3e619fee58 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:24:06.613510 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca63a7a9-d797-4329-a966-6677c22a47f1 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:06.613510 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-ca63a7a9-d797-4329-a966-6677c22a47f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:06.647888 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-ccc2f437-b213-4c59-8aea-c0df650e7be9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3945aaa89dd54656becb75c3f2c5de25'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:06.665168 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-ccc2f437-b213-4c59-8aea-c0df650e7be9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3945aaa89dd54656becb75c3f2c5de25'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:06.665872 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-ccc2f437-b213-4c59-8aea-c0df650e7be9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3945aaa89dd54656becb75c3f2c5de25'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:06.669508 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-ccc2f437-b213-4c59-8aea-c0df650e7be9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3945aaa89dd54656becb75c3f2c5de25'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:06.689534 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-ccc2f437-b213-4c59-8aea-c0df650e7be9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3945aaa89dd54656becb75c3f2c5de25'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:06.740271 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 848/1711] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 20 22:24:06 2022] DELETE /identity/v3/users/3945aaa89dd54656becb75c3f2c5de25 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:24:06.742090 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e2c194-82ec-4427-b955-80429ec423ca None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:06.742371 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e2c194-82ec-4427-b955-80429ec423ca None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:06.742706 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e2c194-82ec-4427-b955-80429ec423ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:06.797057 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-38e2c194-82ec-4427-b955-80429ec423ca None None] MFA Rules not processed for user `fb0b83edd8754e659729e05787f3bf4d`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:24:06.799639 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-38e2c194-82ec-4427-b955-80429ec423ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:06.849218 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca63a7a9-d797-4329-a966-6677c22a47f1 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:06.970225 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 849/1712] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:24:06 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:24:06.985731 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f269bca-0c56-4335-a66b-1200f6aac37f None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:06.986051 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f269bca-0c56-4335-a66b-1200f6aac37f None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:06.986295 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f269bca-0c56-4335-a66b-1200f6aac37f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:07.015023 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223e5462-4ad2-4fed-8ae0-14e8327657d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:07.016344 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223e5462-4ad2-4fed-8ae0-14e8327657d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:07.016789 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223e5462-4ad2-4fed-8ae0-14e8327657d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:07.017207 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223e5462-4ad2-4fed-8ae0-14e8327657d4 admin admin] PATH_INFO: `/v3/users/336f2bfb5b8e4bc3be051e5363b4185f` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:07.018839 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223e5462-4ad2-4fed-8ae0-14e8327657d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=336f2bfb5b8e4bc3be051e5363b4185f)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:07.021141 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223e5462-4ad2-4fed-8ae0-14e8327657d4 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:07.037053 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-9f269bca-0c56-4335-a66b-1200f6aac37f None None] MFA Rules not processed for user `738e985e59b54da6b729bc8007eb7f3d`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:24:07.039665 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-9f269bca-0c56-4335-a66b-1200f6aac37f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:07.075378 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:07.082362 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:07.147615 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-223e5462-4ad2-4fed-8ae0-14e8327657d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '336f2bfb5b8e4bc3be051e5363b4185f'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:07.163391 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-223e5462-4ad2-4fed-8ae0-14e8327657d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '336f2bfb5b8e4bc3be051e5363b4185f'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:07.164239 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-223e5462-4ad2-4fed-8ae0-14e8327657d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '336f2bfb5b8e4bc3be051e5363b4185f'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:07.165175 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-223e5462-4ad2-4fed-8ae0-14e8327657d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '336f2bfb5b8e4bc3be051e5363b4185f'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:07.168789 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 850/1713] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:24:06 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:24:07.173063 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6137f33-5e0c-403e-ac95-13329ef724ce None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:07.173460 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6137f33-5e0c-403e-ac95-13329ef724ce None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:07.173645 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6137f33-5e0c-403e-ac95-13329ef724ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:07.193775 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-223e5462-4ad2-4fed-8ae0-14e8327657d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '336f2bfb5b8e4bc3be051e5363b4185f'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:07.217581 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-b6137f33-5e0c-403e-ac95-13329ef724ce None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:24:07.218985 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-b6137f33-5e0c-403e-ac95-13329ef724ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:07.241076 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 851/1714] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:24:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:24:07.241076 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f9c45c-690b-4129-9772-6dd1b416eb69 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:07.241076 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f9c45c-690b-4129-9772-6dd1b416eb69 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:07.241076 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f9c45c-690b-4129-9772-6dd1b416eb69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:07.242849 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 864/1715] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 20 22:24:06 2022] DELETE /identity/v3/users/336f2bfb5b8e4bc3be051e5363b4185f => generated 0 bytes in 631 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:24:07.244399 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223e5462-4ad2-4fed-8ae0-14e8327657d4 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:07.249807 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-223e5462-4ad2-4fed-8ae0-14e8327657d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:07.339328 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-c5f9c45c-690b-4129-9772-6dd1b416eb69 None None] MFA Rules not processed for user `3eed1b62f00a4dbc98524c44147c3b72`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:24:07.342329 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-c5f9c45c-690b-4129-9772-6dd1b416eb69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:07.474014 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223e5462-4ad2-4fed-8ae0-14e8327657d4 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:07.485344 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb40201-2a33-4aa0-9e4e-15a124a75bbf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db7eed561e99452289a662ad326cf919', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:07.486277 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb40201-2a33-4aa0-9e4e-15a124a75bbf service nova] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:07.487199 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb40201-2a33-4aa0-9e4e-15a124a75bbf service nova] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:07.487810 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb40201-2a33-4aa0-9e4e-15a124a75bbf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:07.490027 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-3bb40201-2a33-4aa0-9e4e-15a124a75bbf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:07.495719 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 852/1716] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:24:07 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:24:07.500768 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219ecd3f-3896-4028-a21f-d1df05643e1f None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:07.501057 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219ecd3f-3896-4028-a21f-d1df05643e1f None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:07.501359 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219ecd3f-3896-4028-a21f-d1df05643e1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:07.582202 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-219ecd3f-3896-4028-a21f-d1df05643e1f None None] MFA Rules not processed for user `738e985e59b54da6b729bc8007eb7f3d`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:24:07.588715 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-219ecd3f-3896-4028-a21f-d1df05643e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:07.661546 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb40201-2a33-4aa0-9e4e-15a124a75bbf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:07.663219 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb40201-2a33-4aa0-9e4e-15a124a75bbf service nova] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:07.691689 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 865/1717] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:24:07 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:24:07.696275 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb40201-2a33-4aa0-9e4e-15a124a75bbf service nova] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:07.700462 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-3bb40201-2a33-4aa0-9e4e-15a124a75bbf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:07.719344 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 853/1718] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:24:07 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:24:07.721581 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219ecd3f-3896-4028-a21f-d1df05643e1f None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:07.725361 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-219ecd3f-3896-4028-a21f-d1df05643e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:07.782376 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:07.832975 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb40201-2a33-4aa0-9e4e-15a124a75bbf service nova] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:07.852193 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4729ef92-bc1a-43e3-8653-0cd37210b0cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b0b3ca4ecd41aaba9cf8e0f91fbf54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:07.852975 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4729ef92-bc1a-43e3-8653-0cd37210b0cd service neutron] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:07.853100 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4729ef92-bc1a-43e3-8653-0cd37210b0cd service neutron] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:07.853371 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4729ef92-bc1a-43e3-8653-0cd37210b0cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:07.884246 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:07.898532 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219ecd3f-3896-4028-a21f-d1df05643e1f None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:07.912251 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c49dcc7-6ff6-498d-9304-6e0eda4eb7f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:07.913403 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c49dcc7-6ff6-498d-9304-6e0eda4eb7f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:07.913723 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c49dcc7-6ff6-498d-9304-6e0eda4eb7f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:07.914088 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c49dcc7-6ff6-498d-9304-6e0eda4eb7f7 admin admin] PATH_INFO: `/v3/projects/ecad345382b84bcb8e0b7664b79a4254` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:07.917405 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c49dcc7-6ff6-498d-9304-6e0eda4eb7f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecad345382b84bcb8e0b7664b79a4254)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:07.923310 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c49dcc7-6ff6-498d-9304-6e0eda4eb7f7 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:08.039432 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4729ef92-bc1a-43e3-8653-0cd37210b0cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:08.041724 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4729ef92-bc1a-43e3-8653-0cd37210b0cd service neutron] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:08.055269 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-9c49dcc7-6ff6-498d-9304-6e0eda4eb7f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecad345382b84bcb8e0b7664b79a4254', 'request_id': 'req-9c49dcc7-6ff6-498d-9304-6e0eda4eb7f7'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:08.071181 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-9c49dcc7-6ff6-498d-9304-6e0eda4eb7f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecad345382b84bcb8e0b7664b79a4254', 'request_id': 'req-9c49dcc7-6ff6-498d-9304-6e0eda4eb7f7'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:08.080231 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 866/1719] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:24:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:24:08.080231 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4729ef92-bc1a-43e3-8653-0cd37210b0cd service neutron] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:08.084058 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-4729ef92-bc1a-43e3-8653-0cd37210b0cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:08.106326 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-9c49dcc7-6ff6-498d-9304-6e0eda4eb7f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecad345382b84bcb8e0b7664b79a4254', 'request_id': 'req-9c49dcc7-6ff6-498d-9304-6e0eda4eb7f7'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:08.128808 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4729ef92-bc1a-43e3-8653-0cd37210b0cd service neutron] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:08.139633 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-9c49dcc7-6ff6-498d-9304-6e0eda4eb7f7 admin admin] The token cache is being invalidate because project ecad345382b84bcb8e0b7664b79a4254 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81307) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 22:24:08.140258 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-9c49dcc7-6ff6-498d-9304-6e0eda4eb7f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:08.143724 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-9c49dcc7-6ff6-498d-9304-6e0eda4eb7f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:08.149897 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 854/1720] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 20 22:24:07 2022] DELETE /identity/v3/projects/ecad345382b84bcb8e0b7664b79a4254 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:24:08.149897 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c49dcc7-6ff6-498d-9304-6e0eda4eb7f7 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:08.153309 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-9c49dcc7-6ff6-498d-9304-6e0eda4eb7f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:08.212021 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e41466d-7f9d-4a4b-92f1-c39e5702d48c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db7eed561e99452289a662ad326cf919', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:08.212678 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e41466d-7f9d-4a4b-92f1-c39e5702d48c service nova] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:08.213050 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e41466d-7f9d-4a4b-92f1-c39e5702d48c service nova] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:08.213320 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e41466d-7f9d-4a4b-92f1-c39e5702d48c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:08.216446 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-3e41466d-7f9d-4a4b-92f1-c39e5702d48c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:08.395041 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c49dcc7-6ff6-498d-9304-6e0eda4eb7f7 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:08.403725 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2713a3-e0bd-4a2e-a827-90ce3e868188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:08.404386 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2713a3-e0bd-4a2e-a827-90ce3e868188 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:08.404663 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2713a3-e0bd-4a2e-a827-90ce3e868188 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:08.404955 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2713a3-e0bd-4a2e-a827-90ce3e868188 admin admin] PATH_INFO: `/v3/projects/cb594f7c81a74ff7bc9b0885b77489d5` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:08.406464 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2713a3-e0bd-4a2e-a827-90ce3e868188 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb594f7c81a74ff7bc9b0885b77489d5)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:08.410468 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2713a3-e0bd-4a2e-a827-90ce3e868188 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:08.411890 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e41466d-7f9d-4a4b-92f1-c39e5702d48c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:08.413562 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e41466d-7f9d-4a4b-92f1-c39e5702d48c service nova] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:08.452726 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 867/1721] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:24:08 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:24:08.468124 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1917677f-6884-4fc6-ad5b-d05aa87fe143 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:08.468409 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1917677f-6884-4fc6-ad5b-d05aa87fe143 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:08.468691 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1917677f-6884-4fc6-ad5b-d05aa87fe143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:08.557718 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-1917677f-6884-4fc6-ad5b-d05aa87fe143 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:24:08.559587 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-1917677f-6884-4fc6-ad5b-d05aa87fe143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:08.573003 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-ad2713a3-e0bd-4a2e-a827-90ce3e868188 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb594f7c81a74ff7bc9b0885b77489d5', 'request_id': 'req-ad2713a3-e0bd-4a2e-a827-90ce3e868188'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:08.602496 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-ad2713a3-e0bd-4a2e-a827-90ce3e868188 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb594f7c81a74ff7bc9b0885b77489d5', 'request_id': 'req-ad2713a3-e0bd-4a2e-a827-90ce3e868188'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:08.615262 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:08.635436 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-ad2713a3-e0bd-4a2e-a827-90ce3e868188 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb594f7c81a74ff7bc9b0885b77489d5', 'request_id': 'req-ad2713a3-e0bd-4a2e-a827-90ce3e868188'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:08.656181 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-ad2713a3-e0bd-4a2e-a827-90ce3e868188 admin admin] The token cache is being invalidate because project cb594f7c81a74ff7bc9b0885b77489d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81307) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 22:24:08.656472 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-ad2713a3-e0bd-4a2e-a827-90ce3e868188 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:08.657705 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-ad2713a3-e0bd-4a2e-a827-90ce3e868188 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:08.660560 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 855/1722] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 20 22:24:08 2022] DELETE /identity/v3/projects/cb594f7c81a74ff7bc9b0885b77489d5 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:24:08.664659 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2713a3-e0bd-4a2e-a827-90ce3e868188 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:08.668280 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-ad2713a3-e0bd-4a2e-a827-90ce3e868188 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:08.718531 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:08.743711 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 868/1723] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:24:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:24:08.744811 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218e860c-8307-47a1-b69c-422e81095e2b None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:08.745101 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218e860c-8307-47a1-b69c-422e81095e2b None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:08.745380 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218e860c-8307-47a1-b69c-422e81095e2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:08.784832 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-218e860c-8307-47a1-b69c-422e81095e2b None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:24:08.786897 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-218e860c-8307-47a1-b69c-422e81095e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:08.809857 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 869/1724] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:24:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:24:08.822078 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f2504-d2c1-423d-8d36-ee5b47d832e6 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:08.822368 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f2504-d2c1-423d-8d36-ee5b47d832e6 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:08.822679 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f2504-d2c1-423d-8d36-ee5b47d832e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:08.857500 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2713a3-e0bd-4a2e-a827-90ce3e868188 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:08.861849 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-c64f2504-d2c1-423d-8d36-ee5b47d832e6 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:24:08.863269 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-c64f2504-d2c1-423d-8d36-ee5b47d832e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:08.865337 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a11e41-b383-4847-bc47-3d19b21d9a5b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db7eed561e99452289a662ad326cf919', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:08.866602 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a11e41-b383-4847-bc47-3d19b21d9a5b service nova] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:08.867050 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a11e41-b383-4847-bc47-3d19b21d9a5b service nova] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:08.867790 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a11e41-b383-4847-bc47-3d19b21d9a5b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:08.875522 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-b6a11e41-b383-4847-bc47-3d19b21d9a5b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:08.876260 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 870/1725] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:24:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:24:08.877803 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3e1b27-dbfa-4458-838d-b582b3620bc9 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:08.878229 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3e1b27-dbfa-4458-838d-b582b3620bc9 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:08.878693 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3e1b27-dbfa-4458-838d-b582b3620bc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:08.917299 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-bf3e1b27-dbfa-4458-838d-b582b3620bc9 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:24:08.920606 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-bf3e1b27-dbfa-4458-838d-b582b3620bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:08.935701 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 871/1726] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:24:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:24:08.936839 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3e1b27-dbfa-4458-838d-b582b3620bc9 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:08.948962 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3e1b27-dbfa-4458-838d-b582b3620bc9 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:08.956430 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d6985a-97f7-4b70-bba7-2d8588f4964c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:08.957163 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d6985a-97f7-4b70-bba7-2d8588f4964c admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:08.957487 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d6985a-97f7-4b70-bba7-2d8588f4964c admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:08.957761 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d6985a-97f7-4b70-bba7-2d8588f4964c admin admin] PATH_INFO: `/v3/domains` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:08.958551 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d6985a-97f7-4b70-bba7-2d8588f4964c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:24:08.958855 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d6985a-97f7-4b70-bba7-2d8588f4964c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:08.960701 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d6985a-97f7-4b70-bba7-2d8588f4964c admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:08.976627 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 872/1727] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 20 22:24:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:24:08.978001 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5401792-5a66-41ad-9a5a-2a758026f4e9 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:08.978289 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5401792-5a66-41ad-9a5a-2a758026f4e9 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:08.978603 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5401792-5a66-41ad-9a5a-2a758026f4e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:09.003321 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-b5401792-5a66-41ad-9a5a-2a758026f4e9 None None] MFA Rules not processed for user `c0a26034863a4590b4e2ec3a853a12b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:24:09.004562 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-b5401792-5a66-41ad-9a5a-2a758026f4e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:09.019185 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a11e41-b383-4847-bc47-3d19b21d9a5b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:09.034923 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a11e41-b383-4847-bc47-3d19b21d9a5b service nova] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:09.055349 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 856/1728] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:24:08 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:24:09.067662 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a11e41-b383-4847-bc47-3d19b21d9a5b service nova] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:09.092328 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a11e41-b383-4847-bc47-3d19b21d9a5b service nova] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:09.098103 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c9683d-6556-4121-87db-c4814b9d9440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:09.098928 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c9683d-6556-4121-87db-c4814b9d9440 admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:09.099313 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c9683d-6556-4121-87db-c4814b9d9440 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:09.099696 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c9683d-6556-4121-87db-c4814b9d9440 admin admin] PATH_INFO: `/v3/domains` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:09.100464 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c9683d-6556-4121-87db-c4814b9d9440 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:24:09.101008 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c9683d-6556-4121-87db-c4814b9d9440 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:09.103479 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c9683d-6556-4121-87db-c4814b9d9440 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:09.118831 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 857/1729] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 20 22:24:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:24:09.120346 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b740e825-a4f0-41bf-85bb-8de2136eacce None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:09.120777 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b740e825-a4f0-41bf-85bb-8de2136eacce None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:09.121330 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b740e825-a4f0-41bf-85bb-8de2136eacce None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:09.127110 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 858/1730] 10.222.0.33 () {54 vars in 912 bytes} [Tue Sep 20 22:24:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:24:09.128233 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b740e825-a4f0-41bf-85bb-8de2136eacce None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:09.154395 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 873/1731] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:24:08 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:24:09.154395 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5401792-5a66-41ad-9a5a-2a758026f4e9 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:09.161615 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b740e825-a4f0-41bf-85bb-8de2136eacce None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:09.175305 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42902445-76c1-4181-96c6-53147bd280f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:09.175927 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42902445-76c1-4181-96c6-53147bd280f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:09.176490 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42902445-76c1-4181-96c6-53147bd280f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:09.176490 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42902445-76c1-4181-96c6-53147bd280f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:09.178906 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42902445-76c1-4181-96c6-53147bd280f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:09.188045 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42902445-76c1-4181-96c6-53147bd280f2 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:09.201583 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5401792-5a66-41ad-9a5a-2a758026f4e9 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:09.211816 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51301ca-8d19-4d63-a5d9-87dc3854aa6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:09.212444 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51301ca-8d19-4d63-a5d9-87dc3854aa6a admin admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:09.212724 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51301ca-8d19-4d63-a5d9-87dc3854aa6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:09.212990 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51301ca-8d19-4d63-a5d9-87dc3854aa6a admin admin] PATH_INFO: `/v3/projects` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:09.213639 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51301ca-8d19-4d63-a5d9-87dc3854aa6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:09.220013 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51301ca-8d19-4d63-a5d9-87dc3854aa6a admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:09.289332 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 859/1732] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 20 22:24:09 2022] POST /identity/v3/projects => generated 387 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:24:09.291487 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba4d5bc-129e-4905-9a3e-fcb7b7bb6210 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:09.310322 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba4d5bc-129e-4905-9a3e-fcb7b7bb6210 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:09.310932 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba4d5bc-129e-4905-9a3e-fcb7b7bb6210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:09.313359 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 874/1733] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 20 22:24:09 2022] POST /identity/v3/projects => generated 363 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:24:09.314448 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51301ca-8d19-4d63-a5d9-87dc3854aa6a admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:09.318351 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-e51301ca-8d19-4d63-a5d9-87dc3854aa6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:09.380742 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-cba4d5bc-129e-4905-9a3e-fcb7b7bb6210 None None] MFA Rules not processed for user `e9b0b3ca4ecd41aaba9cf8e0f91fbf54`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:24:09.382340 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-cba4d5bc-129e-4905-9a3e-fcb7b7bb6210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:09.504956 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51301ca-8d19-4d63-a5d9-87dc3854aa6a admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:09.535294 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fcc6fe-f646-448f-9e11-a69825dc3bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:09.536218 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fcc6fe-f646-448f-9e11-a69825dc3bc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:09.536710 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fcc6fe-f646-448f-9e11-a69825dc3bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:09.537207 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fcc6fe-f646-448f-9e11-a69825dc3bc4 admin admin] PATH_INFO: `/v3/projects/d05a7f9da7454f2fa9378ead3b932447` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:09.540844 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fcc6fe-f646-448f-9e11-a69825dc3bc4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d05a7f9da7454f2fa9378ead3b932447)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:09.545681 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fcc6fe-f646-448f-9e11-a69825dc3bc4 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:09.557374 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 860/1734] 10.222.0.33 () {58 vars in 1009 bytes} [Tue Sep 20 22:24:09 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:24:09.559594 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba4d5bc-129e-4905-9a3e-fcb7b7bb6210 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:09.584490 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba4d5bc-129e-4905-9a3e-fcb7b7bb6210 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:09.585801 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:09.594074 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebca9c5-3c7a-4191-9fa9-81c701a424fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:09.595199 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebca9c5-3c7a-4191-9fa9-81c701a424fd admin admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:09.595683 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebca9c5-3c7a-4191-9fa9-81c701a424fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:09.596191 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebca9c5-3c7a-4191-9fa9-81c701a424fd admin admin] PATH_INFO: `/v3/users` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:09.597045 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebca9c5-3c7a-4191-9fa9-81c701a424fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:09.604549 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebca9c5-3c7a-4191-9fa9-81c701a424fd admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:09.635171 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:09.657723 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 861/1735] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 20 22:24:09 2022] POST /identity/v3/users => generated 294 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:24:09.661628 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebca9c5-3c7a-4191-9fa9-81c701a424fd admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:09.679197 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebca9c5-3c7a-4191-9fa9-81c701a424fd admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:09.718432 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-52fcc6fe-f646-448f-9e11-a69825dc3bc4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd05a7f9da7454f2fa9378ead3b932447', 'request_id': 'req-52fcc6fe-f646-448f-9e11-a69825dc3bc4'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:09.733385 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-52fcc6fe-f646-448f-9e11-a69825dc3bc4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd05a7f9da7454f2fa9378ead3b932447', 'request_id': 'req-52fcc6fe-f646-448f-9e11-a69825dc3bc4'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:09.754896 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-52fcc6fe-f646-448f-9e11-a69825dc3bc4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd05a7f9da7454f2fa9378ead3b932447', 'request_id': 'req-52fcc6fe-f646-448f-9e11-a69825dc3bc4'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:09.775166 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-52fcc6fe-f646-448f-9e11-a69825dc3bc4 admin admin] The token cache is being invalidate because project d05a7f9da7454f2fa9378ead3b932447 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81306) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 22:24:09.775462 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-52fcc6fe-f646-448f-9e11-a69825dc3bc4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:09.776160 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-52fcc6fe-f646-448f-9e11-a69825dc3bc4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:09.778148 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 875/1736] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 20 22:24:09 2022] DELETE /identity/v3/projects/d05a7f9da7454f2fa9378ead3b932447 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:24:09.780047 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fcc6fe-f646-448f-9e11-a69825dc3bc4 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:09.786258 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-52fcc6fe-f646-448f-9e11-a69825dc3bc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:09.832566 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d056b429-abe9-4fc2-98a1-87ca7a21c014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:09.833609 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d056b429-abe9-4fc2-98a1-87ca7a21c014 admin admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:09.834860 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d056b429-abe9-4fc2-98a1-87ca7a21c014 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:09.835607 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d056b429-abe9-4fc2-98a1-87ca7a21c014 admin admin] PATH_INFO: `/v3/users` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:09.838020 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d056b429-abe9-4fc2-98a1-87ca7a21c014 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:09.841190 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d056b429-abe9-4fc2-98a1-87ca7a21c014 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:09.904781 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 862/1737] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 20 22:24:09 2022] POST /identity/v3/users => generated 282 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:24:09.906188 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d056b429-abe9-4fc2-98a1-87ca7a21c014 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:09.909012 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-d056b429-abe9-4fc2-98a1-87ca7a21c014 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:09.929669 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d056b429-abe9-4fc2-98a1-87ca7a21c014 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:09.939836 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd1799b-1e60-4c93-bcad-8f9936437366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:09.941143 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd1799b-1e60-4c93-bcad-8f9936437366 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:09.942405 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd1799b-1e60-4c93-bcad-8f9936437366 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:09.943087 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd1799b-1e60-4c93-bcad-8f9936437366 admin admin] PATH_INFO: `/v3/users/8bf4562f75034fb39a281fb5cfa04a62` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:09.945874 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd1799b-1e60-4c93-bcad-8f9936437366 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bf4562f75034fb39a281fb5cfa04a62)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:09.949615 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd1799b-1e60-4c93-bcad-8f9936437366 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:09.962738 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fcc6fe-f646-448f-9e11-a69825dc3bc4 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:09.974946 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a815d5b-85cc-44a5-aeea-613b68b2bdcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:09.975781 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a815d5b-85cc-44a5-aeea-613b68b2bdcd admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:09.976173 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a815d5b-85cc-44a5-aeea-613b68b2bdcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:09.976540 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a815d5b-85cc-44a5-aeea-613b68b2bdcd admin admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:09.977298 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a815d5b-85cc-44a5-aeea-613b68b2bdcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:09.981625 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a815d5b-85cc-44a5-aeea-613b68b2bdcd admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:10.007594 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 876/1738] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:24:09 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:24:10.008700 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a815d5b-85cc-44a5-aeea-613b68b2bdcd admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:10.011247 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-0a815d5b-85cc-44a5-aeea-613b68b2bdcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:10.061412 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-8bd1799b-1e60-4c93-bcad-8f9936437366 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bf4562f75034fb39a281fb5cfa04a62'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:10.082099 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-8bd1799b-1e60-4c93-bcad-8f9936437366 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bf4562f75034fb39a281fb5cfa04a62'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:10.083251 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-8bd1799b-1e60-4c93-bcad-8f9936437366 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bf4562f75034fb39a281fb5cfa04a62'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:10.084262 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-8bd1799b-1e60-4c93-bcad-8f9936437366 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bf4562f75034fb39a281fb5cfa04a62'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:10.103530 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-8bd1799b-1e60-4c93-bcad-8f9936437366 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bf4562f75034fb39a281fb5cfa04a62'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:10.140713 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 863/1739] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 20 22:24:09 2022] DELETE /identity/v3/users/8bf4562f75034fb39a281fb5cfa04a62 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:24:10.141968 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd1799b-1e60-4c93-bcad-8f9936437366 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:10.143773 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-8bd1799b-1e60-4c93-bcad-8f9936437366 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:10.171171 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a815d5b-85cc-44a5-aeea-613b68b2bdcd admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:10.315351 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c61fd29-ebc4-4018-88a8-5db1c4845286 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b0b3ca4ecd41aaba9cf8e0f91fbf54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:10.316967 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c61fd29-ebc4-4018-88a8-5db1c4845286 service neutron] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:10.317086 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:10.317433 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c61fd29-ebc4-4018-88a8-5db1c4845286 service neutron] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:10.325588 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c61fd29-ebc4-4018-88a8-5db1c4845286 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:10.327999 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd1799b-1e60-4c93-bcad-8f9936437366 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:10.339160 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-1c61fd29-ebc4-4018-88a8-5db1c4845286 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:10.346876 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afcc7ea-f2a4-40de-9e3b-e2f489eb402b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:10.348724 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afcc7ea-f2a4-40de-9e3b-e2f489eb402b admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:10.348724 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afcc7ea-f2a4-40de-9e3b-e2f489eb402b admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:10.348724 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afcc7ea-f2a4-40de-9e3b-e2f489eb402b admin admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:10.348724 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afcc7ea-f2a4-40de-9e3b-e2f489eb402b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:10.350757 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afcc7ea-f2a4-40de-9e3b-e2f489eb402b admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:10.388397 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:10.395115 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c61fd29-ebc4-4018-88a8-5db1c4845286 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:10.398853 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 864/1740] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:24:10 2022] GET /identity/v3/roles => generated 1420 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:24:10.405627 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becca192-cca3-4d8e-bb35-1333ff70f420 None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:10.411405 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c61fd29-ebc4-4018-88a8-5db1c4845286 service neutron] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:10.422777 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becca192-cca3-4d8e-bb35-1333ff70f420 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:10.424564 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becca192-cca3-4d8e-bb35-1333ff70f420 None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:10.438756 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 865/1741] 10.222.0.33 () {54 vars in 912 bytes} [Tue Sep 20 22:24:10 2022] GET /identity => generated 270 bytes in 39 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:24:10.440151 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becca192-cca3-4d8e-bb35-1333ff70f420 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:10.443277 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 877/1742] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:24:10 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:24:10.444374 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c61fd29-ebc4-4018-88a8-5db1c4845286 service neutron] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:10.457110 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-becca192-cca3-4d8e-bb35-1333ff70f420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:10.477928 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c61fd29-ebc4-4018-88a8-5db1c4845286 service neutron] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:10.494178 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4308575-b1d9-4b69-971e-c271d2807869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:10.496852 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4308575-b1d9-4b69-971e-c271d2807869 admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:10.496852 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4308575-b1d9-4b69-971e-c271d2807869 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:10.496852 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4308575-b1d9-4b69-971e-c271d2807869 admin admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:10.497131 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4308575-b1d9-4b69-971e-c271d2807869 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:10.498881 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4308575-b1d9-4b69-971e-c271d2807869 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:10.515082 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becca192-cca3-4d8e-bb35-1333ff70f420 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:10.527657 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d65bdde-17c1-450e-ba70-ded1fec44c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:10.538735 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 878/1743] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:24:10 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:24:10.544895 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d65bdde-17c1-450e-ba70-ded1fec44c03 admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:10.545452 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d65bdde-17c1-450e-ba70-ded1fec44c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:10.546301 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d65bdde-17c1-450e-ba70-ded1fec44c03 admin admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:10.549586 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d65bdde-17c1-450e-ba70-ded1fec44c03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:10.549829 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53797eac-ccc1-46d8-be34-5dbc71b2b5ec None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:10.550081 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53797eac-ccc1-46d8-be34-5dbc71b2b5ec None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:10.553151 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53797eac-ccc1-46d8-be34-5dbc71b2b5ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:10.555929 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d65bdde-17c1-450e-ba70-ded1fec44c03 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:10.588384 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 866/1744] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:24:10 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:24:10.591788 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d65bdde-17c1-450e-ba70-ded1fec44c03 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:10.601317 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-53797eac-ccc1-46d8-be34-5dbc71b2b5ec None None] MFA Rules not processed for user `e9b0b3ca4ecd41aaba9cf8e0f91fbf54`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:24:10.604405 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-53797eac-ccc1-46d8-be34-5dbc71b2b5ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:10.622840 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d65bdde-17c1-450e-ba70-ded1fec44c03 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:10.624048 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 879/1745] 10.222.0.33 () {58 vars in 1009 bytes} [Tue Sep 20 22:24:10 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:24:10.624750 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53797eac-ccc1-46d8-be34-5dbc71b2b5ec None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:10.639386 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a479e36d-e1d2-409b-bee4-17f81c81eae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:10.640433 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a479e36d-e1d2-409b-bee4-17f81c81eae9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:10.641442 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a479e36d-e1d2-409b-bee4-17f81c81eae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:10.642080 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a479e36d-e1d2-409b-bee4-17f81c81eae9 admin admin] PATH_INFO: `/v3/projects/21920814936144e8a2cd29e42abd1489/users/a46d974e8cff47eabdb624835a31e873/roles/604444e7ad0d437dbd1f5a6e02b761f5` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:10.651202 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53797eac-ccc1-46d8-be34-5dbc71b2b5ec None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:10.664221 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf6b191-efe3-4286-915a-7a5d44c7f8ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:10.664984 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf6b191-efe3-4286-915a-7a5d44c7f8ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:10.665270 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf6b191-efe3-4286-915a-7a5d44c7f8ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:10.665615 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf6b191-efe3-4286-915a-7a5d44c7f8ef admin admin] PATH_INFO: `/v3/projects/08f22a77b5ac4a408164b8b07431e188/users/e7d68f5888a34192bfff43d2e5c2c65e/roles/604444e7ad0d437dbd1f5a6e02b761f5` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:10.685234 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a479e36d-e1d2-409b-bee4-17f81c81eae9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21920814936144e8a2cd29e42abd1489, user_id=a46d974e8cff47eabdb624835a31e873, role_id=604444e7ad0d437dbd1f5a6e02b761f5)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:10.692038 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a479e36d-e1d2-409b-bee4-17f81c81eae9 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:10.708718 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf6b191-efe3-4286-915a-7a5d44c7f8ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=08f22a77b5ac4a408164b8b07431e188, user_id=e7d68f5888a34192bfff43d2e5c2c65e, role_id=604444e7ad0d437dbd1f5a6e02b761f5)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:10.711189 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf6b191-efe3-4286-915a-7a5d44c7f8ef admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:10.738065 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 880/1746] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:24:10 2022] PUT /identity/v3/projects/08f22a77b5ac4a408164b8b07431e188/users/e7d68f5888a34192bfff43d2e5c2c65e/roles/604444e7ad0d437dbd1f5a6e02b761f5 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:24:10.758148 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 867/1747] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:24:10 2022] PUT /identity/v3/projects/21920814936144e8a2cd29e42abd1489/users/a46d974e8cff47eabdb624835a31e873/roles/604444e7ad0d437dbd1f5a6e02b761f5 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:24:10.758148 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d85e84a-04cf-4610-8456-f65a6e5d5008 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:10.758148 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d85e84a-04cf-4610-8456-f65a6e5d5008 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:10.758148 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d85e84a-04cf-4610-8456-f65a6e5d5008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:10.758598 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf6b191-efe3-4286-915a-7a5d44c7f8ef admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:10.760463 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-ddf6b191-efe3-4286-915a-7a5d44c7f8ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:10.834938 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-4d85e84a-04cf-4610-8456-f65a6e5d5008 None None] MFA Rules not processed for user `e7d68f5888a34192bfff43d2e5c2c65e`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:24:10.838500 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-4d85e84a-04cf-4610-8456-f65a6e5d5008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:10.923055 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf6b191-efe3-4286-915a-7a5d44c7f8ef admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:11.034241 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08281ee1-a6ae-4ad2-b0a2-6ae44e89b72f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b0b3ca4ecd41aaba9cf8e0f91fbf54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:11.034909 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08281ee1-a6ae-4ad2-b0a2-6ae44e89b72f service neutron] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:11.035333 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08281ee1-a6ae-4ad2-b0a2-6ae44e89b72f service neutron] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:11.035614 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08281ee1-a6ae-4ad2-b0a2-6ae44e89b72f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:11.042302 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 868/1748] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:24:10 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:24:11.044011 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c9025-59f1-410d-bfe2-b6cfd88776bb None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:11.044484 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c9025-59f1-410d-bfe2-b6cfd88776bb None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:11.044875 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c9025-59f1-410d-bfe2-b6cfd88776bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:11.059306 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08281ee1-a6ae-4ad2-b0a2-6ae44e89b72f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:11.060768 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08281ee1-a6ae-4ad2-b0a2-6ae44e89b72f service neutron] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:11.080101 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 881/1749] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:24:10 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:24:11.081072 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08281ee1-a6ae-4ad2-b0a2-6ae44e89b72f service neutron] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:11.084305 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-08281ee1-a6ae-4ad2-b0a2-6ae44e89b72f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:11.095569 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-cf7c9025-59f1-410d-bfe2-b6cfd88776bb None None] MFA Rules not processed for user `a46d974e8cff47eabdb624835a31e873`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:24:11.097277 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-cf7c9025-59f1-410d-bfe2-b6cfd88776bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:11.216790 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 869/1750] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:24:11 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:24:11.216790 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7c9025-59f1-410d-bfe2-b6cfd88776bb None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:11.229300 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7c9025-59f1-410d-bfe2-b6cfd88776bb None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:11.235040 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6d9642-213b-4a93-9703-a6de091379fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:11.235798 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d9642-213b-4a93-9703-a6de091379fd admin admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:11.236193 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d9642-213b-4a93-9703-a6de091379fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:11.236695 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d9642-213b-4a93-9703-a6de091379fd admin admin] PATH_INFO: `/v3/projects` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:11.237564 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6d9642-213b-4a93-9703-a6de091379fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:11.238762 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08281ee1-a6ae-4ad2-b0a2-6ae44e89b72f service neutron] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:11.240077 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6d9642-213b-4a93-9703-a6de091379fd admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:11.255048 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda09448-1455-46af-b62a-7d3ae1bfacb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:11.255716 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda09448-1455-46af-b62a-7d3ae1bfacb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:11.256000 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda09448-1455-46af-b62a-7d3ae1bfacb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:11.256279 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda09448-1455-46af-b62a-7d3ae1bfacb4 admin admin] PATH_INFO: `/v3/projects/6d69d1e80f9b4ed0941706d458fd4727` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:11.257473 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda09448-1455-46af-b62a-7d3ae1bfacb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d69d1e80f9b4ed0941706d458fd4727)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:11.260216 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda09448-1455-46af-b62a-7d3ae1bfacb4 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:11.300679 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:11.307284 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 870/1751] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 20 22:24:11 2022] POST /identity/v3/projects => generated 387 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:24:11.309490 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6d9642-213b-4a93-9703-a6de091379fd admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:11.416205 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:11.422591 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-cda09448-1455-46af-b62a-7d3ae1bfacb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d69d1e80f9b4ed0941706d458fd4727', 'request_id': 'req-cda09448-1455-46af-b62a-7d3ae1bfacb4'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:11.432582 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-cda09448-1455-46af-b62a-7d3ae1bfacb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d69d1e80f9b4ed0941706d458fd4727', 'request_id': 'req-cda09448-1455-46af-b62a-7d3ae1bfacb4'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:11.459542 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-cda09448-1455-46af-b62a-7d3ae1bfacb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d69d1e80f9b4ed0941706d458fd4727', 'request_id': 'req-cda09448-1455-46af-b62a-7d3ae1bfacb4'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:11.492326 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-cda09448-1455-46af-b62a-7d3ae1bfacb4 admin admin] The token cache is being invalidate because project 6d69d1e80f9b4ed0941706d458fd4727 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81306) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 22:24:11.493564 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-cda09448-1455-46af-b62a-7d3ae1bfacb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:11.494309 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-cda09448-1455-46af-b62a-7d3ae1bfacb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:11.496441 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 882/1752] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 20 22:24:11 2022] DELETE /identity/v3/projects/6d69d1e80f9b4ed0941706d458fd4727 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:24:11.498913 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda09448-1455-46af-b62a-7d3ae1bfacb4 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:11.504683 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-cda09448-1455-46af-b62a-7d3ae1bfacb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:11.534796 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6d9642-213b-4a93-9703-a6de091379fd admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:11.687143 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda09448-1455-46af-b62a-7d3ae1bfacb4 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:11.721537 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271e6abf-e892-4635-af00-87e2148c6a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:11.723245 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e6abf-e892-4635-af00-87e2148c6a2e admin admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:11.725664 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e6abf-e892-4635-af00-87e2148c6a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:11.725953 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e6abf-e892-4635-af00-87e2148c6a2e admin admin] PATH_INFO: `/v3/users` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:11.726710 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271e6abf-e892-4635-af00-87e2148c6a2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:11.735638 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271e6abf-e892-4635-af00-87e2148c6a2e admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:11.742972 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7616a0a0-1a8a-45a1-93b7-ba46e303f9ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:11.748258 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7616a0a0-1a8a-45a1-93b7-ba46e303f9ca admin admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:11.748559 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7616a0a0-1a8a-45a1-93b7-ba46e303f9ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:11.748840 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7616a0a0-1a8a-45a1-93b7-ba46e303f9ca admin admin] PATH_INFO: `/v3/projects` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:11.749515 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7616a0a0-1a8a-45a1-93b7-ba46e303f9ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:11.756793 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7616a0a0-1a8a-45a1-93b7-ba46e303f9ca admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:11.807230 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 883/1753] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 20 22:24:11 2022] POST /identity/v3/users => generated 300 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:24:11.810207 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e0239f-807c-4f49-853f-4a748b12118b None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:11.810660 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e0239f-807c-4f49-853f-4a748b12118b None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:11.812693 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e0239f-807c-4f49-853f-4a748b12118b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:11.832164 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 871/1754] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 20 22:24:11 2022] POST /identity/v3/projects => generated 363 bytes in 524 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:24:11.833140 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7616a0a0-1a8a-45a1-93b7-ba46e303f9ca admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:11.896980 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-a6e0239f-807c-4f49-853f-4a748b12118b None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:24:11.903696 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-a6e0239f-807c-4f49-853f-4a748b12118b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:11.977373 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7616a0a0-1a8a-45a1-93b7-ba46e303f9ca admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:11.982662 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c97f1a1-0c7e-4f5c-a02b-a9ab8064acdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:11.983280 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c97f1a1-0c7e-4f5c-a02b-a9ab8064acdc admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:11.983607 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c97f1a1-0c7e-4f5c-a02b-a9ab8064acdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:11.983832 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c97f1a1-0c7e-4f5c-a02b-a9ab8064acdc admin admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:11.984492 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c97f1a1-0c7e-4f5c-a02b-a9ab8064acdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:11.986540 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c97f1a1-0c7e-4f5c-a02b-a9ab8064acdc admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:12.005499 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 872/1755] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:24:11 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:24:12.005499 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c97f1a1-0c7e-4f5c-a02b-a9ab8064acdc admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:12.007596 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-0c97f1a1-0c7e-4f5c-a02b-a9ab8064acdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:12.075713 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c97f1a1-0c7e-4f5c-a02b-a9ab8064acdc admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:12.075892 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 884/1756] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:24:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:24:12.075892 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e0239f-807c-4f49-853f-4a748b12118b None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:12.076240 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-a6e0239f-807c-4f49-853f-4a748b12118b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:12.083592 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892e8194-d3c6-4573-95ef-0b1e526ab7dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:12.084630 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892e8194-d3c6-4573-95ef-0b1e526ab7dd admin admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:12.085059 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892e8194-d3c6-4573-95ef-0b1e526ab7dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:12.086229 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892e8194-d3c6-4573-95ef-0b1e526ab7dd admin admin] PATH_INFO: `/v3/users` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:12.088048 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892e8194-d3c6-4573-95ef-0b1e526ab7dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:12.091284 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892e8194-d3c6-4573-95ef-0b1e526ab7dd admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:12.135945 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 873/1757] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 20 22:24:12 2022] POST /identity/v3/users => generated 288 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:24:12.142093 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892e8194-d3c6-4573-95ef-0b1e526ab7dd admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:12.164228 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892e8194-d3c6-4573-95ef-0b1e526ab7dd admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:12.179604 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bee5855-6ec2-4c28-a518-f0ca5d95287c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:12.180735 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee5855-6ec2-4c28-a518-f0ca5d95287c admin admin] REQUEST_METHOD: `PUT` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:12.181191 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee5855-6ec2-4c28-a518-f0ca5d95287c admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:12.182911 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee5855-6ec2-4c28-a518-f0ca5d95287c admin admin] PATH_INFO: `/v3/projects/6448b5fce3a24ec2a4a47682d6e91c21/users/52ecb4df06ca44d18ee6f17d818a35c9/roles/8a829170b29d42d6af589399e51edb0f` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:12.203340 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:12.219378 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bee5855-6ec2-4c28-a518-f0ca5d95287c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6448b5fce3a24ec2a4a47682d6e91c21, user_id=52ecb4df06ca44d18ee6f17d818a35c9, role_id=8a829170b29d42d6af589399e51edb0f)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:12.224161 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bee5855-6ec2-4c28-a518-f0ca5d95287c admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:12.259655 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 874/1758] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:24:12 2022] PUT /identity/v3/projects/6448b5fce3a24ec2a4a47682d6e91c21/users/52ecb4df06ca44d18ee6f17d818a35c9/roles/8a829170b29d42d6af589399e51edb0f => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:24:12.261373 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50f236e-0fc4-4aa2-8a7d-74a7ff872735 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:12.263241 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50f236e-0fc4-4aa2-8a7d-74a7ff872735 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:12.263438 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50f236e-0fc4-4aa2-8a7d-74a7ff872735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:12.280391 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:12.334619 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e0239f-807c-4f49-853f-4a748b12118b None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:12.345489 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-a50f236e-0fc4-4aa2-8a7d-74a7ff872735 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:24:12.345489 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-a50f236e-0fc4-4aa2-8a7d-74a7ff872735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:12.428044 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d7eef0-88d6-4c85-ae95-e9ff5332f2ae service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c79676ee86294dab92ba732e38d6fa74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:12.428994 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d7eef0-88d6-4c85-ae95-e9ff5332f2ae service placement] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:12.429703 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d7eef0-88d6-4c85-ae95-e9ff5332f2ae service placement] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:12.429993 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d7eef0-88d6-4c85-ae95-e9ff5332f2ae service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:12.432674 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-45d7eef0-88d6-4c85-ae95-e9ff5332f2ae service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:12.450646 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d7eef0-88d6-4c85-ae95-e9ff5332f2ae service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:12.453258 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d7eef0-88d6-4c85-ae95-e9ff5332f2ae service placement] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:12.480998 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 885/1759] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:24:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:24:12.485213 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d7eef0-88d6-4c85-ae95-e9ff5332f2ae service placement] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:12.511072 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 875/1760] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:24:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:24:12.512471 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db421725-014a-42d0-a00c-5cda9c589030 None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:12.512769 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db421725-014a-42d0-a00c-5cda9c589030 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:12.513039 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db421725-014a-42d0-a00c-5cda9c589030 None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:12.517109 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 876/1761] 10.222.0.33 () {54 vars in 961 bytes} [Tue Sep 20 22:24:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:24:12.517912 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db421725-014a-42d0-a00c-5cda9c589030 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:12.543631 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db421725-014a-42d0-a00c-5cda9c589030 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:12.550213 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44cbf5d-ac30-40d0-9b05-3a3611f5273e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:12.551035 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44cbf5d-ac30-40d0-9b05-3a3611f5273e admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:12.551314 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44cbf5d-ac30-40d0-9b05-3a3611f5273e admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:12.551605 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44cbf5d-ac30-40d0-9b05-3a3611f5273e admin admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:12.552224 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44cbf5d-ac30-40d0-9b05-3a3611f5273e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:12.553834 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44cbf5d-ac30-40d0-9b05-3a3611f5273e admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:12.574494 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 877/1762] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:24:12 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:24:12.578264 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a3a94a-3213-4743-a030-be575b9bd3fb None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:12.578610 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a3a94a-3213-4743-a030-be575b9bd3fb None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:12.578888 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a3a94a-3213-4743-a030-be575b9bd3fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:12.617557 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-42a3a94a-3213-4743-a030-be575b9bd3fb None None] MFA Rules not processed for user `fb0b83edd8754e659729e05787f3bf4d`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:24:12.618808 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-42a3a94a-3213-4743-a030-be575b9bd3fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:12.650206 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d7eef0-88d6-4c85-ae95-e9ff5332f2ae service placement] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:12.671598 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85ce34a-c5e2-44c1-bc4d-0ca11eb901c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:12.672436 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ce34a-c5e2-44c1-bc4d-0ca11eb901c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:12.672783 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ce34a-c5e2-44c1-bc4d-0ca11eb901c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:12.673179 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ce34a-c5e2-44c1-bc4d-0ca11eb901c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:12.673902 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85ce34a-c5e2-44c1-bc4d-0ca11eb901c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:12.678632 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85ce34a-c5e2-44c1-bc4d-0ca11eb901c7 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:12.702999 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 886/1763] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:24:12 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:24:12.705580 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85ce34a-c5e2-44c1-bc4d-0ca11eb901c7 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:12.732624 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85ce34a-c5e2-44c1-bc4d-0ca11eb901c7 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:12.768889 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252e1961-9937-48f1-a3af-45c881e02b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:12.769847 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e1961-9937-48f1-a3af-45c881e02b16 admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:12.770382 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e1961-9937-48f1-a3af-45c881e02b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:12.770782 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e1961-9937-48f1-a3af-45c881e02b16 admin admin] PATH_INFO: `/v3/domains` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:12.771959 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252e1961-9937-48f1-a3af-45c881e02b16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:24:12.772374 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252e1961-9937-48f1-a3af-45c881e02b16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:12.775876 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252e1961-9937-48f1-a3af-45c881e02b16 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:12.808852 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 878/1764] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:24:12 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:24:12.810453 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d57cd-9414-43f9-a699-236d64b83cc1 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:12.810725 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d57cd-9414-43f9-a699-236d64b83cc1 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:12.811054 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d57cd-9414-43f9-a699-236d64b83cc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:12.828845 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 887/1765] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 20 22:24:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:24:12.831323 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252e1961-9937-48f1-a3af-45c881e02b16 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:12.860854 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252e1961-9937-48f1-a3af-45c881e02b16 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:12.885370 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-674d57cd-9414-43f9-a699-236d64b83cc1 None None] MFA Rules not processed for user `c79676ee86294dab92ba732e38d6fa74`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:24:12.885532 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550f3c59-6906-4cde-b014-e3d0444db74e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:12.886457 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550f3c59-6906-4cde-b014-e3d0444db74e admin admin] REQUEST_METHOD: `PUT` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:12.887275 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550f3c59-6906-4cde-b014-e3d0444db74e admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:12.887275 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550f3c59-6906-4cde-b014-e3d0444db74e admin admin] PATH_INFO: `/v3/projects/6448b5fce3a24ec2a4a47682d6e91c21/users/52ecb4df06ca44d18ee6f17d818a35c9/roles/8a829170b29d42d6af589399e51edb0f` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:12.890279 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-674d57cd-9414-43f9-a699-236d64b83cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:12.893100 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550f3c59-6906-4cde-b014-e3d0444db74e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6448b5fce3a24ec2a4a47682d6e91c21, user_id=52ecb4df06ca44d18ee6f17d818a35c9, role_id=8a829170b29d42d6af589399e51edb0f)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:12.908445 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550f3c59-6906-4cde-b014-e3d0444db74e admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:12.921150 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 879/1766] 10.222.0.33 () {58 vars in 1058 bytes} [Tue Sep 20 22:24:12 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:24:12.922951 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674d57cd-9414-43f9-a699-236d64b83cc1 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:12.936514 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 888/1767] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:24:12 2022] PUT /identity/v3/projects/6448b5fce3a24ec2a4a47682d6e91c21/users/52ecb4df06ca44d18ee6f17d818a35c9/roles/8a829170b29d42d6af589399e51edb0f => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:24:12.937495 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550f3c59-6906-4cde-b014-e3d0444db74e admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:12.986741 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674d57cd-9414-43f9-a699-236d64b83cc1 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:13.054251 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:13.131123 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc52a3c0-a64c-4072-986f-84ad6ae884e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:13.132297 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc52a3c0-a64c-4072-986f-84ad6ae884e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:13.133538 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc52a3c0-a64c-4072-986f-84ad6ae884e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:13.133538 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc52a3c0-a64c-4072-986f-84ad6ae884e3 admin admin] PATH_INFO: `/v3/projects/e7a86533cf8e4ebd8fbea060c3f3e39a/users/ed28acc69d8c412a81e0050e0607773d/roles/8a829170b29d42d6af589399e51edb0f` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:13.152984 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550f3c59-6906-4cde-b014-e3d0444db74e admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:13.169992 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362a08a4-bc95-4e9c-bac0-b1c69d6fbea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:13.170670 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362a08a4-bc95-4e9c-bac0-b1c69d6fbea8 admin admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:13.171198 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362a08a4-bc95-4e9c-bac0-b1c69d6fbea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:13.171469 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362a08a4-bc95-4e9c-bac0-b1c69d6fbea8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:13.173426 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362a08a4-bc95-4e9c-bac0-b1c69d6fbea8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:13.175540 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362a08a4-bc95-4e9c-bac0-b1c69d6fbea8 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:13.182964 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc52a3c0-a64c-4072-986f-84ad6ae884e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7a86533cf8e4ebd8fbea060c3f3e39a, user_id=ed28acc69d8c412a81e0050e0607773d, role_id=8a829170b29d42d6af589399e51edb0f)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:13.189009 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc52a3c0-a64c-4072-986f-84ad6ae884e3 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:13.222820 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 880/1768] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:24:12 2022] PUT /identity/v3/projects/e7a86533cf8e4ebd8fbea060c3f3e39a/users/ed28acc69d8c412a81e0050e0607773d/roles/8a829170b29d42d6af589399e51edb0f => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:24:13.223736 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc52a3c0-a64c-4072-986f-84ad6ae884e3 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:13.242466 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 889/1769] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 20 22:24:12 2022] POST /identity/v3/projects => generated 375 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:24:13.248764 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f041d3a8-84ba-4056-808e-1a7e60febe2c None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:13.250688 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f041d3a8-84ba-4056-808e-1a7e60febe2c None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:13.251283 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f041d3a8-84ba-4056-808e-1a7e60febe2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:13.277961 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:13.363358 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-f041d3a8-84ba-4056-808e-1a7e60febe2c None None] MFA Rules not processed for user `52ecb4df06ca44d18ee6f17d818a35c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:24:13.364600 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-f041d3a8-84ba-4056-808e-1a7e60febe2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:13.490760 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc52a3c0-a64c-4072-986f-84ad6ae884e3 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:13.650036 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 890/1770] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:24:13 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 403 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:24:13.654198 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b54e8a-fcd9-4b04-a649-834e48d87a0f None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:13.654198 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b54e8a-fcd9-4b04-a649-834e48d87a0f None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:13.654198 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b54e8a-fcd9-4b04-a649-834e48d87a0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:13.722557 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-01b54e8a-fcd9-4b04-a649-834e48d87a0f None None] MFA Rules not processed for user `3eed1b62f00a4dbc98524c44147c3b72`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:24:13.724281 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-01b54e8a-fcd9-4b04-a649-834e48d87a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:13.761978 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c19a6d4-1fa1-446d-9760-95b2ada873de service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c79676ee86294dab92ba732e38d6fa74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:13.762645 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c19a6d4-1fa1-446d-9760-95b2ada873de service placement] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:13.768682 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c19a6d4-1fa1-446d-9760-95b2ada873de service placement] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:13.769013 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c19a6d4-1fa1-446d-9760-95b2ada873de service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:13.795467 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c19a6d4-1fa1-446d-9760-95b2ada873de service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:13.798101 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c19a6d4-1fa1-446d-9760-95b2ada873de service placement] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:13.823319 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 891/1771] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:24:13 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:24:13.825261 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b54e8a-fcd9-4b04-a649-834e48d87a0f None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:13.839280 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 881/1772] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:24:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 615 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:24:13.840378 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c19a6d4-1fa1-446d-9760-95b2ada873de service placement] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:13.927687 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:14.001613 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c19a6d4-1fa1-446d-9760-95b2ada873de service placement] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:14.005165 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b54e8a-fcd9-4b04-a649-834e48d87a0f None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:14.012396 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f480239e-6336-413f-a0e1-68f26a2b08d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:14.013026 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f480239e-6336-413f-a0e1-68f26a2b08d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:14.013424 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f480239e-6336-413f-a0e1-68f26a2b08d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:14.013568 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f480239e-6336-413f-a0e1-68f26a2b08d1 admin admin] PATH_INFO: `/v3/users` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:14.014235 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f480239e-6336-413f-a0e1-68f26a2b08d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:14.016510 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f480239e-6336-413f-a0e1-68f26a2b08d1 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:14.022992 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9891af6-2fe5-4eb0-8f02-340798f86a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:14.023634 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9891af6-2fe5-4eb0-8f02-340798f86a0d admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:14.023915 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9891af6-2fe5-4eb0-8f02-340798f86a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:14.024191 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9891af6-2fe5-4eb0-8f02-340798f86a0d admin admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:14.024844 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9891af6-2fe5-4eb0-8f02-340798f86a0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:14.031189 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9891af6-2fe5-4eb0-8f02-340798f86a0d admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:14.050869 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 892/1773] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:24:13 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:24:14.051778 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9891af6-2fe5-4eb0-8f02-340798f86a0d admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:14.057157 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-b9891af6-2fe5-4eb0-8f02-340798f86a0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:14.087205 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 882/1774] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 20 22:24:13 2022] POST /identity/v3/users => generated 288 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:24:14.087981 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f480239e-6336-413f-a0e1-68f26a2b08d1 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:14.134538 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f480239e-6336-413f-a0e1-68f26a2b08d1 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:14.154764 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b30e3c-285e-494b-b57c-c6cd26b8be67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:14.156767 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b30e3c-285e-494b-b57c-c6cd26b8be67 admin admin] REQUEST_METHOD: `PUT` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:14.157800 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b30e3c-285e-494b-b57c-c6cd26b8be67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:14.159549 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b30e3c-285e-494b-b57c-c6cd26b8be67 admin admin] PATH_INFO: `/v3/projects/e7a86533cf8e4ebd8fbea060c3f3e39a/users/ed28acc69d8c412a81e0050e0607773d/roles/8a829170b29d42d6af589399e51edb0f` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:14.163771 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b30e3c-285e-494b-b57c-c6cd26b8be67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7a86533cf8e4ebd8fbea060c3f3e39a, user_id=ed28acc69d8c412a81e0050e0607773d, role_id=8a829170b29d42d6af589399e51edb0f)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:14.176545 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b30e3c-285e-494b-b57c-c6cd26b8be67 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:14.231214 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 883/1775] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:24:14 2022] PUT /identity/v3/projects/e7a86533cf8e4ebd8fbea060c3f3e39a/users/ed28acc69d8c412a81e0050e0607773d/roles/8a829170b29d42d6af589399e51edb0f => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:24:14.232329 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b30e3c-285e-494b-b57c-c6cd26b8be67 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:14.267580 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9891af6-2fe5-4eb0-8f02-340798f86a0d admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:14.311775 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:14.379010 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b30e3c-285e-494b-b57c-c6cd26b8be67 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:14.406631 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a31bedd-0268-4a18-af21-41c6e9106686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:14.408521 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a31bedd-0268-4a18-af21-41c6e9106686 admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:14.408812 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a31bedd-0268-4a18-af21-41c6e9106686 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:14.412078 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a31bedd-0268-4a18-af21-41c6e9106686 admin admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:14.412813 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a31bedd-0268-4a18-af21-41c6e9106686 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:14.414478 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a31bedd-0268-4a18-af21-41c6e9106686 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:14.471154 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 884/1776] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:24:14 2022] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:24:14.475411 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e137b68-c83a-4bdd-9a32-7cd6b4eb6f78 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:14.476930 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e137b68-c83a-4bdd-9a32-7cd6b4eb6f78 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:14.476930 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e137b68-c83a-4bdd-9a32-7cd6b4eb6f78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:14.496297 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6edd409-8e17-4775-b6a1-a12e44f3210e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577c8b14c1f4279beac13b9ba11aba1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:14.496934 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6edd409-8e17-4775-b6a1-a12e44f3210e service cinder] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:14.497217 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6edd409-8e17-4775-b6a1-a12e44f3210e service cinder] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:14.497558 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6edd409-8e17-4775-b6a1-a12e44f3210e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:14.548297 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-7e137b68-c83a-4bdd-9a32-7cd6b4eb6f78 None None] MFA Rules not processed for user `ed28acc69d8c412a81e0050e0607773d`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:24:14.549661 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-7e137b68-c83a-4bdd-9a32-7cd6b4eb6f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:14.689108 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6edd409-8e17-4775-b6a1-a12e44f3210e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:14.693692 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6edd409-8e17-4775-b6a1-a12e44f3210e service cinder] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:14.718530 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 885/1777] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:24:14 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:24:14.719841 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e137b68-c83a-4bdd-9a32-7cd6b4eb6f78 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:14.734690 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 893/1778] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:24:14 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 683 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:24:14.735799 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6edd409-8e17-4775-b6a1-a12e44f3210e service cinder] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:14.742286 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-a6edd409-8e17-4775-b6a1-a12e44f3210e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:14.759608 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e137b68-c83a-4bdd-9a32-7cd6b4eb6f78 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:14.772975 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7312a9c1-15d3-4f1c-8313-065a70522419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:14.773650 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6edd409-8e17-4775-b6a1-a12e44f3210e service cinder] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:14.773942 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7312a9c1-15d3-4f1c-8313-065a70522419 admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:14.774830 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7312a9c1-15d3-4f1c-8313-065a70522419 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:14.774987 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7312a9c1-15d3-4f1c-8313-065a70522419 admin admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:14.775786 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7312a9c1-15d3-4f1c-8313-065a70522419 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:14.784743 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f670fab3-0378-4980-bbbf-df14948fefcb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577c8b14c1f4279beac13b9ba11aba1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:14.786241 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7312a9c1-15d3-4f1c-8313-065a70522419 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:14.786831 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f670fab3-0378-4980-bbbf-df14948fefcb service cinder] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:14.787356 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f670fab3-0378-4980-bbbf-df14948fefcb service cinder] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:14.788149 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f670fab3-0378-4980-bbbf-df14948fefcb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:14.806678 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f670fab3-0378-4980-bbbf-df14948fefcb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:14.810483 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f670fab3-0378-4980-bbbf-df14948fefcb service cinder] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:14.827560 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 886/1779] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:24:14 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:24:14.829019 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7312a9c1-15d3-4f1c-8313-065a70522419 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:14.840892 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 894/1780] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:24:14 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:24:14.843234 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7312a9c1-15d3-4f1c-8313-065a70522419 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:14.848784 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad7295c-e3dd-4c8e-99aa-202c2f07ac61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:14.849519 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7295c-e3dd-4c8e-99aa-202c2f07ac61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:14.849894 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7295c-e3dd-4c8e-99aa-202c2f07ac61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:14.850358 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7295c-e3dd-4c8e-99aa-202c2f07ac61 admin admin] PATH_INFO: `/v3/users/e7d68f5888a34192bfff43d2e5c2c65e` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:14.852060 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad7295c-e3dd-4c8e-99aa-202c2f07ac61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7d68f5888a34192bfff43d2e5c2c65e)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:14.854827 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad7295c-e3dd-4c8e-99aa-202c2f07ac61 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:14.865504 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f670fab3-0378-4980-bbbf-df14948fefcb service cinder] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:14.910394 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f670fab3-0378-4980-bbbf-df14948fefcb service cinder] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:14.929459 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7be21a1-1cc2-4df2-a587-6ff6be6e438f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:14.930242 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7be21a1-1cc2-4df2-a587-6ff6be6e438f admin admin] REQUEST_METHOD: `PUT` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:14.930453 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7be21a1-1cc2-4df2-a587-6ff6be6e438f admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:14.930833 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7be21a1-1cc2-4df2-a587-6ff6be6e438f admin admin] PATH_INFO: `/v3/projects/0a120b3241894c53bd84a5fcd29e81df/users/75040f197fa84436bb0644fb52b8606e/roles/604444e7ad0d437dbd1f5a6e02b761f5` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:14.979423 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7be21a1-1cc2-4df2-a587-6ff6be6e438f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a120b3241894c53bd84a5fcd29e81df, user_id=75040f197fa84436bb0644fb52b8606e, role_id=604444e7ad0d437dbd1f5a6e02b761f5)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:14.984567 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-fad7295c-e3dd-4c8e-99aa-202c2f07ac61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7d68f5888a34192bfff43d2e5c2c65e'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:14.987104 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7be21a1-1cc2-4df2-a587-6ff6be6e438f admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:15.004191 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-fad7295c-e3dd-4c8e-99aa-202c2f07ac61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7d68f5888a34192bfff43d2e5c2c65e'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:15.004942 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-fad7295c-e3dd-4c8e-99aa-202c2f07ac61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7d68f5888a34192bfff43d2e5c2c65e'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:15.005992 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-fad7295c-e3dd-4c8e-99aa-202c2f07ac61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7d68f5888a34192bfff43d2e5c2c65e'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:15.035524 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-fad7295c-e3dd-4c8e-99aa-202c2f07ac61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7d68f5888a34192bfff43d2e5c2c65e'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:15.061794 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 895/1781] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:24:14 2022] PUT /identity/v3/projects/0a120b3241894c53bd84a5fcd29e81df/users/75040f197fa84436bb0644fb52b8606e/roles/604444e7ad0d437dbd1f5a6e02b761f5 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:24:15.061794 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7be21a1-1cc2-4df2-a587-6ff6be6e438f admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:15.061794 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-c7be21a1-1cc2-4df2-a587-6ff6be6e438f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:15.105579 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:15.141252 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 887/1782] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 20 22:24:14 2022] DELETE /identity/v3/users/e7d68f5888a34192bfff43d2e5c2c65e => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:24:15.147790 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272a9a5b-c091-4212-870e-edcd9859830e None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:15.149227 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272a9a5b-c091-4212-870e-edcd9859830e None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:15.149635 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272a9a5b-c091-4212-870e-edcd9859830e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:15.179363 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:15.215967 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7be21a1-1cc2-4df2-a587-6ff6be6e438f admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:15.257769 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-272a9a5b-c091-4212-870e-edcd9859830e None None] MFA Rules not processed for user `75040f197fa84436bb0644fb52b8606e`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:24:15.262081 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-272a9a5b-c091-4212-870e-edcd9859830e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:15.363318 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590ba858-8779-4a28-b888-470d1fd72d0a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577c8b14c1f4279beac13b9ba11aba1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:15.366416 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590ba858-8779-4a28-b888-470d1fd72d0a service cinder] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:15.366966 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590ba858-8779-4a28-b888-470d1fd72d0a service cinder] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:15.368135 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590ba858-8779-4a28-b888-470d1fd72d0a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:15.381645 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-590ba858-8779-4a28-b888-470d1fd72d0a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:15.505294 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 888/1783] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:24:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:24:15.508790 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20e78ab-4064-4c91-804a-d05608a02172 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:15.509659 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20e78ab-4064-4c91-804a-d05608a02172 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:15.510257 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20e78ab-4064-4c91-804a-d05608a02172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:15.566659 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-c20e78ab-4064-4c91-804a-d05608a02172 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:24:15.569695 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-c20e78ab-4064-4c91-804a-d05608a02172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:15.613010 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590ba858-8779-4a28-b888-470d1fd72d0a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:15.614466 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590ba858-8779-4a28-b888-470d1fd72d0a service cinder] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:15.637650 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 896/1784] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:24:15 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 585 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:24:15.642844 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590ba858-8779-4a28-b888-470d1fd72d0a service cinder] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:15.647265 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-590ba858-8779-4a28-b888-470d1fd72d0a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:15.751941 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 889/1785] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:24:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:24:15.764850 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20e78ab-4064-4c91-804a-d05608a02172 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:15.774363 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-c20e78ab-4064-4c91-804a-d05608a02172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:15.827690 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590ba858-8779-4a28-b888-470d1fd72d0a service cinder] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:15.843819 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7840fdd9-53f4-4e3d-affa-f73b2eaa8e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:15.847267 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7840fdd9-53f4-4e3d-affa-f73b2eaa8e46 admin admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:15.847763 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7840fdd9-53f4-4e3d-affa-f73b2eaa8e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:15.848062 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7840fdd9-53f4-4e3d-affa-f73b2eaa8e46 admin admin] PATH_INFO: `/v3/projects` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:15.848835 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7840fdd9-53f4-4e3d-affa-f73b2eaa8e46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:15.851266 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7840fdd9-53f4-4e3d-affa-f73b2eaa8e46 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:15.946951 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 897/1786] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 20 22:24:15 2022] POST /identity/v3/projects => generated 375 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:24:15.950692 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7840fdd9-53f4-4e3d-affa-f73b2eaa8e46 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:15.995163 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20e78ab-4064-4c91-804a-d05608a02172 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:15.995934 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:16.117156 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f6c92f-1c40-424d-8a90-383b26b03bad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b0b3ca4ecd41aaba9cf8e0f91fbf54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:16.118687 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f6c92f-1c40-424d-8a90-383b26b03bad service neutron] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:16.119270 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f6c92f-1c40-424d-8a90-383b26b03bad service neutron] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:16.120154 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f6c92f-1c40-424d-8a90-383b26b03bad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:16.133347 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:16.173293 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7840fdd9-53f4-4e3d-affa-f73b2eaa8e46 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:16.186054 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2af6b2-3bea-483b-8ae3-2eebb761fc7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:16.186810 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2af6b2-3bea-483b-8ae3-2eebb761fc7b admin admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:16.187159 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2af6b2-3bea-483b-8ae3-2eebb761fc7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:16.187440 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2af6b2-3bea-483b-8ae3-2eebb761fc7b admin admin] PATH_INFO: `/v3/users` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:16.188237 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2af6b2-3bea-483b-8ae3-2eebb761fc7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:16.190254 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2af6b2-3bea-483b-8ae3-2eebb761fc7b admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:16.275743 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 898/1787] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 20 22:24:15 2022] POST /identity/v3/users => generated 294 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:24:16.280093 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2af6b2-3bea-483b-8ae3-2eebb761fc7b admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:16.319448 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f6c92f-1c40-424d-8a90-383b26b03bad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:16.320870 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2af6b2-3bea-483b-8ae3-2eebb761fc7b admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:16.321007 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f6c92f-1c40-424d-8a90-383b26b03bad service neutron] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:16.332285 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90047d0d-9c0c-4ba5-b17b-008e2c48cf34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:16.333062 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90047d0d-9c0c-4ba5-b17b-008e2c48cf34 admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:16.333262 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90047d0d-9c0c-4ba5-b17b-008e2c48cf34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:16.333524 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90047d0d-9c0c-4ba5-b17b-008e2c48cf34 admin admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:16.339990 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90047d0d-9c0c-4ba5-b17b-008e2c48cf34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:16.341658 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90047d0d-9c0c-4ba5-b17b-008e2c48cf34 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:16.348795 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 890/1788] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:24:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 585 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 20 22:24:16.372376 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 899/1789] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:24:16 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 20 22:24:16.378569 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f6c92f-1c40-424d-8a90-383b26b03bad service neutron] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:16.429200 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f6c92f-1c40-424d-8a90-383b26b03bad service neutron] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:16.454729 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeba727b-e4e9-4f69-9c4f-f958d6a40f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:16.455415 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeba727b-e4e9-4f69-9c4f-f958d6a40f65 admin admin] REQUEST_METHOD: `PUT` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:16.455697 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeba727b-e4e9-4f69-9c4f-f958d6a40f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:16.455972 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeba727b-e4e9-4f69-9c4f-f958d6a40f65 admin admin] PATH_INFO: `/v3/projects/72b8ccc84bf74e8fb9fa885691c3391f/users/dca309558db249b298eb6695e6d8447c/roles/8a829170b29d42d6af589399e51edb0f` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:16.492697 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeba727b-e4e9-4f69-9c4f-f958d6a40f65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72b8ccc84bf74e8fb9fa885691c3391f, user_id=dca309558db249b298eb6695e6d8447c, role_id=8a829170b29d42d6af589399e51edb0f)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:16.497205 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeba727b-e4e9-4f69-9c4f-f958d6a40f65 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:16.533427 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 891/1790] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:24:16 2022] PUT /identity/v3/projects/72b8ccc84bf74e8fb9fa885691c3391f/users/dca309558db249b298eb6695e6d8447c/roles/8a829170b29d42d6af589399e51edb0f => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:24:16.534744 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90047d0d-9c0c-4ba5-b17b-008e2c48cf34 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:16.554195 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90047d0d-9c0c-4ba5-b17b-008e2c48cf34 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:16.719116 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a5938e-b292-4264-a22b-2d83404b2fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:16.722362 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a5938e-b292-4264-a22b-2d83404b2fb4 admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:16.722756 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a5938e-b292-4264-a22b-2d83404b2fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:16.724763 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a5938e-b292-4264-a22b-2d83404b2fb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:16.730656 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a5938e-b292-4264-a22b-2d83404b2fb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:16.735970 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a5938e-b292-4264-a22b-2d83404b2fb4 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:16.773464 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 900/1791] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:24:16 2022] GET /identity/v3/roles => generated 1420 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 20 22:24:16.778200 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeba727b-e4e9-4f69-9c4f-f958d6a40f65 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:16.799592 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeba727b-e4e9-4f69-9c4f-f958d6a40f65 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:16.818106 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630f8aed-6e29-444a-a741-a86f52f0ddc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:16.819597 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630f8aed-6e29-444a-a741-a86f52f0ddc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:16.820056 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630f8aed-6e29-444a-a741-a86f52f0ddc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:16.820549 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630f8aed-6e29-444a-a741-a86f52f0ddc0 admin admin] PATH_INFO: `/v3/projects/72b8ccc84bf74e8fb9fa885691c3391f/users/dca309558db249b298eb6695e6d8447c/roles/8a829170b29d42d6af589399e51edb0f` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:16.824093 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630f8aed-6e29-444a-a741-a86f52f0ddc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72b8ccc84bf74e8fb9fa885691c3391f, user_id=dca309558db249b298eb6695e6d8447c, role_id=8a829170b29d42d6af589399e51edb0f)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:16.829208 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630f8aed-6e29-444a-a741-a86f52f0ddc0 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:16.846786 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 892/1792] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:24:16 2022] PUT /identity/v3/projects/72b8ccc84bf74e8fb9fa885691c3391f/users/dca309558db249b298eb6695e6d8447c/roles/8a829170b29d42d6af589399e51edb0f => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:24:16.854471 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57542981-32b6-4784-becf-078e2a5c2531 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:16.855774 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57542981-32b6-4784-becf-078e2a5c2531 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:16.855992 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57542981-32b6-4784-becf-078e2a5c2531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:16.982876 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-57542981-32b6-4784-becf-078e2a5c2531 None None] MFA Rules not processed for user `dca309558db249b298eb6695e6d8447c`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:24:16.984687 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-57542981-32b6-4784-becf-078e2a5c2531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:17.121720 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a597ea-31c2-47f5-ab7e-128228996a63 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:17.122905 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a597ea-31c2-47f5-ab7e-128228996a63 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:17.123180 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a597ea-31c2-47f5-ab7e-128228996a63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:17.265918 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-07a597ea-31c2-47f5-ab7e-128228996a63 None None] MFA Rules not processed for user `e916748fdee84c34af034e75a919b986`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:24:17.267328 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-07a597ea-31c2-47f5-ab7e-128228996a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:17.269880 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 901/1793] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:24:16 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 416 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:24:17.334380 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57542981-32b6-4784-becf-078e2a5c2531 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:17.336247 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-57542981-32b6-4784-becf-078e2a5c2531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:17.366011 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:17.476850 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 893/1794] 10.222.0.33 () {58 vars in 1009 bytes} [Tue Sep 20 22:24:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 22:24:17.531247 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57542981-32b6-4784-becf-078e2a5c2531 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:17.546477 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb8bcd8-ff4d-436b-8705-fc422e37d91e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577c8b14c1f4279beac13b9ba11aba1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:17.551155 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb8bcd8-ff4d-436b-8705-fc422e37d91e service cinder] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:17.551663 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb8bcd8-ff4d-436b-8705-fc422e37d91e service cinder] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:17.552287 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb8bcd8-ff4d-436b-8705-fc422e37d91e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:17.705692 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb8bcd8-ff4d-436b-8705-fc422e37d91e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:17.713063 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb8bcd8-ff4d-436b-8705-fc422e37d91e service cinder] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:17.751975 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 902/1795] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:24:17 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 20 22:24:17.809235 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a597ea-31c2-47f5-ab7e-128228996a63 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:17.811538 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-07a597ea-31c2-47f5-ab7e-128228996a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:17.940992 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:18.134289 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a597ea-31c2-47f5-ab7e-128228996a63 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:18.163722 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad1dd76-e404-4399-a0bd-ec38e596cfc5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '257983500d7b430c8f0377b2aa743ae0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:18.164505 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad1dd76-e404-4399-a0bd-ec38e596cfc5 service swift] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:18.164917 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad1dd76-e404-4399-a0bd-ec38e596cfc5 service swift] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:18.165299 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad1dd76-e404-4399-a0bd-ec38e596cfc5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:18.191890 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad1dd76-e404-4399-a0bd-ec38e596cfc5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:18.193597 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad1dd76-e404-4399-a0bd-ec38e596cfc5 service swift] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:18.226090 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 894/1796] 10.222.0.33 () {60 vars in 1384 bytes} [Tue Sep 20 22:24:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 20 22:24:18.912364 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb8bcd8-ff4d-436b-8705-fc422e37d91e service cinder] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:18.914070 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-8fb8bcd8-ff4d-436b-8705-fc422e37d91e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:19.175278 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb8bcd8-ff4d-436b-8705-fc422e37d91e service cinder] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:19.195182 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b704a8-a8d5-4aca-984c-dbf43eb36c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:19.200402 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b704a8-a8d5-4aca-984c-dbf43eb36c03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:19.200402 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b704a8-a8d5-4aca-984c-dbf43eb36c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:19.200402 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b704a8-a8d5-4aca-984c-dbf43eb36c03 admin admin] PATH_INFO: `/v3/projects/08f22a77b5ac4a408164b8b07431e188` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:19.205646 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b704a8-a8d5-4aca-984c-dbf43eb36c03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08f22a77b5ac4a408164b8b07431e188)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:19.212529 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b704a8-a8d5-4aca-984c-dbf43eb36c03 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:19.318849 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-a2b704a8-a8d5-4aca-984c-dbf43eb36c03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08f22a77b5ac4a408164b8b07431e188', 'request_id': 'req-a2b704a8-a8d5-4aca-984c-dbf43eb36c03'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:19.348206 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-a2b704a8-a8d5-4aca-984c-dbf43eb36c03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08f22a77b5ac4a408164b8b07431e188', 'request_id': 'req-a2b704a8-a8d5-4aca-984c-dbf43eb36c03'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:19.388288 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-a2b704a8-a8d5-4aca-984c-dbf43eb36c03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08f22a77b5ac4a408164b8b07431e188', 'request_id': 'req-a2b704a8-a8d5-4aca-984c-dbf43eb36c03'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:19.398264 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:19.421865 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-a2b704a8-a8d5-4aca-984c-dbf43eb36c03 admin admin] The token cache is being invalidate because project 08f22a77b5ac4a408164b8b07431e188 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81306) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 22:24:19.421865 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-a2b704a8-a8d5-4aca-984c-dbf43eb36c03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:19.427144 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-a2b704a8-a8d5-4aca-984c-dbf43eb36c03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:19.437812 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 903/1797] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 20 22:24:18 2022] DELETE /identity/v3/projects/08f22a77b5ac4a408164b8b07431e188 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:24:19.438083 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad1dd76-e404-4399-a0bd-ec38e596cfc5 service swift] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:19.465540 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad1dd76-e404-4399-a0bd-ec38e596cfc5 service swift] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:19.653363 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbbaacf-063d-4d73-ba99-878bf73f2740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:19.654021 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbbaacf-063d-4d73-ba99-878bf73f2740 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:19.654292 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbbaacf-063d-4d73-ba99-878bf73f2740 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:19.654767 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbbaacf-063d-4d73-ba99-878bf73f2740 admin admin] PATH_INFO: `/v3/users/52ecb4df06ca44d18ee6f17d818a35c9` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:19.660255 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbbaacf-063d-4d73-ba99-878bf73f2740 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52ecb4df06ca44d18ee6f17d818a35c9)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:19.662214 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbbaacf-063d-4d73-ba99-878bf73f2740 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:19.923022 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-5dbbaacf-063d-4d73-ba99-878bf73f2740 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52ecb4df06ca44d18ee6f17d818a35c9'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:19.963086 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-5dbbaacf-063d-4d73-ba99-878bf73f2740 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52ecb4df06ca44d18ee6f17d818a35c9'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:19.969149 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-5dbbaacf-063d-4d73-ba99-878bf73f2740 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52ecb4df06ca44d18ee6f17d818a35c9'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:19.974674 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-5dbbaacf-063d-4d73-ba99-878bf73f2740 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52ecb4df06ca44d18ee6f17d818a35c9'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:20.023529 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-5dbbaacf-063d-4d73-ba99-878bf73f2740 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52ecb4df06ca44d18ee6f17d818a35c9'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:20.133526 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 895/1798] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 20 22:24:19 2022] DELETE /identity/v3/users/52ecb4df06ca44d18ee6f17d818a35c9 => generated 0 bytes in 696 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 22:24:20.435564 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5c3a85-e38b-4a6b-a870-3fa939abecc0 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:20.435564 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5c3a85-e38b-4a6b-a870-3fa939abecc0 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:20.435564 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5c3a85-e38b-4a6b-a870-3fa939abecc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:20.511075 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-ce5c3a85-e38b-4a6b-a870-3fa939abecc0 None None] MFA Rules not processed for user `e9b0b3ca4ecd41aaba9cf8e0f91fbf54`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:24:20.513323 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-ce5c3a85-e38b-4a6b-a870-3fa939abecc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:20.662873 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 904/1799] 10.222.0.50 () {58 vars in 1015 bytes} [Tue Sep 20 22:24:20 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:24:20.676713 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbbaacf-063d-4d73-ba99-878bf73f2740 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:20.679036 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-5dbbaacf-063d-4d73-ba99-878bf73f2740 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:20.731300 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5c3a85-e38b-4a6b-a870-3fa939abecc0 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:20.733192 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-ce5c3a85-e38b-4a6b-a870-3fa939abecc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:20.803894 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:20.953246 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbbaacf-063d-4d73-ba99-878bf73f2740 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:20.962546 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5c3a85-e38b-4a6b-a870-3fa939abecc0 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:20.973236 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6c885f-0bd7-4bfe-8ce0-1fe6f2b0bc41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:20.974195 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6c885f-0bd7-4bfe-8ce0-1fe6f2b0bc41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:20.974716 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6c885f-0bd7-4bfe-8ce0-1fe6f2b0bc41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:20.975401 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6c885f-0bd7-4bfe-8ce0-1fe6f2b0bc41 admin admin] PATH_INFO: `/v3/users/a46d974e8cff47eabdb624835a31e873` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:20.976240 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3eefbc-9b5b-46b2-b7b6-421525ca16b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:20.976901 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3eefbc-9b5b-46b2-b7b6-421525ca16b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:20.977085 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6c885f-0bd7-4bfe-8ce0-1fe6f2b0bc41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a46d974e8cff47eabdb624835a31e873)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:20.977246 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3eefbc-9b5b-46b2-b7b6-421525ca16b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:20.977557 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3eefbc-9b5b-46b2-b7b6-421525ca16b2 admin admin] PATH_INFO: `/v3/users/bea159bc58024b59a5a206d0afb0c6a5` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:20.978763 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3eefbc-9b5b-46b2-b7b6-421525ca16b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bea159bc58024b59a5a206d0afb0c6a5)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:20.980359 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6c885f-0bd7-4bfe-8ce0-1fe6f2b0bc41 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:20.991355 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3eefbc-9b5b-46b2-b7b6-421525ca16b2 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:21.091672 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-0c6c885f-0bd7-4bfe-8ce0-1fe6f2b0bc41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a46d974e8cff47eabdb624835a31e873'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:21.123519 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-0c6c885f-0bd7-4bfe-8ce0-1fe6f2b0bc41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a46d974e8cff47eabdb624835a31e873'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:21.127160 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-0c6c885f-0bd7-4bfe-8ce0-1fe6f2b0bc41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a46d974e8cff47eabdb624835a31e873'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:21.133487 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-0c6c885f-0bd7-4bfe-8ce0-1fe6f2b0bc41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a46d974e8cff47eabdb624835a31e873'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:21.147679 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-bc3eefbc-9b5b-46b2-b7b6-421525ca16b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bea159bc58024b59a5a206d0afb0c6a5'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:21.149956 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-0c6c885f-0bd7-4bfe-8ce0-1fe6f2b0bc41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a46d974e8cff47eabdb624835a31e873'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:21.172672 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-bc3eefbc-9b5b-46b2-b7b6-421525ca16b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bea159bc58024b59a5a206d0afb0c6a5'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:21.173305 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-bc3eefbc-9b5b-46b2-b7b6-421525ca16b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bea159bc58024b59a5a206d0afb0c6a5'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:21.173928 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-bc3eefbc-9b5b-46b2-b7b6-421525ca16b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bea159bc58024b59a5a206d0afb0c6a5'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:21.191904 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-bc3eefbc-9b5b-46b2-b7b6-421525ca16b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bea159bc58024b59a5a206d0afb0c6a5'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:21.204589 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 905/1800] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 20 22:24:20 2022] DELETE /identity/v3/users/a46d974e8cff47eabdb624835a31e873 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 22:24:21.204589 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6c885f-0bd7-4bfe-8ce0-1fe6f2b0bc41 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:21.204589 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-0c6c885f-0bd7-4bfe-8ce0-1fe6f2b0bc41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:21.230153 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 896/1801] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 20 22:24:20 2022] DELETE /identity/v3/users/bea159bc58024b59a5a206d0afb0c6a5 => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:24:21.231589 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ca8feb-da33-43fd-b1a6-96fff1c69ac0 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:21.231883 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ca8feb-da33-43fd-b1a6-96fff1c69ac0 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:21.232162 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ca8feb-da33-43fd-b1a6-96fff1c69ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:21.277747 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:21.316157 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-87ca8feb-da33-43fd-b1a6-96fff1c69ac0 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:24:21.316157 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-87ca8feb-da33-43fd-b1a6-96fff1c69ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:21.388870 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6c885f-0bd7-4bfe-8ce0-1fe6f2b0bc41 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:21.454660 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 897/1802] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:24:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:24:21.456161 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed262c08-924f-4f05-8d7c-8641d1156892 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:21.456571 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed262c08-924f-4f05-8d7c-8641d1156892 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:21.456773 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed262c08-924f-4f05-8d7c-8641d1156892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:21.504408 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-ed262c08-924f-4f05-8d7c-8641d1156892 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:24:21.505710 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-ed262c08-924f-4f05-8d7c-8641d1156892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:21.508629 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2419b34c-29b6-40db-869a-33c5c2aa0e56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b0b3ca4ecd41aaba9cf8e0f91fbf54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:21.509391 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2419b34c-29b6-40db-869a-33c5c2aa0e56 service neutron] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:21.509777 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2419b34c-29b6-40db-869a-33c5c2aa0e56 service neutron] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:21.510155 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2419b34c-29b6-40db-869a-33c5c2aa0e56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:21.516003 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-2419b34c-29b6-40db-869a-33c5c2aa0e56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:21.522930 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 898/1803] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:24:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:24:21.523869 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed262c08-924f-4f05-8d7c-8641d1156892 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:21.527987 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-ed262c08-924f-4f05-8d7c-8641d1156892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:21.539832 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2419b34c-29b6-40db-869a-33c5c2aa0e56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:21.541164 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2419b34c-29b6-40db-869a-33c5c2aa0e56 service neutron] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:21.558898 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 906/1804] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:24:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:24:21.568204 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2419b34c-29b6-40db-869a-33c5c2aa0e56 service neutron] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:21.575357 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-2419b34c-29b6-40db-869a-33c5c2aa0e56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:21.595414 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2419b34c-29b6-40db-869a-33c5c2aa0e56 service neutron] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:21.609844 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73263274-77bc-46ee-bf1f-18e6679f9f54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b0b3ca4ecd41aaba9cf8e0f91fbf54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:21.621442 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73263274-77bc-46ee-bf1f-18e6679f9f54 service neutron] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:21.624190 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73263274-77bc-46ee-bf1f-18e6679f9f54 service neutron] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:21.624554 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73263274-77bc-46ee-bf1f-18e6679f9f54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:21.642386 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73263274-77bc-46ee-bf1f-18e6679f9f54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:21.644141 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:21.645409 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73263274-77bc-46ee-bf1f-18e6679f9f54 service neutron] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:21.676346 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 907/1805] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:24:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 20 22:24:21.677306 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73263274-77bc-46ee-bf1f-18e6679f9f54 service neutron] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:21.679299 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-73263274-77bc-46ee-bf1f-18e6679f9f54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:21.686874 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed262c08-924f-4f05-8d7c-8641d1156892 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:21.703441 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347c1683-12b1-4da0-93a5-6fc8bcb11244 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577c8b14c1f4279beac13b9ba11aba1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:21.704095 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c1683-12b1-4da0-93a5-6fc8bcb11244 service cinder] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:21.709783 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c1683-12b1-4da0-93a5-6fc8bcb11244 service cinder] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:21.710094 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c1683-12b1-4da0-93a5-6fc8bcb11244 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:21.719454 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-347c1683-12b1-4da0-93a5-6fc8bcb11244 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:21.723119 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73263274-77bc-46ee-bf1f-18e6679f9f54 service neutron] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:21.733137 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0f906a-d2ca-47c9-ae8a-a6945c5593b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b0b3ca4ecd41aaba9cf8e0f91fbf54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:21.734031 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0f906a-d2ca-47c9-ae8a-a6945c5593b2 service neutron] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:21.735666 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0f906a-d2ca-47c9-ae8a-a6945c5593b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:21.736113 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0f906a-d2ca-47c9-ae8a-a6945c5593b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:21.775852 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0f906a-d2ca-47c9-ae8a-a6945c5593b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:21.777512 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0f906a-d2ca-47c9-ae8a-a6945c5593b2 service neutron] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:21.803974 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 908/1806] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:24:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:24:21.864693 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347c1683-12b1-4da0-93a5-6fc8bcb11244 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:21.866167 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347c1683-12b1-4da0-93a5-6fc8bcb11244 service cinder] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:21.880118 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 899/1807] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:24:21 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:24:23.508640 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347c1683-12b1-4da0-93a5-6fc8bcb11244 service cinder] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:23.509640 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0f906a-d2ca-47c9-ae8a-a6945c5593b2 service neutron] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:23.511653 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-347c1683-12b1-4da0-93a5-6fc8bcb11244 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:23.513447 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-7b0f906a-d2ca-47c9-ae8a-a6945c5593b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:23.550374 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0f906a-d2ca-47c9-ae8a-a6945c5593b2 service neutron] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:23.557120 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347c1683-12b1-4da0-93a5-6fc8bcb11244 service cinder] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:23.584775 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0982f8-c27d-40a7-bae4-f818220453a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:23.592097 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddd3669-39d5-4e84-87db-b183e8273cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:23.593900 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0982f8-c27d-40a7-bae4-f818220453a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:23.594209 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0982f8-c27d-40a7-bae4-f818220453a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:23.595861 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0982f8-c27d-40a7-bae4-f818220453a0 admin admin] PATH_INFO: `/v3/projects/21920814936144e8a2cd29e42abd1489` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:23.597964 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddd3669-39d5-4e84-87db-b183e8273cf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:23.600798 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddd3669-39d5-4e84-87db-b183e8273cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:23.601289 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddd3669-39d5-4e84-87db-b183e8273cf2 admin admin] PATH_INFO: `/v3/projects/6448b5fce3a24ec2a4a47682d6e91c21` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:23.604158 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0982f8-c27d-40a7-bae4-f818220453a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21920814936144e8a2cd29e42abd1489)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:23.606990 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddd3669-39d5-4e84-87db-b183e8273cf2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6448b5fce3a24ec2a4a47682d6e91c21)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:23.608903 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddd3669-39d5-4e84-87db-b183e8273cf2 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:23.612898 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0982f8-c27d-40a7-bae4-f818220453a0 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:23.775014 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-bddd3669-39d5-4e84-87db-b183e8273cf2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6448b5fce3a24ec2a4a47682d6e91c21', 'request_id': 'req-bddd3669-39d5-4e84-87db-b183e8273cf2'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:23.796439 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-bddd3669-39d5-4e84-87db-b183e8273cf2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6448b5fce3a24ec2a4a47682d6e91c21', 'request_id': 'req-bddd3669-39d5-4e84-87db-b183e8273cf2'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:23.825843 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-bddd3669-39d5-4e84-87db-b183e8273cf2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6448b5fce3a24ec2a4a47682d6e91c21', 'request_id': 'req-bddd3669-39d5-4e84-87db-b183e8273cf2'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:23.838935 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-5b0982f8-c27d-40a7-bae4-f818220453a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21920814936144e8a2cd29e42abd1489', 'request_id': 'req-5b0982f8-c27d-40a7-bae4-f818220453a0'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:23.853621 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-bddd3669-39d5-4e84-87db-b183e8273cf2 admin admin] The token cache is being invalidate because project 6448b5fce3a24ec2a4a47682d6e91c21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81307) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 22:24:23.853914 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-bddd3669-39d5-4e84-87db-b183e8273cf2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:23.856536 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-bddd3669-39d5-4e84-87db-b183e8273cf2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:23.859323 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-5b0982f8-c27d-40a7-bae4-f818220453a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21920814936144e8a2cd29e42abd1489', 'request_id': 'req-5b0982f8-c27d-40a7-bae4-f818220453a0'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:23.866317 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 900/1808] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 20 22:24:23 2022] DELETE /identity/v3/projects/6448b5fce3a24ec2a4a47682d6e91c21 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:24:23.872592 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79abb3bd-4837-4aee-adfb-fc05e895685a None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:23.872592 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79abb3bd-4837-4aee-adfb-fc05e895685a None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:23.872592 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79abb3bd-4837-4aee-adfb-fc05e895685a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:23.892456 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-5b0982f8-c27d-40a7-bae4-f818220453a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21920814936144e8a2cd29e42abd1489', 'request_id': 'req-5b0982f8-c27d-40a7-bae4-f818220453a0'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:23.928284 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-79abb3bd-4837-4aee-adfb-fc05e895685a None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:24:23.929064 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-5b0982f8-c27d-40a7-bae4-f818220453a0 admin admin] The token cache is being invalidate because project 21920814936144e8a2cd29e42abd1489 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81306) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 22:24:23.929544 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-5b0982f8-c27d-40a7-bae4-f818220453a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:23.929913 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-79abb3bd-4837-4aee-adfb-fc05e895685a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:23.930773 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-5b0982f8-c27d-40a7-bae4-f818220453a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:23.947049 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 909/1809] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 20 22:24:23 2022] DELETE /identity/v3/projects/21920814936144e8a2cd29e42abd1489 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 22:24:23.948864 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0982f8-c27d-40a7-bae4-f818220453a0 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:23.950866 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-5b0982f8-c27d-40a7-bae4-f818220453a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:24.101537 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:24.169447 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0982f8-c27d-40a7-bae4-f818220453a0 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:24.182289 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f22402a-069f-4b1f-8bff-1a7c2d8c0b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:24.183550 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f22402a-069f-4b1f-8bff-1a7c2d8c0b6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:24.183827 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f22402a-069f-4b1f-8bff-1a7c2d8c0b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:24.184098 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f22402a-069f-4b1f-8bff-1a7c2d8c0b6c admin admin] PATH_INFO: `/v3/users/ed28acc69d8c412a81e0050e0607773d` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:24.185438 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f22402a-069f-4b1f-8bff-1a7c2d8c0b6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed28acc69d8c412a81e0050e0607773d)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:24.187759 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f22402a-069f-4b1f-8bff-1a7c2d8c0b6c admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:24.227215 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 901/1810] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:24:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:24:24.234605 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e6453-9031-480d-8c32-a3293ae395ad None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:24.235116 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e6453-9031-480d-8c32-a3293ae395ad None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:24.235545 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e6453-9031-480d-8c32-a3293ae395ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:24.279377 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-317e6453-9031-480d-8c32-a3293ae395ad None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:24:24.281249 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-317e6453-9031-480d-8c32-a3293ae395ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:24.318024 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-6f22402a-069f-4b1f-8bff-1a7c2d8c0b6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed28acc69d8c412a81e0050e0607773d'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:24.324172 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 902/1811] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:24:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:24:24.328974 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317e6453-9031-480d-8c32-a3293ae395ad None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:24.330572 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-6f22402a-069f-4b1f-8bff-1a7c2d8c0b6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed28acc69d8c412a81e0050e0607773d'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:24.331213 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-6f22402a-069f-4b1f-8bff-1a7c2d8c0b6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed28acc69d8c412a81e0050e0607773d'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:24.331867 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-6f22402a-069f-4b1f-8bff-1a7c2d8c0b6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed28acc69d8c412a81e0050e0607773d'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:24.339447 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:24.347649 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-6f22402a-069f-4b1f-8bff-1a7c2d8c0b6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed28acc69d8c412a81e0050e0607773d'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:24.358772 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317e6453-9031-480d-8c32-a3293ae395ad None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:24.392850 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ed867d-424c-4e96-a2f6-a58e4b94873f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:24.395938 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ed867d-424c-4e96-a2f6-a58e4b94873f admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:24.396171 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ed867d-424c-4e96-a2f6-a58e4b94873f admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:24.396449 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ed867d-424c-4e96-a2f6-a58e4b94873f admin admin] PATH_INFO: `/v3/domains` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:24.402653 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ed867d-424c-4e96-a2f6-a58e4b94873f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:24:24.403180 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ed867d-424c-4e96-a2f6-a58e4b94873f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:24.405243 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ed867d-424c-4e96-a2f6-a58e4b94873f admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:24.421734 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 910/1812] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 20 22:24:23 2022] DELETE /identity/v3/users/ed28acc69d8c412a81e0050e0607773d => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:24:24.423548 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 903/1813] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 20 22:24:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:24:24.427842 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f22402a-069f-4b1f-8bff-1a7c2d8c0b6c admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:24.430714 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-6f22402a-069f-4b1f-8bff-1a7c2d8c0b6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:24.550369 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f22402a-069f-4b1f-8bff-1a7c2d8c0b6c admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:24.556758 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f41597-0805-4862-852f-0ced4d70fa3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:24.558212 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f41597-0805-4862-852f-0ced4d70fa3f admin admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:24.558650 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f41597-0805-4862-852f-0ced4d70fa3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:24.559038 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f41597-0805-4862-852f-0ced4d70fa3f admin admin] PATH_INFO: `/v3/projects` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:24.559915 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f41597-0805-4862-852f-0ced4d70fa3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:24.563488 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f41597-0805-4862-852f-0ced4d70fa3f admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:24.613830 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ed867d-424c-4e96-a2f6-a58e4b94873f admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:24.614400 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 911/1814] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 20 22:24:24 2022] POST /identity/v3/projects => generated 385 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:24:24.630467 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ed867d-424c-4e96-a2f6-a58e4b94873f admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:24.724635 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759e799a-bff9-4574-ac38-d558f9418ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:24.725765 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e799a-bff9-4574-ac38-d558f9418ad6 admin admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:24.726296 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e799a-bff9-4574-ac38-d558f9418ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:24.727000 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e799a-bff9-4574-ac38-d558f9418ad6 admin admin] PATH_INFO: `/v3/users` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:24.727942 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759e799a-bff9-4574-ac38-d558f9418ad6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:24.733202 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759e799a-bff9-4574-ac38-d558f9418ad6 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:24.791493 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 904/1815] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 20 22:24:24 2022] POST /identity/v3/users => generated 293 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:24:24.797329 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f41597-0805-4862-852f-0ced4d70fa3f admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:24.814376 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f41597-0805-4862-852f-0ced4d70fa3f admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:24.831134 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f164ee70-4151-4b87-808b-97be881fe07a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:24.831776 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f164ee70-4151-4b87-808b-97be881fe07a admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:24.832054 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f164ee70-4151-4b87-808b-97be881fe07a admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:24.845525 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f164ee70-4151-4b87-808b-97be881fe07a admin admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:24.847781 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f164ee70-4151-4b87-808b-97be881fe07a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:24.852448 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f164ee70-4151-4b87-808b-97be881fe07a admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:24.904239 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759e799a-bff9-4574-ac38-d558f9418ad6 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:24.905635 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 912/1816] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:24:24 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:24:24.937181 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759e799a-bff9-4574-ac38-d558f9418ad6 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:24.962658 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5d42c5-ff43-4da7-9d54-d6f9611e46a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:24.969053 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5d42c5-ff43-4da7-9d54-d6f9611e46a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:24.969982 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5d42c5-ff43-4da7-9d54-d6f9611e46a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:24.972083 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5d42c5-ff43-4da7-9d54-d6f9611e46a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:24.975320 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5d42c5-ff43-4da7-9d54-d6f9611e46a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:24.980374 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5d42c5-ff43-4da7-9d54-d6f9611e46a3 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:25.025488 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 905/1817] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:24:24 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:24:25.032425 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f164ee70-4151-4b87-808b-97be881fe07a admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:25.053912 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f164ee70-4151-4b87-808b-97be881fe07a admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:25.066430 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8d3a08-cdfb-4ce0-866b-9d1244963323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:25.069120 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8d3a08-cdfb-4ce0-866b-9d1244963323 admin admin] REQUEST_METHOD: `PUT` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:25.069407 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8d3a08-cdfb-4ce0-866b-9d1244963323 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:25.070372 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8d3a08-cdfb-4ce0-866b-9d1244963323 admin admin] PATH_INFO: `/v3/projects/ff33edbaf87a484e8b1f81fe768c2e98/users/b50c8efad55446828740d785761c11bc/roles/604444e7ad0d437dbd1f5a6e02b761f5` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:25.150966 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8d3a08-cdfb-4ce0-866b-9d1244963323 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff33edbaf87a484e8b1f81fe768c2e98, user_id=b50c8efad55446828740d785761c11bc, role_id=604444e7ad0d437dbd1f5a6e02b761f5)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:25.160858 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8d3a08-cdfb-4ce0-866b-9d1244963323 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:25.174899 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5d42c5-ff43-4da7-9d54-d6f9611e46a3 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:25.177358 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-eb5d42c5-ff43-4da7-9d54-d6f9611e46a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:25.217342 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 913/1818] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:24:25 2022] PUT /identity/v3/projects/ff33edbaf87a484e8b1f81fe768c2e98/users/b50c8efad55446828740d785761c11bc/roles/604444e7ad0d437dbd1f5a6e02b761f5 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:24:25.219109 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62507cda-ab1d-40dc-af5e-3040c794bfe2 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:25.219427 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5d42c5-ff43-4da7-9d54-d6f9611e46a3 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:25.219544 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62507cda-ab1d-40dc-af5e-3040c794bfe2 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:25.219822 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62507cda-ab1d-40dc-af5e-3040c794bfe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:25.245751 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:25.270427 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-62507cda-ab1d-40dc-af5e-3040c794bfe2 None None] MFA Rules not processed for user `b50c8efad55446828740d785761c11bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:24:25.272574 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-62507cda-ab1d-40dc-af5e-3040c794bfe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:25.409242 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 914/1819] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:24:25 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:24:25.411459 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62507cda-ab1d-40dc-af5e-3040c794bfe2 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:25.449675 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1092b069-d2e0-4367-8f25-dcdbe22f0ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:25.450359 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1092b069-d2e0-4367-8f25-dcdbe22f0ec4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:25.450677 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1092b069-d2e0-4367-8f25-dcdbe22f0ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:25.450952 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1092b069-d2e0-4367-8f25-dcdbe22f0ec4 admin admin] PATH_INFO: `/v3/projects/76922d67028b42ae881ef7e65a1285a4` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:25.452344 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1092b069-d2e0-4367-8f25-dcdbe22f0ec4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76922d67028b42ae881ef7e65a1285a4)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:25.454027 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1092b069-d2e0-4367-8f25-dcdbe22f0ec4 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:25.550707 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-1092b069-d2e0-4367-8f25-dcdbe22f0ec4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76922d67028b42ae881ef7e65a1285a4', 'request_id': 'req-1092b069-d2e0-4367-8f25-dcdbe22f0ec4'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:25.559939 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-1092b069-d2e0-4367-8f25-dcdbe22f0ec4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76922d67028b42ae881ef7e65a1285a4', 'request_id': 'req-1092b069-d2e0-4367-8f25-dcdbe22f0ec4'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:25.583377 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-1092b069-d2e0-4367-8f25-dcdbe22f0ec4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76922d67028b42ae881ef7e65a1285a4', 'request_id': 'req-1092b069-d2e0-4367-8f25-dcdbe22f0ec4'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:25.591126 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:25.600145 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-1092b069-d2e0-4367-8f25-dcdbe22f0ec4 admin admin] The token cache is being invalidate because project 76922d67028b42ae881ef7e65a1285a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81307) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 22:24:25.609418 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-1092b069-d2e0-4367-8f25-dcdbe22f0ec4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:25.610614 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-1092b069-d2e0-4367-8f25-dcdbe22f0ec4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:25.613936 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 906/1820] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 20 22:24:25 2022] DELETE /identity/v3/projects/76922d67028b42ae881ef7e65a1285a4 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 22:24:25.624190 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1092b069-d2e0-4367-8f25-dcdbe22f0ec4 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:25.644814 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-1092b069-d2e0-4367-8f25-dcdbe22f0ec4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:25.668633 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62507cda-ab1d-40dc-af5e-3040c794bfe2 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:25.852862 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1092b069-d2e0-4367-8f25-dcdbe22f0ec4 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:25.861118 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088d7d1b-3ff8-470a-b8b5-c4e7db4d0d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:25.862141 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088d7d1b-3ff8-470a-b8b5-c4e7db4d0d36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:25.862994 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088d7d1b-3ff8-470a-b8b5-c4e7db4d0d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:25.863541 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088d7d1b-3ff8-470a-b8b5-c4e7db4d0d36 admin admin] PATH_INFO: `/v3/users/04cc6996303046babef83a9c7aab8fa6` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:25.865766 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088d7d1b-3ff8-470a-b8b5-c4e7db4d0d36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04cc6996303046babef83a9c7aab8fa6)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:25.869280 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088d7d1b-3ff8-470a-b8b5-c4e7db4d0d36 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:25.955025 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575d47df-18d7-4cd3-a08e-d07e2b4de62d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:25.957173 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d47df-18d7-4cd3-a08e-d07e2b4de62d admin admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:25.957908 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d47df-18d7-4cd3-a08e-d07e2b4de62d admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:25.959489 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d47df-18d7-4cd3-a08e-d07e2b4de62d admin admin] PATH_INFO: `/v3/projects` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:25.962071 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575d47df-18d7-4cd3-a08e-d07e2b4de62d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:25.970122 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575d47df-18d7-4cd3-a08e-d07e2b4de62d admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:26.030000 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-088d7d1b-3ff8-470a-b8b5-c4e7db4d0d36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04cc6996303046babef83a9c7aab8fa6'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:26.049318 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-088d7d1b-3ff8-470a-b8b5-c4e7db4d0d36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04cc6996303046babef83a9c7aab8fa6'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:26.049507 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-088d7d1b-3ff8-470a-b8b5-c4e7db4d0d36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04cc6996303046babef83a9c7aab8fa6'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:26.050171 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-088d7d1b-3ff8-470a-b8b5-c4e7db4d0d36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04cc6996303046babef83a9c7aab8fa6'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:26.056131 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 915/1821] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 20 22:24:25 2022] POST /identity/v3/projects => generated 387 bytes in 647 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:24:26.061898 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575d47df-18d7-4cd3-a08e-d07e2b4de62d admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:26.064519 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-575d47df-18d7-4cd3-a08e-d07e2b4de62d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:26.092839 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-088d7d1b-3ff8-470a-b8b5-c4e7db4d0d36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04cc6996303046babef83a9c7aab8fa6'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:26.146443 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 907/1822] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 20 22:24:25 2022] DELETE /identity/v3/users/04cc6996303046babef83a9c7aab8fa6 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:24:26.181391 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:26.252160 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575d47df-18d7-4cd3-a08e-d07e2b4de62d admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:26.401266 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529afc60-c9c7-49e2-98c0-4734f194f1f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:26.403000 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529afc60-c9c7-49e2-98c0-4734f194f1f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:26.403470 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529afc60-c9c7-49e2-98c0-4734f194f1f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:26.404473 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529afc60-c9c7-49e2-98c0-4734f194f1f3 admin admin] PATH_INFO: `/v3/users` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:26.406402 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529afc60-c9c7-49e2-98c0-4734f194f1f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:26.413392 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529afc60-c9c7-49e2-98c0-4734f194f1f3 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:26.468933 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 916/1823] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 20 22:24:26 2022] POST /identity/v3/users => generated 294 bytes in 408 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:24:26.473430 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088d7d1b-3ff8-470a-b8b5-c4e7db4d0d36 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:26.491371 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088d7d1b-3ff8-470a-b8b5-c4e7db4d0d36 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:26.511927 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42102ff9-3c09-497d-8728-5543b97546e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:26.512838 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42102ff9-3c09-497d-8728-5543b97546e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:26.513172 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42102ff9-3c09-497d-8728-5543b97546e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:26.513560 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42102ff9-3c09-497d-8728-5543b97546e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:26.514602 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42102ff9-3c09-497d-8728-5543b97546e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:26.516885 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42102ff9-3c09-497d-8728-5543b97546e9 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:26.532081 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 908/1824] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:24:26 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 20 22:24:26.536193 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529afc60-c9c7-49e2-98c0-4734f194f1f3 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:26.548842 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529afc60-c9c7-49e2-98c0-4734f194f1f3 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:26.556042 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0708a671-247d-444b-aec3-c6b85b0c23b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:26.557196 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0708a671-247d-444b-aec3-c6b85b0c23b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:26.557753 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0708a671-247d-444b-aec3-c6b85b0c23b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:26.558126 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0708a671-247d-444b-aec3-c6b85b0c23b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:26.559293 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0708a671-247d-444b-aec3-c6b85b0c23b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:26.562402 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0708a671-247d-444b-aec3-c6b85b0c23b5 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:26.579721 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 917/1825] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:24:26 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 20 22:24:26.584735 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42102ff9-3c09-497d-8728-5543b97546e9 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:26.618412 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42102ff9-3c09-497d-8728-5543b97546e9 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:26.641597 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be50611-6dfc-4725-b3c7-2c2fcbb265f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:26.642713 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be50611-6dfc-4725-b3c7-2c2fcbb265f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:26.643823 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be50611-6dfc-4725-b3c7-2c2fcbb265f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:26.644769 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be50611-6dfc-4725-b3c7-2c2fcbb265f0 admin admin] PATH_INFO: `/v3/projects/330b726fb38843819b02b630907f5a10/users/6f0a4ab80ed9442fbd07cc9c201dc2f4/roles/604444e7ad0d437dbd1f5a6e02b761f5` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:26.670896 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8a3791-cafd-4f3e-af32-f1fe1a1b1986 None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:26.671653 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8a3791-cafd-4f3e-af32-f1fe1a1b1986 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:26.671653 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8a3791-cafd-4f3e-af32-f1fe1a1b1986 None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:26.672965 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 918/1826] 10.222.0.33 () {54 vars in 921 bytes} [Tue Sep 20 22:24:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 20 22:24:26.706308 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be50611-6dfc-4725-b3c7-2c2fcbb265f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=330b726fb38843819b02b630907f5a10, user_id=6f0a4ab80ed9442fbd07cc9c201dc2f4, role_id=604444e7ad0d437dbd1f5a6e02b761f5)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:26.709322 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be50611-6dfc-4725-b3c7-2c2fcbb265f0 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:26.737053 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 909/1827] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:24:26 2022] PUT /identity/v3/projects/330b726fb38843819b02b630907f5a10/users/6f0a4ab80ed9442fbd07cc9c201dc2f4/roles/604444e7ad0d437dbd1f5a6e02b761f5 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:24:26.753608 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85c130e-9575-4261-8f35-28fa509a6f47 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:26.754050 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85c130e-9575-4261-8f35-28fa509a6f47 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:26.755751 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85c130e-9575-4261-8f35-28fa509a6f47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:26.822204 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9153cbd-13b0-4ee2-8f39-1fbc9ab5cc4c None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:26.822492 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9153cbd-13b0-4ee2-8f39-1fbc9ab5cc4c None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:26.823670 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9153cbd-13b0-4ee2-8f39-1fbc9ab5cc4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:26.919063 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-d85c130e-9575-4261-8f35-28fa509a6f47 None None] MFA Rules not processed for user `6f0a4ab80ed9442fbd07cc9c201dc2f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:24:26.919242 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-b9153cbd-13b0-4ee2-8f39-1fbc9ab5cc4c None None] MFA Rules not processed for user `db7eed561e99452289a662ad326cf919`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:24:26.921443 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-b9153cbd-13b0-4ee2-8f39-1fbc9ab5cc4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:26.921835 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-d85c130e-9575-4261-8f35-28fa509a6f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:27.154574 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:27.171568 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 919/1828] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:24:26 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 419 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:24:27.183355 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85c130e-9575-4261-8f35-28fa509a6f47 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:27.300409 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 910/1829] 10.222.0.33 () {58 vars in 1018 bytes} [Tue Sep 20 22:24:26 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 481 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:24:27.360079 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:27.411833 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85c130e-9575-4261-8f35-28fa509a6f47 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:27.419830 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36665167-9c33-4ae7-a132-77df29c96b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:27.420874 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36665167-9c33-4ae7-a132-77df29c96b3f admin admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:27.421247 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36665167-9c33-4ae7-a132-77df29c96b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:27.431171 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36665167-9c33-4ae7-a132-77df29c96b3f admin admin] PATH_INFO: `/v3/projects` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:27.433609 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36665167-9c33-4ae7-a132-77df29c96b3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:27.436172 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36665167-9c33-4ae7-a132-77df29c96b3f admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:27.486891 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 920/1830] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 20 22:24:27 2022] POST /identity/v3/projects => generated 383 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:24:27.490460 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9153cbd-13b0-4ee2-8f39-1fbc9ab5cc4c None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:27.520655 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9153cbd-13b0-4ee2-8f39-1fbc9ab5cc4c None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:27.718971 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403b5239-0704-495c-ad76-39e4e94204ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:27.720784 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403b5239-0704-495c-ad76-39e4e94204ef admin admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:27.721407 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403b5239-0704-495c-ad76-39e4e94204ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:27.721987 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403b5239-0704-495c-ad76-39e4e94204ef admin admin] PATH_INFO: `/v3/users` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:27.722846 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403b5239-0704-495c-ad76-39e4e94204ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:27.726722 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403b5239-0704-495c-ad76-39e4e94204ef admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:27.767431 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 911/1831] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 20 22:24:27 2022] POST /identity/v3/users => generated 298 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:24:27.768276 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36665167-9c33-4ae7-a132-77df29c96b3f admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:27.791920 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36665167-9c33-4ae7-a132-77df29c96b3f admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:27.819998 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac388180-ba54-44a9-bb5b-e26cac353472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:27.824670 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac388180-ba54-44a9-bb5b-e26cac353472 admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:27.825354 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac388180-ba54-44a9-bb5b-e26cac353472 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:27.826364 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac388180-ba54-44a9-bb5b-e26cac353472 admin admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:27.827471 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac388180-ba54-44a9-bb5b-e26cac353472 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:27.831138 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac388180-ba54-44a9-bb5b-e26cac353472 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:27.859086 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 921/1832] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:24:27 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 20 22:24:27.863038 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403b5239-0704-495c-ad76-39e4e94204ef admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:27.882538 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403b5239-0704-495c-ad76-39e4e94204ef admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:27.895528 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5536558a-1a88-4e86-ada8-d69ae1320e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:27.896330 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5536558a-1a88-4e86-ada8-d69ae1320e32 admin admin] REQUEST_METHOD: `PUT` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:27.896727 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5536558a-1a88-4e86-ada8-d69ae1320e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:27.897110 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5536558a-1a88-4e86-ada8-d69ae1320e32 admin admin] PATH_INFO: `/v3/projects/d81b714d4bc54ea9a0ed4beb051d84f6/users/42a71816399f404b865397c04f60494e/roles/8a829170b29d42d6af589399e51edb0f` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:27.963605 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac388180-ba54-44a9-bb5b-e26cac353472 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:27.964459 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5536558a-1a88-4e86-ada8-d69ae1320e32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d81b714d4bc54ea9a0ed4beb051d84f6, user_id=42a71816399f404b865397c04f60494e, role_id=8a829170b29d42d6af589399e51edb0f)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:27.965711 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-ac388180-ba54-44a9-bb5b-e26cac353472 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:27.967359 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5536558a-1a88-4e86-ada8-d69ae1320e32 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:28.011486 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac388180-ba54-44a9-bb5b-e26cac353472 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:28.011945 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 912/1833] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:24:27 2022] PUT /identity/v3/projects/d81b714d4bc54ea9a0ed4beb051d84f6/users/42a71816399f404b865397c04f60494e/roles/8a829170b29d42d6af589399e51edb0f => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:24:28.018668 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5536558a-1a88-4e86-ada8-d69ae1320e32 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:28.220553 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5536558a-1a88-4e86-ada8-d69ae1320e32 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:28.241202 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab28e532-9c88-49aa-bd6c-71769138fae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:28.241202 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab28e532-9c88-49aa-bd6c-71769138fae3 admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:28.241202 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab28e532-9c88-49aa-bd6c-71769138fae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:28.241202 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab28e532-9c88-49aa-bd6c-71769138fae3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:28.241635 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab28e532-9c88-49aa-bd6c-71769138fae3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:28.241635 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab28e532-9c88-49aa-bd6c-71769138fae3 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:28.271265 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 913/1834] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:24:28 2022] GET /identity/v3/roles => generated 1420 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:24:28.271265 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab28e532-9c88-49aa-bd6c-71769138fae3 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:28.275875 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-ab28e532-9c88-49aa-bd6c-71769138fae3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:28.297656 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6acc7cd-d5be-4841-bfe2-50efa1c9219c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:28.299452 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6acc7cd-d5be-4841-bfe2-50efa1c9219c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:28.299738 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6acc7cd-d5be-4841-bfe2-50efa1c9219c admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:28.300393 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6acc7cd-d5be-4841-bfe2-50efa1c9219c admin admin] PATH_INFO: `/v3/projects/e7a86533cf8e4ebd8fbea060c3f3e39a` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:28.308160 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6acc7cd-d5be-4841-bfe2-50efa1c9219c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7a86533cf8e4ebd8fbea060c3f3e39a)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:28.317385 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6acc7cd-d5be-4841-bfe2-50efa1c9219c admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:28.446909 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:28.461566 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-e6acc7cd-d5be-4841-bfe2-50efa1c9219c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7a86533cf8e4ebd8fbea060c3f3e39a', 'request_id': 'req-e6acc7cd-d5be-4841-bfe2-50efa1c9219c'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:28.492209 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-e6acc7cd-d5be-4841-bfe2-50efa1c9219c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7a86533cf8e4ebd8fbea060c3f3e39a', 'request_id': 'req-e6acc7cd-d5be-4841-bfe2-50efa1c9219c'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:28.509211 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-e6acc7cd-d5be-4841-bfe2-50efa1c9219c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7a86533cf8e4ebd8fbea060c3f3e39a', 'request_id': 'req-e6acc7cd-d5be-4841-bfe2-50efa1c9219c'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:28.539067 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-e6acc7cd-d5be-4841-bfe2-50efa1c9219c admin admin] The token cache is being invalidate because project e7a86533cf8e4ebd8fbea060c3f3e39a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81306) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 22:24:28.539525 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-e6acc7cd-d5be-4841-bfe2-50efa1c9219c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:28.541232 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-e6acc7cd-d5be-4841-bfe2-50efa1c9219c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:28.547055 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 922/1835] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 20 22:24:27 2022] DELETE /identity/v3/projects/e7a86533cf8e4ebd8fbea060c3f3e39a => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 22:24:28.556060 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab28e532-9c88-49aa-bd6c-71769138fae3 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:28.556207 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fedb89a-e1e9-4612-953d-c1af2a594126 None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:28.556207 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fedb89a-e1e9-4612-953d-c1af2a594126 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:28.556207 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fedb89a-e1e9-4612-953d-c1af2a594126 None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:28.556207 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 923/1836] 10.222.0.33 () {54 vars in 921 bytes} [Tue Sep 20 22:24:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:24:28.568560 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fedb89a-e1e9-4612-953d-c1af2a594126 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:28.575923 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-2fedb89a-e1e9-4612-953d-c1af2a594126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:28.821346 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:28.839857 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be18a9a-04a9-4913-a014-426b69e6c3ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db7eed561e99452289a662ad326cf919', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:28.840436 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be18a9a-04a9-4913-a014-426b69e6c3ec service nova] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:28.840713 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be18a9a-04a9-4913-a014-426b69e6c3ec service nova] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:28.841172 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be18a9a-04a9-4913-a014-426b69e6c3ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:28.878392 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-2be18a9a-04a9-4913-a014-426b69e6c3ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:28.894790 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fedb89a-e1e9-4612-953d-c1af2a594126 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:28.905307 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be18a9a-04a9-4913-a014-426b69e6c3ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:28.911385 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36acd98d-f0b0-4013-a325-1d7c75846f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:28.914336 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36acd98d-f0b0-4013-a325-1d7c75846f55 admin admin] REQUEST_METHOD: `PUT` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:28.914501 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be18a9a-04a9-4913-a014-426b69e6c3ec service nova] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:28.914629 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36acd98d-f0b0-4013-a325-1d7c75846f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:28.914629 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36acd98d-f0b0-4013-a325-1d7c75846f55 admin admin] PATH_INFO: `/v3/projects/d81b714d4bc54ea9a0ed4beb051d84f6/users/42a71816399f404b865397c04f60494e/roles/8a829170b29d42d6af589399e51edb0f` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:28.915469 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36acd98d-f0b0-4013-a325-1d7c75846f55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d81b714d4bc54ea9a0ed4beb051d84f6, user_id=42a71816399f404b865397c04f60494e, role_id=8a829170b29d42d6af589399e51edb0f)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:28.921086 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36acd98d-f0b0-4013-a325-1d7c75846f55 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:28.942767 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 914/1837] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:24:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 673 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:24:28.944470 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2335d45-c5b6-485b-869f-99d8ea895f66 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:28.946235 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2335d45-c5b6-485b-869f-99d8ea895f66 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:28.946682 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2335d45-c5b6-485b-869f-99d8ea895f66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:28.953948 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 924/1838] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:24:28 2022] PUT /identity/v3/projects/d81b714d4bc54ea9a0ed4beb051d84f6/users/42a71816399f404b865397c04f60494e/roles/8a829170b29d42d6af589399e51edb0f => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:24:28.968311 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a574c5-0ffe-469a-9abf-64c9c0569b6f None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:28.968708 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a574c5-0ffe-469a-9abf-64c9c0569b6f None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:28.970938 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a574c5-0ffe-469a-9abf-64c9c0569b6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:29.011172 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-b2335d45-c5b6-485b-869f-99d8ea895f66 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:24:29.016988 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-b2335d45-c5b6-485b-869f-99d8ea895f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:29.053053 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-79a574c5-0ffe-469a-9abf-64c9c0569b6f None None] MFA Rules not processed for user `db7eed561e99452289a662ad326cf919`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:24:29.060486 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-79a574c5-0ffe-469a-9abf-64c9c0569b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:29.256983 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 915/1839] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:24:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:24:29.263151 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9b6a9e-f032-4889-a9a7-7acab0eb9b9b None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:29.263373 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9b6a9e-f032-4889-a9a7-7acab0eb9b9b None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:29.263590 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9b6a9e-f032-4889-a9a7-7acab0eb9b9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:29.385083 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-da9b6a9e-f032-4889-a9a7-7acab0eb9b9b None None] MFA Rules not processed for user `42a71816399f404b865397c04f60494e`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:24:29.389459 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-da9b6a9e-f032-4889-a9a7-7acab0eb9b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:29.407888 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 925/1840] 10.222.0.33 () {58 vars in 1018 bytes} [Tue Sep 20 22:24:28 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 453 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:24:29.412987 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a574c5-0ffe-469a-9abf-64c9c0569b6f None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:29.416463 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-79a574c5-0ffe-469a-9abf-64c9c0569b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:29.461384 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a574c5-0ffe-469a-9abf-64c9c0569b6f None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:29.476826 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48ed242-74fa-413f-afae-c03cc270aa76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:29.477750 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48ed242-74fa-413f-afae-c03cc270aa76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:29.478032 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48ed242-74fa-413f-afae-c03cc270aa76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:29.478458 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48ed242-74fa-413f-afae-c03cc270aa76 admin admin] PATH_INFO: `/v3/projects/5a331d79d8534851b6486a8af38bd14b` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:29.485328 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48ed242-74fa-413f-afae-c03cc270aa76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a331d79d8534851b6486a8af38bd14b)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:29.492812 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48ed242-74fa-413f-afae-c03cc270aa76 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:29.564408 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:29.626569 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-b48ed242-74fa-413f-afae-c03cc270aa76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a331d79d8534851b6486a8af38bd14b', 'request_id': 'req-b48ed242-74fa-413f-afae-c03cc270aa76'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:29.637651 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 916/1841] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:24:29 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 380 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:24:29.640281 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a1f960-c85c-4c5d-a94e-8ea268b393fb None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:29.644273 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a1f960-c85c-4c5d-a94e-8ea268b393fb None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:29.644814 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a1f960-c85c-4c5d-a94e-8ea268b393fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:29.647118 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-b48ed242-74fa-413f-afae-c03cc270aa76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a331d79d8534851b6486a8af38bd14b', 'request_id': 'req-b48ed242-74fa-413f-afae-c03cc270aa76'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:29.666103 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-b48ed242-74fa-413f-afae-c03cc270aa76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a331d79d8534851b6486a8af38bd14b', 'request_id': 'req-b48ed242-74fa-413f-afae-c03cc270aa76'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:29.702160 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-b48ed242-74fa-413f-afae-c03cc270aa76 admin admin] The token cache is being invalidate because project 5a331d79d8534851b6486a8af38bd14b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81306) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 22:24:29.703001 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-b48ed242-74fa-413f-afae-c03cc270aa76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:29.706027 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-b48ed242-74fa-413f-afae-c03cc270aa76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:29.710979 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 926/1842] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 20 22:24:29 2022] DELETE /identity/v3/projects/5a331d79d8534851b6486a8af38bd14b => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:24:29.712523 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48ed242-74fa-413f-afae-c03cc270aa76 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:29.716659 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-d7a1f960-c85c-4c5d-a94e-8ea268b393fb None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:24:29.718733 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-b48ed242-74fa-413f-afae-c03cc270aa76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:29.721747 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-d7a1f960-c85c-4c5d-a94e-8ea268b393fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:29.916353 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 917/1843] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:24:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:24:29.916353 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d363b092-fff8-4c0f-9db3-fc5cd819c9b4 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:29.916353 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d363b092-fff8-4c0f-9db3-fc5cd819c9b4 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:29.917216 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48ed242-74fa-413f-afae-c03cc270aa76 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:29.917591 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d363b092-fff8-4c0f-9db3-fc5cd819c9b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:29.945351 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315ff5ea-e4f2-4d40-8a66-44f5a28d7455 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577c8b14c1f4279beac13b9ba11aba1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:29.946049 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315ff5ea-e4f2-4d40-8a66-44f5a28d7455 service cinder] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:29.946370 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315ff5ea-e4f2-4d40-8a66-44f5a28d7455 service cinder] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:29.946683 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315ff5ea-e4f2-4d40-8a66-44f5a28d7455 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:29.952467 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-315ff5ea-e4f2-4d40-8a66-44f5a28d7455 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:29.977352 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:29.987504 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-d363b092-fff8-4c0f-9db3-fc5cd819c9b4 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:24:29.992486 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-d363b092-fff8-4c0f-9db3-fc5cd819c9b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:30.016782 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 918/1844] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:24:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:24:30.017962 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d363b092-fff8-4c0f-9db3-fc5cd819c9b4 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:30.070556 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d363b092-fff8-4c0f-9db3-fc5cd819c9b4 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:30.094442 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed00db9e-2be2-4c0c-a6e8-94dfb88a8764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:30.096956 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed00db9e-2be2-4c0c-a6e8-94dfb88a8764 admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:30.098829 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed00db9e-2be2-4c0c-a6e8-94dfb88a8764 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:30.100973 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed00db9e-2be2-4c0c-a6e8-94dfb88a8764 admin admin] PATH_INFO: `/v3/domains` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:30.103462 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed00db9e-2be2-4c0c-a6e8-94dfb88a8764 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:24:30.104558 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed00db9e-2be2-4c0c-a6e8-94dfb88a8764 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:30.109795 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed00db9e-2be2-4c0c-a6e8-94dfb88a8764 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:30.127406 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315ff5ea-e4f2-4d40-8a66-44f5a28d7455 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:30.128923 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315ff5ea-e4f2-4d40-8a66-44f5a28d7455 service cinder] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:30.149022 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 927/1845] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:24:29 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:24:30.150020 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315ff5ea-e4f2-4d40-8a66-44f5a28d7455 service cinder] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:30.157912 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-315ff5ea-e4f2-4d40-8a66-44f5a28d7455 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:30.170079 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 919/1846] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 20 22:24:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:24:30.172088 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a037f8fb-e458-4aa5-963f-5021535b70c1 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:30.172384 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a037f8fb-e458-4aa5-963f-5021535b70c1 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:30.172672 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a037f8fb-e458-4aa5-963f-5021535b70c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:30.277114 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-a037f8fb-e458-4aa5-963f-5021535b70c1 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:24:30.278349 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-a037f8fb-e458-4aa5-963f-5021535b70c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:30.311624 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 920/1847] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:24:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:24:30.312463 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a037f8fb-e458-4aa5-963f-5021535b70c1 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:30.336092 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a037f8fb-e458-4aa5-963f-5021535b70c1 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:30.349587 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668072b4-9d09-44e6-8c6c-33c8b40ef28d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:30.350422 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668072b4-9d09-44e6-8c6c-33c8b40ef28d admin admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:30.350842 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668072b4-9d09-44e6-8c6c-33c8b40ef28d admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:30.351117 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668072b4-9d09-44e6-8c6c-33c8b40ef28d admin admin] PATH_INFO: `/v3/projects` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:30.351938 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668072b4-9d09-44e6-8c6c-33c8b40ef28d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:30.353982 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668072b4-9d09-44e6-8c6c-33c8b40ef28d admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:30.396433 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315ff5ea-e4f2-4d40-8a66-44f5a28d7455 service cinder] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:30.412712 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d46dbd-a697-432c-add6-5d3099ece6a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db7eed561e99452289a662ad326cf919', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:30.414143 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d46dbd-a697-432c-add6-5d3099ece6a9 service nova] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:30.414565 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d46dbd-a697-432c-add6-5d3099ece6a9 service nova] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:30.414946 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d46dbd-a697-432c-add6-5d3099ece6a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:30.419389 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-00d46dbd-a697-432c-add6-5d3099ece6a9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:30.452383 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d46dbd-a697-432c-add6-5d3099ece6a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:30.468286 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d46dbd-a697-432c-add6-5d3099ece6a9 service nova] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:30.470022 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 921/1848] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 20 22:24:30 2022] POST /identity/v3/projects => generated 365 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:24:30.473596 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668072b4-9d09-44e6-8c6c-33c8b40ef28d admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:30.504381 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 928/1849] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:24:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:24:30.505391 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d46dbd-a697-432c-add6-5d3099ece6a9 service nova] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:30.534299 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d46dbd-a697-432c-add6-5d3099ece6a9 service nova] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:30.753761 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668072b4-9d09-44e6-8c6c-33c8b40ef28d admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:30.755734 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47e8a93-26aa-46b7-8129-1e0ae90e1ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:30.757512 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e8a93-26aa-46b7-8129-1e0ae90e1ff9 admin admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:30.758194 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e8a93-26aa-46b7-8129-1e0ae90e1ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:30.758480 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e8a93-26aa-46b7-8129-1e0ae90e1ff9 admin admin] PATH_INFO: `/v3/users` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:30.760938 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47e8a93-26aa-46b7-8129-1e0ae90e1ff9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:30.761165 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d12ada-b78e-4b02-975e-ca6ee2db5848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:30.762170 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d12ada-b78e-4b02-975e-ca6ee2db5848 admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:30.762685 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d12ada-b78e-4b02-975e-ca6ee2db5848 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:30.763162 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d12ada-b78e-4b02-975e-ca6ee2db5848 admin admin] PATH_INFO: `/v3/domains` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:30.764238 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d12ada-b78e-4b02-975e-ca6ee2db5848 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:24:30.764715 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d12ada-b78e-4b02-975e-ca6ee2db5848 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:30.767775 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d12ada-b78e-4b02-975e-ca6ee2db5848 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:30.778534 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47e8a93-26aa-46b7-8129-1e0ae90e1ff9 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:30.786161 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 922/1850] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 20 22:24:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:24:30.790686 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d12ada-b78e-4b02-975e-ca6ee2db5848 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:30.804165 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d12ada-b78e-4b02-975e-ca6ee2db5848 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:30.813046 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70bfd0b-4d73-4bec-98a2-1888fae4725d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:30.814135 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70bfd0b-4d73-4bec-98a2-1888fae4725d admin admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:30.814729 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70bfd0b-4d73-4bec-98a2-1888fae4725d admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:30.815223 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70bfd0b-4d73-4bec-98a2-1888fae4725d admin admin] PATH_INFO: `/v3/projects` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:30.820040 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70bfd0b-4d73-4bec-98a2-1888fae4725d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:30.831136 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70bfd0b-4d73-4bec-98a2-1888fae4725d admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:30.838244 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 929/1851] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 20 22:24:30 2022] POST /identity/v3/users => generated 283 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:24:30.842317 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47e8a93-26aa-46b7-8129-1e0ae90e1ff9 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:30.893715 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47e8a93-26aa-46b7-8129-1e0ae90e1ff9 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:30.914098 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5b9d18-6692-44f3-85af-cd41beae3232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:30.917549 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5b9d18-6692-44f3-85af-cd41beae3232 admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:30.919157 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5b9d18-6692-44f3-85af-cd41beae3232 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:30.920025 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5b9d18-6692-44f3-85af-cd41beae3232 admin admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:30.921339 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5b9d18-6692-44f3-85af-cd41beae3232 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:30.924646 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5b9d18-6692-44f3-85af-cd41beae3232 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:30.952056 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 923/1852] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 20 22:24:30 2022] POST /identity/v3/projects => generated 379 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 20 22:24:30.956765 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70bfd0b-4d73-4bec-98a2-1888fae4725d admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:30.971727 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 930/1853] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:24:30 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:24:30.973705 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5b9d18-6692-44f3-85af-cd41beae3232 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:30.998620 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:31.023808 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5b9d18-6692-44f3-85af-cd41beae3232 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:31.053095 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:31.203052 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70bfd0b-4d73-4bec-98a2-1888fae4725d admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:31.217134 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcdba78-247f-4805-962b-1d983889bd0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:31.218830 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcdba78-247f-4805-962b-1d983889bd0d admin admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:31.219496 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcdba78-247f-4805-962b-1d983889bd0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:31.221300 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcdba78-247f-4805-962b-1d983889bd0d admin admin] PATH_INFO: `/v3/users` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:31.223253 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcdba78-247f-4805-962b-1d983889bd0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:31.228784 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcdba78-247f-4805-962b-1d983889bd0d admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:31.237946 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7373133f-5c17-45e0-babe-823cfac13b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:31.243243 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7373133f-5c17-45e0-babe-823cfac13b4a admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:31.243787 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7373133f-5c17-45e0-babe-823cfac13b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:31.244434 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7373133f-5c17-45e0-babe-823cfac13b4a admin admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:31.245647 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7373133f-5c17-45e0-babe-823cfac13b4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:31.250218 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7373133f-5c17-45e0-babe-823cfac13b4a admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:31.269395 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 924/1854] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 20 22:24:30 2022] POST /identity/v3/users => generated 290 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 20 22:24:31.274835 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcdba78-247f-4805-962b-1d983889bd0d admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:31.301883 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 931/1855] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:24:30 2022] GET /identity/v3/roles => generated 1420 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:24:31.305873 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7373133f-5c17-45e0-babe-823cfac13b4a admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:31.309442 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcdba78-247f-4805-962b-1d983889bd0d admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:31.319299 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326672ce-d216-4e03-8cc1-1eefb01f9456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:31.320967 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326672ce-d216-4e03-8cc1-1eefb01f9456 admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:31.321740 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326672ce-d216-4e03-8cc1-1eefb01f9456 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:31.322398 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326672ce-d216-4e03-8cc1-1eefb01f9456 admin admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:31.323770 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326672ce-d216-4e03-8cc1-1eefb01f9456 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:31.328785 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326672ce-d216-4e03-8cc1-1eefb01f9456 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:31.341233 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7373133f-5c17-45e0-babe-823cfac13b4a admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:31.360796 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 925/1856] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:24:31 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:24:31.363844 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd067847-a9f6-4602-898d-778c8aa1cdf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:31.364727 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd067847-a9f6-4602-898d-778c8aa1cdf3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:31.365148 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326672ce-d216-4e03-8cc1-1eefb01f9456 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:31.365567 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd067847-a9f6-4602-898d-778c8aa1cdf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:31.366177 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd067847-a9f6-4602-898d-778c8aa1cdf3 admin admin] PATH_INFO: `/v3/projects/9d04b6e9a20443c3818bc2fe3055b181/users/d18922eb8cee4f44949a773574573691/roles/604444e7ad0d437dbd1f5a6e02b761f5` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:31.388549 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326672ce-d216-4e03-8cc1-1eefb01f9456 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:31.412338 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab08d128-7aa6-4736-9523-2af3ecfbf0bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:31.413145 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab08d128-7aa6-4736-9523-2af3ecfbf0bb admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:31.415155 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab08d128-7aa6-4736-9523-2af3ecfbf0bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:31.415628 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab08d128-7aa6-4736-9523-2af3ecfbf0bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:31.418470 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab08d128-7aa6-4736-9523-2af3ecfbf0bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:31.421237 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab08d128-7aa6-4736-9523-2af3ecfbf0bb admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:31.434762 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd067847-a9f6-4602-898d-778c8aa1cdf3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d04b6e9a20443c3818bc2fe3055b181, user_id=d18922eb8cee4f44949a773574573691, role_id=604444e7ad0d437dbd1f5a6e02b761f5)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:31.444582 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd067847-a9f6-4602-898d-778c8aa1cdf3 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:31.457202 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 926/1857] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:24:31 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:24:31.460120 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab08d128-7aa6-4736-9523-2af3ecfbf0bb admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:31.477673 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 932/1858] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:24:31 2022] PUT /identity/v3/projects/9d04b6e9a20443c3818bc2fe3055b181/users/d18922eb8cee4f44949a773574573691/roles/604444e7ad0d437dbd1f5a6e02b761f5 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 22:24:31.493954 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4dcfc4-2346-49f9-88c1-2e40fda23b85 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:31.494485 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4dcfc4-2346-49f9-88c1-2e40fda23b85 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:31.495521 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4dcfc4-2346-49f9-88c1-2e40fda23b85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:31.506241 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab08d128-7aa6-4736-9523-2af3ecfbf0bb admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:31.540954 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-5d4dcfc4-2346-49f9-88c1-2e40fda23b85 None None] MFA Rules not processed for user `d18922eb8cee4f44949a773574573691`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:24:31.542782 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-5d4dcfc4-2346-49f9-88c1-2e40fda23b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:31.595318 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71b9d53-55c1-4d7f-a66f-729bf0ab5cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:31.596521 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71b9d53-55c1-4d7f-a66f-729bf0ab5cb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:31.596966 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71b9d53-55c1-4d7f-a66f-729bf0ab5cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:31.597389 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71b9d53-55c1-4d7f-a66f-729bf0ab5cb1 admin admin] PATH_INFO: `/v3/projects/189b7480b0ad4738a613b6c3df0ce301/users/f2eedbc3d86946cf91d291b2bb7790a4/roles/604444e7ad0d437dbd1f5a6e02b761f5` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:31.621007 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71b9d53-55c1-4d7f-a66f-729bf0ab5cb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=189b7480b0ad4738a613b6c3df0ce301, user_id=f2eedbc3d86946cf91d291b2bb7790a4, role_id=604444e7ad0d437dbd1f5a6e02b761f5)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:31.623992 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71b9d53-55c1-4d7f-a66f-729bf0ab5cb1 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:31.652064 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 927/1859] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:24:31 2022] PUT /identity/v3/projects/189b7480b0ad4738a613b6c3df0ce301/users/f2eedbc3d86946cf91d291b2bb7790a4/roles/604444e7ad0d437dbd1f5a6e02b761f5 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:24:31.652064 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71b9d53-55c1-4d7f-a66f-729bf0ab5cb1 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:31.652880 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 933/1860] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:24:31 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 22:24:31.654141 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4dcfc4-2346-49f9-88c1-2e40fda23b85 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:31.670194 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4dcfc4-2346-49f9-88c1-2e40fda23b85 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:31.727940 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71b9d53-55c1-4d7f-a66f-729bf0ab5cb1 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:31.733592 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1397afeb-f457-4694-af2e-5fd375e7b4b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577c8b14c1f4279beac13b9ba11aba1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:31.734595 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1397afeb-f457-4694-af2e-5fd375e7b4b4 service cinder] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:31.734929 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1397afeb-f457-4694-af2e-5fd375e7b4b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:31.735358 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1397afeb-f457-4694-af2e-5fd375e7b4b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:31.738542 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-1397afeb-f457-4694-af2e-5fd375e7b4b4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:31.741269 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5fc6c1-99c8-4b2b-97a0-76ca43b1c9c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:31.742069 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5fc6c1-99c8-4b2b-97a0-76ca43b1c9c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:31.742498 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5fc6c1-99c8-4b2b-97a0-76ca43b1c9c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:31.743110 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5fc6c1-99c8-4b2b-97a0-76ca43b1c9c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:31.744396 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5fc6c1-99c8-4b2b-97a0-76ca43b1c9c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:31.747291 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5fc6c1-99c8-4b2b-97a0-76ca43b1c9c9 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:31.761371 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:31.777666 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:31.790527 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 934/1861] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 20 22:24:31 2022] POST /identity/v3/projects => generated 367 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:24:31.792774 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f755de-439e-4134-abaf-e645cb487f6e None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:31.792948 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f755de-439e-4134-abaf-e645cb487f6e None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:31.793226 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f755de-439e-4134-abaf-e645cb487f6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:31.830557 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-d0f755de-439e-4134-abaf-e645cb487f6e None None] MFA Rules not processed for user `f2eedbc3d86946cf91d291b2bb7790a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:24:31.831021 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1397afeb-f457-4694-af2e-5fd375e7b4b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:31.831951 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-d0f755de-439e-4134-abaf-e645cb487f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:31.832661 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1397afeb-f457-4694-af2e-5fd375e7b4b4 service cinder] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:31.843171 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 928/1862] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:24:31 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:24:31.843993 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1397afeb-f457-4694-af2e-5fd375e7b4b4 service cinder] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:31.856837 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1397afeb-f457-4694-af2e-5fd375e7b4b4 service cinder] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:31.903451 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 935/1863] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:24:31 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:24:31.908005 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f755de-439e-4134-abaf-e645cb487f6e None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:31.918367 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3739eb77-fcb4-47ef-afbc-1a0197784747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:31.919122 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3739eb77-fcb4-47ef-afbc-1a0197784747 admin admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:31.919467 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3739eb77-fcb4-47ef-afbc-1a0197784747 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:31.919749 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3739eb77-fcb4-47ef-afbc-1a0197784747 admin admin] PATH_INFO: `/v3/users` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:31.920942 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3739eb77-fcb4-47ef-afbc-1a0197784747 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:31.923182 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3739eb77-fcb4-47ef-afbc-1a0197784747 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:31.959664 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 929/1864] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 20 22:24:31 2022] POST /identity/v3/users => generated 290 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:24:31.963263 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3739eb77-fcb4-47ef-afbc-1a0197784747 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:31.980175 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3739eb77-fcb4-47ef-afbc-1a0197784747 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:31.985130 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07223d7-029c-4934-8171-9859ece10ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:31.985633 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07223d7-029c-4934-8171-9859ece10ce3 admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:31.985908 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07223d7-029c-4934-8171-9859ece10ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:31.986178 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07223d7-029c-4934-8171-9859ece10ce3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:31.987029 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07223d7-029c-4934-8171-9859ece10ce3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:31.988599 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f755de-439e-4134-abaf-e645cb487f6e None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:31.989075 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07223d7-029c-4934-8171-9859ece10ce3 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:31.997855 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49010fe-51e9-4b78-9b92-c794fd434f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:31.998913 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49010fe-51e9-4b78-9b92-c794fd434f9e admin admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:31.999202 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49010fe-51e9-4b78-9b92-c794fd434f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:31.999481 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49010fe-51e9-4b78-9b92-c794fd434f9e admin admin] PATH_INFO: `/v3/projects` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:32.000089 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 930/1865] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:24:31 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:24:32.003055 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49010fe-51e9-4b78-9b92-c794fd434f9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:32.005065 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49010fe-51e9-4b78-9b92-c794fd434f9e admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:32.006041 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07223d7-029c-4934-8171-9859ece10ce3 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:32.020088 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07223d7-029c-4934-8171-9859ece10ce3 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:32.033618 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96e86e3-5c78-4f90-a0b4-108fd5ad7983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:32.034802 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96e86e3-5c78-4f90-a0b4-108fd5ad7983 admin admin] REQUEST_METHOD: `PUT` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:32.035085 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96e86e3-5c78-4f90-a0b4-108fd5ad7983 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:32.035373 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96e86e3-5c78-4f90-a0b4-108fd5ad7983 admin admin] PATH_INFO: `/v3/projects/3450ea8885984e6d8a6cf7cc0af17583/users/275c51a3ca7f453ebd1c45a6a3521180/roles/8a829170b29d42d6af589399e51edb0f` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:32.064295 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 936/1866] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 20 22:24:31 2022] POST /identity/v3/projects => generated 377 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 20 22:24:32.065108 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96e86e3-5c78-4f90-a0b4-108fd5ad7983 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3450ea8885984e6d8a6cf7cc0af17583, user_id=275c51a3ca7f453ebd1c45a6a3521180, role_id=8a829170b29d42d6af589399e51edb0f)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:32.067514 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49010fe-51e9-4b78-9b92-c794fd434f9e admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:32.067896 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96e86e3-5c78-4f90-a0b4-108fd5ad7983 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:32.086623 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 931/1867] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:24:32 2022] PUT /identity/v3/projects/3450ea8885984e6d8a6cf7cc0af17583/users/275c51a3ca7f453ebd1c45a6a3521180/roles/8a829170b29d42d6af589399e51edb0f => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:24:32.091367 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96e86e3-5c78-4f90-a0b4-108fd5ad7983 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:32.180112 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96e86e3-5c78-4f90-a0b4-108fd5ad7983 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:32.185299 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df875d2c-e56a-4e04-8775-67ef97ddad4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:32.185999 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df875d2c-e56a-4e04-8775-67ef97ddad4e admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:32.186348 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df875d2c-e56a-4e04-8775-67ef97ddad4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:32.186763 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df875d2c-e56a-4e04-8775-67ef97ddad4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:32.187486 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df875d2c-e56a-4e04-8775-67ef97ddad4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:32.189192 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df875d2c-e56a-4e04-8775-67ef97ddad4e admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:32.189696 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49010fe-51e9-4b78-9b92-c794fd434f9e admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:32.201711 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7958d13-cfea-4bda-9fbf-769968d26932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:32.201711 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7958d13-cfea-4bda-9fbf-769968d26932 admin admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:32.202021 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7958d13-cfea-4bda-9fbf-769968d26932 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:32.202307 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7958d13-cfea-4bda-9fbf-769968d26932 admin admin] PATH_INFO: `/v3/users` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:32.202982 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7958d13-cfea-4bda-9fbf-769968d26932 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:32.205603 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7958d13-cfea-4bda-9fbf-769968d26932 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:32.209831 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 932/1868] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:24:32 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:24:32.225887 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df875d2c-e56a-4e04-8775-67ef97ddad4e admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:32.240121 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df875d2c-e56a-4e04-8775-67ef97ddad4e admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:32.244877 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 937/1869] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 20 22:24:32 2022] POST /identity/v3/users => generated 295 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:24:32.246169 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7958d13-cfea-4bda-9fbf-769968d26932 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:32.251560 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649076ed-9c91-49aa-9688-eafc00946bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:32.252483 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649076ed-9c91-49aa-9688-eafc00946bd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:32.252829 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649076ed-9c91-49aa-9688-eafc00946bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:32.253210 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649076ed-9c91-49aa-9688-eafc00946bd2 admin admin] PATH_INFO: `/v3/projects/3450ea8885984e6d8a6cf7cc0af17583/users/275c51a3ca7f453ebd1c45a6a3521180/roles/8a829170b29d42d6af589399e51edb0f` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:32.255967 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649076ed-9c91-49aa-9688-eafc00946bd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3450ea8885984e6d8a6cf7cc0af17583, user_id=275c51a3ca7f453ebd1c45a6a3521180, role_id=8a829170b29d42d6af589399e51edb0f)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:32.259424 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649076ed-9c91-49aa-9688-eafc00946bd2 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:32.262830 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:32.265438 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:32.280107 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 933/1870] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:24:32 2022] PUT /identity/v3/projects/3450ea8885984e6d8a6cf7cc0af17583/users/275c51a3ca7f453ebd1c45a6a3521180/roles/8a829170b29d42d6af589399e51edb0f => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:24:32.290674 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7958d13-cfea-4bda-9fbf-769968d26932 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:32.295898 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac58d0d-b7f8-4233-82c2-463f50b90f56 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:32.296183 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac58d0d-b7f8-4233-82c2-463f50b90f56 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:32.296509 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac58d0d-b7f8-4233-82c2-463f50b90f56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:32.363794 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-dac58d0d-b7f8-4233-82c2-463f50b90f56 None None] MFA Rules not processed for user `275c51a3ca7f453ebd1c45a6a3521180`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:24:32.365017 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-dac58d0d-b7f8-4233-82c2-463f50b90f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:32.403088 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46c0481-4b8d-4170-9cd3-e3480e15457e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:32.403649 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46c0481-4b8d-4170-9cd3-e3480e15457e admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:32.403930 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46c0481-4b8d-4170-9cd3-e3480e15457e admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:32.404214 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46c0481-4b8d-4170-9cd3-e3480e15457e admin admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:32.404857 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46c0481-4b8d-4170-9cd3-e3480e15457e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:32.406424 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46c0481-4b8d-4170-9cd3-e3480e15457e admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:32.421823 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 938/1871] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:24:32 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:24:32.422973 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46c0481-4b8d-4170-9cd3-e3480e15457e admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:32.433857 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46c0481-4b8d-4170-9cd3-e3480e15457e admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:32.439018 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c7302c-ea35-42a2-800a-951094eb9842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:32.439630 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c7302c-ea35-42a2-800a-951094eb9842 admin admin] REQUEST_METHOD: `PUT` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:32.439909 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c7302c-ea35-42a2-800a-951094eb9842 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:32.440232 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c7302c-ea35-42a2-800a-951094eb9842 admin admin] PATH_INFO: `/v3/projects/f4fd2ea342ed4f9893278d716863f133/users/f111eadc30a94244a4c5516f8029cc7b/roles/8a829170b29d42d6af589399e51edb0f` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:32.442209 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 934/1872] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:24:32 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:24:32.453333 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac58d0d-b7f8-4233-82c2-463f50b90f56 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:32.457557 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c7302c-ea35-42a2-800a-951094eb9842 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4fd2ea342ed4f9893278d716863f133, user_id=f111eadc30a94244a4c5516f8029cc7b, role_id=8a829170b29d42d6af589399e51edb0f)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:32.459809 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c7302c-ea35-42a2-800a-951094eb9842 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:32.476997 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 939/1873] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:24:32 2022] PUT /identity/v3/projects/f4fd2ea342ed4f9893278d716863f133/users/f111eadc30a94244a4c5516f8029cc7b/roles/8a829170b29d42d6af589399e51edb0f => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:24:32.480946 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c7302c-ea35-42a2-800a-951094eb9842 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:32.516474 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac58d0d-b7f8-4233-82c2-463f50b90f56 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:32.554270 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c7302c-ea35-42a2-800a-951094eb9842 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:32.559082 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bec1d9-fdc6-4dad-87a6-14ba06835012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:32.559736 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bec1d9-fdc6-4dad-87a6-14ba06835012 admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:32.560018 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bec1d9-fdc6-4dad-87a6-14ba06835012 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:32.560285 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bec1d9-fdc6-4dad-87a6-14ba06835012 admin admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:32.561373 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bec1d9-fdc6-4dad-87a6-14ba06835012 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:32.562989 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bec1d9-fdc6-4dad-87a6-14ba06835012 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:32.572030 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f320545-e72b-42d1-8459-56f277762b1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577c8b14c1f4279beac13b9ba11aba1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:32.572653 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f320545-e72b-42d1-8459-56f277762b1a service cinder] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:32.573480 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f320545-e72b-42d1-8459-56f277762b1a service cinder] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:32.573751 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f320545-e72b-42d1-8459-56f277762b1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:32.574321 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 940/1874] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:24:32 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 20 22:24:32.578446 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bec1d9-fdc6-4dad-87a6-14ba06835012 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:32.589001 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bec1d9-fdc6-4dad-87a6-14ba06835012 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:32.594006 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda55b0a-cbac-4dc9-b868-d5edb83869cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:32.595216 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda55b0a-cbac-4dc9-b868-d5edb83869cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:32.595595 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda55b0a-cbac-4dc9-b868-d5edb83869cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:32.595879 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda55b0a-cbac-4dc9-b868-d5edb83869cf admin admin] PATH_INFO: `/v3/projects/f4fd2ea342ed4f9893278d716863f133/users/f111eadc30a94244a4c5516f8029cc7b/roles/8a829170b29d42d6af589399e51edb0f` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:32.599828 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda55b0a-cbac-4dc9-b868-d5edb83869cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4fd2ea342ed4f9893278d716863f133, user_id=f111eadc30a94244a4c5516f8029cc7b, role_id=8a829170b29d42d6af589399e51edb0f)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:32.602622 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda55b0a-cbac-4dc9-b868-d5edb83869cf admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:32.614735 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 941/1875] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:24:32 2022] PUT /identity/v3/projects/f4fd2ea342ed4f9893278d716863f133/users/f111eadc30a94244a4c5516f8029cc7b/roles/8a829170b29d42d6af589399e51edb0f => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:24:32.625694 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20702f4-6ef6-4f9a-b77e-7340d513cf55 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:32.625983 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20702f4-6ef6-4f9a-b77e-7340d513cf55 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:32.626266 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20702f4-6ef6-4f9a-b77e-7340d513cf55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:32.631091 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:32.646141 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f320545-e72b-42d1-8459-56f277762b1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:32.647610 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f320545-e72b-42d1-8459-56f277762b1a service cinder] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:32.657847 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-e20702f4-6ef6-4f9a-b77e-7340d513cf55 None None] MFA Rules not processed for user `f111eadc30a94244a4c5516f8029cc7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:24:32.657985 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 935/1876] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:24:32 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 20 22:24:32.658968 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-e20702f4-6ef6-4f9a-b77e-7340d513cf55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:32.714063 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:32.741426 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 942/1877] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:24:32 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 22:24:32.752692 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f320545-e72b-42d1-8459-56f277762b1a service cinder] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:32.754196 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-5f320545-e72b-42d1-8459-56f277762b1a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:32.767984 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f320545-e72b-42d1-8459-56f277762b1a service cinder] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:32.832805 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586fcb1f-9107-455f-b8ad-797715b79484 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577c8b14c1f4279beac13b9ba11aba1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:32.833803 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586fcb1f-9107-455f-b8ad-797715b79484 service cinder] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:32.834305 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586fcb1f-9107-455f-b8ad-797715b79484 service cinder] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:32.834674 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586fcb1f-9107-455f-b8ad-797715b79484 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:32.929886 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586fcb1f-9107-455f-b8ad-797715b79484 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:32.931316 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586fcb1f-9107-455f-b8ad-797715b79484 service cinder] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:32.941809 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 936/1878] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:24:32 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:24:34.362710 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20702f4-6ef6-4f9a-b77e-7340d513cf55 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:34.372843 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20702f4-6ef6-4f9a-b77e-7340d513cf55 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:34.376406 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cfe915-8ede-464f-b4be-ada52a2dd207 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577c8b14c1f4279beac13b9ba11aba1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:34.377012 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cfe915-8ede-464f-b4be-ada52a2dd207 service cinder] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:34.377290 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cfe915-8ede-464f-b4be-ada52a2dd207 service cinder] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:34.377598 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cfe915-8ede-464f-b4be-ada52a2dd207 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:34.391063 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cfe915-8ede-464f-b4be-ada52a2dd207 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:34.392527 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cfe915-8ede-464f-b4be-ada52a2dd207 service cinder] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:34.405304 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 943/1879] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:24:34 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:24:34.464836 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586fcb1f-9107-455f-b8ad-797715b79484 service cinder] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:34.529450 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586fcb1f-9107-455f-b8ad-797715b79484 service cinder] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:34.534227 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf75a18-0f68-4d26-8210-58719c15d724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:34.534839 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf75a18-0f68-4d26-8210-58719c15d724 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:34.535110 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf75a18-0f68-4d26-8210-58719c15d724 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:34.535386 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf75a18-0f68-4d26-8210-58719c15d724 admin admin] PATH_INFO: `/v3/users/d18922eb8cee4f44949a773574573691` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:34.536522 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf75a18-0f68-4d26-8210-58719c15d724 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d18922eb8cee4f44949a773574573691)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:34.538459 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf75a18-0f68-4d26-8210-58719c15d724 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:34.580775 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:34.586823 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-aaf75a18-0f68-4d26-8210-58719c15d724 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd18922eb8cee4f44949a773574573691'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:34.593791 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-aaf75a18-0f68-4d26-8210-58719c15d724 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd18922eb8cee4f44949a773574573691'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:34.594422 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-aaf75a18-0f68-4d26-8210-58719c15d724 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd18922eb8cee4f44949a773574573691'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:34.595061 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-aaf75a18-0f68-4d26-8210-58719c15d724 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd18922eb8cee4f44949a773574573691'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:34.602284 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-aaf75a18-0f68-4d26-8210-58719c15d724 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd18922eb8cee4f44949a773574573691'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:34.620201 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 937/1880] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 20 22:24:34 2022] DELETE /identity/v3/users/d18922eb8cee4f44949a773574573691 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:24:34.624822 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf83096-12e5-4b68-af62-82429dd6e710 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:34.625121 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf83096-12e5-4b68-af62-82429dd6e710 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:34.625393 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf83096-12e5-4b68-af62-82429dd6e710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:34.644538 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-faf83096-12e5-4b68-af62-82429dd6e710 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:24:34.645723 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-faf83096-12e5-4b68-af62-82429dd6e710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:34.704157 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 944/1881] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:24:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 22:24:34.713771 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf75a18-0f68-4d26-8210-58719c15d724 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:34.715355 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-aaf75a18-0f68-4d26-8210-58719c15d724 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:34.771901 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf75a18-0f68-4d26-8210-58719c15d724 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:34.775560 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d60cd2d-7b15-4fdc-8544-5dd15a3b9800 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b0b3ca4ecd41aaba9cf8e0f91fbf54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:34.776514 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d60cd2d-7b15-4fdc-8544-5dd15a3b9800 service neutron] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:34.776803 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d60cd2d-7b15-4fdc-8544-5dd15a3b9800 service neutron] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:34.777075 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d60cd2d-7b15-4fdc-8544-5dd15a3b9800 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:34.785878 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d60cd2d-7b15-4fdc-8544-5dd15a3b9800 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:34.787325 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d60cd2d-7b15-4fdc-8544-5dd15a3b9800 service neutron] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:34.797703 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 938/1882] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:24:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:24:35.198630 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf83096-12e5-4b68-af62-82429dd6e710 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:35.200154 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-faf83096-12e5-4b68-af62-82429dd6e710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:35.228775 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf83096-12e5-4b68-af62-82429dd6e710 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:35.240387 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad35770c-cc0b-47bb-84a8-561181e9c9b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:35.240918 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad35770c-cc0b-47bb-84a8-561181e9c9b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:35.241207 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad35770c-cc0b-47bb-84a8-561181e9c9b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:35.241519 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad35770c-cc0b-47bb-84a8-561181e9c9b2 admin admin] PATH_INFO: `/v3/projects/9d04b6e9a20443c3818bc2fe3055b181` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:35.243788 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad35770c-cc0b-47bb-84a8-561181e9c9b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d04b6e9a20443c3818bc2fe3055b181)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:35.245717 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad35770c-cc0b-47bb-84a8-561181e9c9b2 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:35.369931 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-ad35770c-cc0b-47bb-84a8-561181e9c9b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d04b6e9a20443c3818bc2fe3055b181', 'request_id': 'req-ad35770c-cc0b-47bb-84a8-561181e9c9b2'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:35.376866 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-ad35770c-cc0b-47bb-84a8-561181e9c9b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d04b6e9a20443c3818bc2fe3055b181', 'request_id': 'req-ad35770c-cc0b-47bb-84a8-561181e9c9b2'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:35.386427 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-ad35770c-cc0b-47bb-84a8-561181e9c9b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d04b6e9a20443c3818bc2fe3055b181', 'request_id': 'req-ad35770c-cc0b-47bb-84a8-561181e9c9b2'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:35.400372 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-ad35770c-cc0b-47bb-84a8-561181e9c9b2 admin admin] The token cache is being invalidate because project 9d04b6e9a20443c3818bc2fe3055b181 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81306) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 22:24:35.401187 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-ad35770c-cc0b-47bb-84a8-561181e9c9b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:35.401862 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-ad35770c-cc0b-47bb-84a8-561181e9c9b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:35.403711 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 945/1883] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 20 22:24:35 2022] DELETE /identity/v3/projects/9d04b6e9a20443c3818bc2fe3055b181 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:24:35.408154 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d60cd2d-7b15-4fdc-8544-5dd15a3b9800 service neutron] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:35.424274 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d60cd2d-7b15-4fdc-8544-5dd15a3b9800 service neutron] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:35.503698 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba290a86-8516-4521-81af-5152822d02e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:35.504901 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba290a86-8516-4521-81af-5152822d02e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:35.504901 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba290a86-8516-4521-81af-5152822d02e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:35.505070 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba290a86-8516-4521-81af-5152822d02e9 admin admin] PATH_INFO: `/v3/users/275c51a3ca7f453ebd1c45a6a3521180` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:35.506249 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba290a86-8516-4521-81af-5152822d02e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=275c51a3ca7f453ebd1c45a6a3521180)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:35.508382 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba290a86-8516-4521-81af-5152822d02e9 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:35.563863 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-ba290a86-8516-4521-81af-5152822d02e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '275c51a3ca7f453ebd1c45a6a3521180'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:35.571618 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-ba290a86-8516-4521-81af-5152822d02e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '275c51a3ca7f453ebd1c45a6a3521180'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:35.572254 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-ba290a86-8516-4521-81af-5152822d02e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '275c51a3ca7f453ebd1c45a6a3521180'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:35.573534 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-ba290a86-8516-4521-81af-5152822d02e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '275c51a3ca7f453ebd1c45a6a3521180'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:35.580669 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-ba290a86-8516-4521-81af-5152822d02e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '275c51a3ca7f453ebd1c45a6a3521180'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:35.581781 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:35.600534 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 939/1884] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 20 22:24:35 2022] DELETE /identity/v3/users/275c51a3ca7f453ebd1c45a6a3521180 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 22:24:35.888694 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad35770c-cc0b-47bb-84a8-561181e9c9b2 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:35.890166 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-ad35770c-cc0b-47bb-84a8-561181e9c9b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:35.910496 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad35770c-cc0b-47bb-84a8-561181e9c9b2 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:35.966977 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:35.974993 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910a145c-e313-43fe-812e-163b589490c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:35.975828 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a145c-e313-43fe-812e-163b589490c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:35.976321 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a145c-e313-43fe-812e-163b589490c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:35.976831 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a145c-e313-43fe-812e-163b589490c3 admin admin] PATH_INFO: `/v3/projects/3450ea8885984e6d8a6cf7cc0af17583` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:35.978196 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910a145c-e313-43fe-812e-163b589490c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3450ea8885984e6d8a6cf7cc0af17583)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:35.980199 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910a145c-e313-43fe-812e-163b589490c3 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:36.027444 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-910a145c-e313-43fe-812e-163b589490c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3450ea8885984e6d8a6cf7cc0af17583', 'request_id': 'req-910a145c-e313-43fe-812e-163b589490c3'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:36.033520 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-910a145c-e313-43fe-812e-163b589490c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3450ea8885984e6d8a6cf7cc0af17583', 'request_id': 'req-910a145c-e313-43fe-812e-163b589490c3'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:36.041686 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-910a145c-e313-43fe-812e-163b589490c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3450ea8885984e6d8a6cf7cc0af17583', 'request_id': 'req-910a145c-e313-43fe-812e-163b589490c3'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:36.054777 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-910a145c-e313-43fe-812e-163b589490c3 admin admin] The token cache is being invalidate because project 3450ea8885984e6d8a6cf7cc0af17583 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81306) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 22:24:36.055062 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-910a145c-e313-43fe-812e-163b589490c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:36.055713 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-910a145c-e313-43fe-812e-163b589490c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:36.057736 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 946/1885] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 20 22:24:35 2022] DELETE /identity/v3/projects/3450ea8885984e6d8a6cf7cc0af17583 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:24:36.062728 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a04b78-c115-4bae-bf54-307c6db4a1a9 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:36.063015 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a04b78-c115-4bae-bf54-307c6db4a1a9 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:36.063292 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a04b78-c115-4bae-bf54-307c6db4a1a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:36.082984 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-95a04b78-c115-4bae-bf54-307c6db4a1a9 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:24:36.084177 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-95a04b78-c115-4bae-bf54-307c6db4a1a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:36.144824 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 940/1886] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:24:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:24:36.152615 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0648bc02-ce6d-4b6b-945b-d55025f33038 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:36.152929 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0648bc02-ce6d-4b6b-945b-d55025f33038 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:36.153208 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0648bc02-ce6d-4b6b-945b-d55025f33038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:36.173936 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-0648bc02-ce6d-4b6b-945b-d55025f33038 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:24:36.175177 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-0648bc02-ce6d-4b6b-945b-d55025f33038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:36.183571 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 947/1887] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:24:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:24:36.187695 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a04b78-c115-4bae-bf54-307c6db4a1a9 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:36.197136 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a04b78-c115-4bae-bf54-307c6db4a1a9 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:36.201916 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f8be61-fdd1-4fd1-ad9c-fd122dca7412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:36.202540 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f8be61-fdd1-4fd1-ad9c-fd122dca7412 admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:36.202819 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f8be61-fdd1-4fd1-ad9c-fd122dca7412 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:36.203092 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f8be61-fdd1-4fd1-ad9c-fd122dca7412 admin admin] PATH_INFO: `/v3/domains` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:36.203761 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f8be61-fdd1-4fd1-ad9c-fd122dca7412 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:24:36.204059 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f8be61-fdd1-4fd1-ad9c-fd122dca7412 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:36.205654 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f8be61-fdd1-4fd1-ad9c-fd122dca7412 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:36.218318 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 941/1888] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 20 22:24:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:24:36.222490 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0648bc02-ce6d-4b6b-945b-d55025f33038 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:36.232466 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0648bc02-ce6d-4b6b-945b-d55025f33038 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:36.237070 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f3f2e2-885f-47a2-b7e6-9ed94e74c2c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:36.237679 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f3f2e2-885f-47a2-b7e6-9ed94e74c2c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:36.237960 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f3f2e2-885f-47a2-b7e6-9ed94e74c2c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:36.238228 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f3f2e2-885f-47a2-b7e6-9ed94e74c2c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:36.238903 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f3f2e2-885f-47a2-b7e6-9ed94e74c2c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:36.240791 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f3f2e2-885f-47a2-b7e6-9ed94e74c2c6 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:36.270930 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 948/1889] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 20 22:24:36 2022] POST /identity/v3/projects => generated 391 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 20 22:24:36.275227 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f8be61-fdd1-4fd1-ad9c-fd122dca7412 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:36.286617 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f8be61-fdd1-4fd1-ad9c-fd122dca7412 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:36.388152 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21adc834-797f-434b-a1f7-c828701b9651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:36.388855 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21adc834-797f-434b-a1f7-c828701b9651 admin admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:36.389241 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21adc834-797f-434b-a1f7-c828701b9651 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:36.389515 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21adc834-797f-434b-a1f7-c828701b9651 admin admin] PATH_INFO: `/v3/users` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:36.390214 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21adc834-797f-434b-a1f7-c828701b9651 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:36.392498 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21adc834-797f-434b-a1f7-c828701b9651 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:36.426071 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 942/1890] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 20 22:24:36 2022] POST /identity/v3/users => generated 296 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 20 22:24:36.430347 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f3f2e2-885f-47a2-b7e6-9ed94e74c2c6 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:36.445669 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f3f2e2-885f-47a2-b7e6-9ed94e74c2c6 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:36.451438 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f39b509-f2d3-43d2-a547-a4e84161bae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:36.452126 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f39b509-f2d3-43d2-a547-a4e84161bae3 admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:36.452558 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f39b509-f2d3-43d2-a547-a4e84161bae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:36.452952 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f39b509-f2d3-43d2-a547-a4e84161bae3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:36.453899 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f39b509-f2d3-43d2-a547-a4e84161bae3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:36.455480 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f39b509-f2d3-43d2-a547-a4e84161bae3 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:36.467665 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 949/1891] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:24:36 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:24:36.471451 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21adc834-797f-434b-a1f7-c828701b9651 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:36.483681 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21adc834-797f-434b-a1f7-c828701b9651 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:36.489357 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef121549-71d2-4e12-bc91-4a103364c7bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:36.490035 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef121549-71d2-4e12-bc91-4a103364c7bf admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:36.490378 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef121549-71d2-4e12-bc91-4a103364c7bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:36.490748 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef121549-71d2-4e12-bc91-4a103364c7bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:36.491455 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef121549-71d2-4e12-bc91-4a103364c7bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:36.493496 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef121549-71d2-4e12-bc91-4a103364c7bf admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:36.507387 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 943/1892] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:24:36 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:24:36.511192 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f39b509-f2d3-43d2-a547-a4e84161bae3 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:36.524524 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f39b509-f2d3-43d2-a547-a4e84161bae3 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:36.537939 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023c8277-80c8-462a-9d9f-a8b03327f1e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:36.538664 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023c8277-80c8-462a-9d9f-a8b03327f1e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:36.538941 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023c8277-80c8-462a-9d9f-a8b03327f1e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:36.539217 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023c8277-80c8-462a-9d9f-a8b03327f1e3 admin admin] PATH_INFO: `/v3/projects/0d8513090dc24b0ab3204b47d934e742/users/0ecff300895b413486739cefcc32d400/roles/604444e7ad0d437dbd1f5a6e02b761f5` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:36.573101 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023c8277-80c8-462a-9d9f-a8b03327f1e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d8513090dc24b0ab3204b47d934e742, user_id=0ecff300895b413486739cefcc32d400, role_id=604444e7ad0d437dbd1f5a6e02b761f5)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:36.582644 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023c8277-80c8-462a-9d9f-a8b03327f1e3 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:36.583870 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef121549-71d2-4e12-bc91-4a103364c7bf admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:36.586163 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-ef121549-71d2-4e12-bc91-4a103364c7bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:36.600956 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 950/1893] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:24:36 2022] PUT /identity/v3/projects/0d8513090dc24b0ab3204b47d934e742/users/0ecff300895b413486739cefcc32d400/roles/604444e7ad0d437dbd1f5a6e02b761f5 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 22:24:36.614469 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da9a3a9-4eb1-45d3-bbcc-48a398b155ab None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:36.614469 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da9a3a9-4eb1-45d3-bbcc-48a398b155ab None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:36.614469 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da9a3a9-4eb1-45d3-bbcc-48a398b155ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:36.663579 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-6da9a3a9-4eb1-45d3-bbcc-48a398b155ab None None] MFA Rules not processed for user `0ecff300895b413486739cefcc32d400`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:24:36.664924 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-6da9a3a9-4eb1-45d3-bbcc-48a398b155ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:36.688291 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:36.696790 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef121549-71d2-4e12-bc91-4a103364c7bf admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:36.776577 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2102dc-93bc-4977-9e35-7b1c0632148f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577c8b14c1f4279beac13b9ba11aba1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:36.777209 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2102dc-93bc-4977-9e35-7b1c0632148f service cinder] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:36.777493 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2102dc-93bc-4977-9e35-7b1c0632148f service cinder] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:36.777782 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2102dc-93bc-4977-9e35-7b1c0632148f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:36.779952 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-2e2102dc-93bc-4977-9e35-7b1c0632148f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:36.782581 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 951/1894] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:24:36 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 22:24:36.785388 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da9a3a9-4eb1-45d3-bbcc-48a398b155ab None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:36.799282 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:36.850494 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2102dc-93bc-4977-9e35-7b1c0632148f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:36.852003 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2102dc-93bc-4977-9e35-7b1c0632148f service cinder] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:36.857014 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da9a3a9-4eb1-45d3-bbcc-48a398b155ab None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:36.861587 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 944/1895] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:24:36 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:24:36.861725 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442aa7a7-0c5a-4c94-bff7-d240d0e6673e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:36.862136 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442aa7a7-0c5a-4c94-bff7-d240d0e6673e admin admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:36.862412 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442aa7a7-0c5a-4c94-bff7-d240d0e6673e admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:36.862728 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442aa7a7-0c5a-4c94-bff7-d240d0e6673e admin admin] PATH_INFO: `/v3/projects` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:36.863332 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442aa7a7-0c5a-4c94-bff7-d240d0e6673e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:36.865212 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442aa7a7-0c5a-4c94-bff7-d240d0e6673e admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:36.891843 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 952/1896] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 20 22:24:36 2022] POST /identity/v3/projects => generated 393 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 20 22:24:36.895769 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2102dc-93bc-4977-9e35-7b1c0632148f service cinder] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:36.906852 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2102dc-93bc-4977-9e35-7b1c0632148f service cinder] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:36.971552 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084173f3-0e5a-4e45-ae7d-717f7bfcff03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:36.972541 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084173f3-0e5a-4e45-ae7d-717f7bfcff03 admin admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:36.972541 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084173f3-0e5a-4e45-ae7d-717f7bfcff03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:36.972743 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084173f3-0e5a-4e45-ae7d-717f7bfcff03 admin admin] PATH_INFO: `/v3/users` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:36.973356 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084173f3-0e5a-4e45-ae7d-717f7bfcff03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:36.975330 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084173f3-0e5a-4e45-ae7d-717f7bfcff03 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:36.999741 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 945/1897] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 20 22:24:36 2022] POST /identity/v3/users => generated 303 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:24:37.004096 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442aa7a7-0c5a-4c94-bff7-d240d0e6673e admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:37.016281 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442aa7a7-0c5a-4c94-bff7-d240d0e6673e admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:37.021751 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a368e872-edbf-43d3-b9c9-97bfbf5956c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:37.022484 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a368e872-edbf-43d3-b9c9-97bfbf5956c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:37.022921 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a368e872-edbf-43d3-b9c9-97bfbf5956c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:37.023307 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a368e872-edbf-43d3-b9c9-97bfbf5956c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:37.024024 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a368e872-edbf-43d3-b9c9-97bfbf5956c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:37.026375 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a368e872-edbf-43d3-b9c9-97bfbf5956c2 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:37.040946 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 953/1898] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:24:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:24:37.043806 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084173f3-0e5a-4e45-ae7d-717f7bfcff03 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:37.058867 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084173f3-0e5a-4e45-ae7d-717f7bfcff03 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:37.066900 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d413353a-2113-49b5-aff0-28ac93da186e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:37.067689 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d413353a-2113-49b5-aff0-28ac93da186e admin admin] REQUEST_METHOD: `PUT` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:37.068428 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d413353a-2113-49b5-aff0-28ac93da186e admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:37.068428 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d413353a-2113-49b5-aff0-28ac93da186e admin admin] PATH_INFO: `/v3/projects/554a91343cda411482be11a2dc37a39d/users/8c5e953e9d93403a8974c914e8d66136/roles/8a829170b29d42d6af589399e51edb0f` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:37.089503 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d413353a-2113-49b5-aff0-28ac93da186e admin admin] RBAC: Authorizing `identity:create_grant(project_id=554a91343cda411482be11a2dc37a39d, user_id=8c5e953e9d93403a8974c914e8d66136, role_id=8a829170b29d42d6af589399e51edb0f)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:37.092578 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d413353a-2113-49b5-aff0-28ac93da186e admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:37.107929 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 946/1899] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:24:37 2022] PUT /identity/v3/projects/554a91343cda411482be11a2dc37a39d/users/8c5e953e9d93403a8974c914e8d66136/roles/8a829170b29d42d6af589399e51edb0f => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:24:37.112033 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a368e872-edbf-43d3-b9c9-97bfbf5956c2 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:37.126454 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a368e872-edbf-43d3-b9c9-97bfbf5956c2 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:37.194994 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f818bb83-57a0-4e30-989a-5bad3bcbb039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:37.195700 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f818bb83-57a0-4e30-989a-5bad3bcbb039 admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:37.195846 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f818bb83-57a0-4e30-989a-5bad3bcbb039 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:37.196120 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f818bb83-57a0-4e30-989a-5bad3bcbb039 admin admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:37.196766 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f818bb83-57a0-4e30-989a-5bad3bcbb039 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:37.198988 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f818bb83-57a0-4e30-989a-5bad3bcbb039 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:37.210613 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 954/1900] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:24:37 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:24:37.214791 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d413353a-2113-49b5-aff0-28ac93da186e admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:37.231572 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d413353a-2113-49b5-aff0-28ac93da186e admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:37.237292 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cfef94-1532-4d8e-ad8c-3c838c5170b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:37.238137 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cfef94-1532-4d8e-ad8c-3c838c5170b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:37.238422 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cfef94-1532-4d8e-ad8c-3c838c5170b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:37.238766 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cfef94-1532-4d8e-ad8c-3c838c5170b7 admin admin] PATH_INFO: `/v3/projects/554a91343cda411482be11a2dc37a39d/users/8c5e953e9d93403a8974c914e8d66136/roles/8a829170b29d42d6af589399e51edb0f` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:37.240888 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cfef94-1532-4d8e-ad8c-3c838c5170b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=554a91343cda411482be11a2dc37a39d, user_id=8c5e953e9d93403a8974c914e8d66136, role_id=8a829170b29d42d6af589399e51edb0f)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:37.243999 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cfef94-1532-4d8e-ad8c-3c838c5170b7 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:37.264884 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 947/1901] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:24:37 2022] PUT /identity/v3/projects/554a91343cda411482be11a2dc37a39d/users/8c5e953e9d93403a8974c914e8d66136/roles/8a829170b29d42d6af589399e51edb0f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 22:24:37.275439 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c518e-7673-47a0-8101-3b7aa83eaa9b None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:37.276292 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c518e-7673-47a0-8101-3b7aa83eaa9b None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:37.276576 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c518e-7673-47a0-8101-3b7aa83eaa9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:37.314656 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-5e8c518e-7673-47a0-8101-3b7aa83eaa9b None None] MFA Rules not processed for user `8c5e953e9d93403a8974c914e8d66136`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:24:37.315921 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-5e8c518e-7673-47a0-8101-3b7aa83eaa9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:37.397554 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 955/1902] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:24:37 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:24:37.405695 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cfef94-1532-4d8e-ad8c-3c838c5170b7 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:37.415687 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:37.485456 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cfef94-1532-4d8e-ad8c-3c838c5170b7 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:37.499191 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44529541-d85b-403c-8ac7-87e67011f528 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577c8b14c1f4279beac13b9ba11aba1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:37.499813 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44529541-d85b-403c-8ac7-87e67011f528 service cinder] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:37.500092 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44529541-d85b-403c-8ac7-87e67011f528 service cinder] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:37.500358 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44529541-d85b-403c-8ac7-87e67011f528 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:37.511333 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44529541-d85b-403c-8ac7-87e67011f528 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:37.512798 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44529541-d85b-403c-8ac7-87e67011f528 service cinder] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:37.523171 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 948/1903] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:24:37 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:24:37.576832 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8c518e-7673-47a0-8101-3b7aa83eaa9b None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:37.590164 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8c518e-7673-47a0-8101-3b7aa83eaa9b None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:37.594762 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6677ada1-5a3b-4bd3-b421-53482b6e2e1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577c8b14c1f4279beac13b9ba11aba1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:37.597900 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6677ada1-5a3b-4bd3-b421-53482b6e2e1c service cinder] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:37.611565 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6677ada1-5a3b-4bd3-b421-53482b6e2e1c service cinder] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:37.618254 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6677ada1-5a3b-4bd3-b421-53482b6e2e1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:37.630869 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:37.672802 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44529541-d85b-403c-8ac7-87e67011f528 service cinder] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:37.674957 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-44529541-d85b-403c-8ac7-87e67011f528 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:37.697616 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6677ada1-5a3b-4bd3-b421-53482b6e2e1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:37.699122 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6677ada1-5a3b-4bd3-b421-53482b6e2e1c service cinder] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:37.711405 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 956/1904] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:24:37 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:24:37.765976 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44529541-d85b-403c-8ac7-87e67011f528 service cinder] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:37.771499 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe1c08b-e57f-49c1-a823-2b38086217b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:37.772222 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe1c08b-e57f-49c1-a823-2b38086217b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:37.772508 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe1c08b-e57f-49c1-a823-2b38086217b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:37.772783 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe1c08b-e57f-49c1-a823-2b38086217b0 admin admin] PATH_INFO: `/v3/users/75040f197fa84436bb0644fb52b8606e` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:37.773958 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe1c08b-e57f-49c1-a823-2b38086217b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75040f197fa84436bb0644fb52b8606e)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:37.783044 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe1c08b-e57f-49c1-a823-2b38086217b0 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:37.890741 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-2fe1c08b-e57f-49c1-a823-2b38086217b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75040f197fa84436bb0644fb52b8606e'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:37.905139 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-2fe1c08b-e57f-49c1-a823-2b38086217b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75040f197fa84436bb0644fb52b8606e'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:37.905952 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-2fe1c08b-e57f-49c1-a823-2b38086217b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75040f197fa84436bb0644fb52b8606e'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:37.906653 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-2fe1c08b-e57f-49c1-a823-2b38086217b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75040f197fa84436bb0644fb52b8606e'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:37.925782 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-2fe1c08b-e57f-49c1-a823-2b38086217b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75040f197fa84436bb0644fb52b8606e'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:37.973301 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 949/1905] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 20 22:24:37 2022] DELETE /identity/v3/users/75040f197fa84436bb0644fb52b8606e => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:24:37.978010 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169fe23a-80ec-4eaf-92e7-b05ee07b2901 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:37.978292 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169fe23a-80ec-4eaf-92e7-b05ee07b2901 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:37.978602 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169fe23a-80ec-4eaf-92e7-b05ee07b2901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:38.025500 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-169fe23a-80ec-4eaf-92e7-b05ee07b2901 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:24:38.027339 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-169fe23a-80ec-4eaf-92e7-b05ee07b2901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:38.128169 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 957/1906] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:24:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:24:38.134655 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe1c08b-e57f-49c1-a823-2b38086217b0 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:38.136184 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-2fe1c08b-e57f-49c1-a823-2b38086217b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:38.203429 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:38.241032 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe1c08b-e57f-49c1-a823-2b38086217b0 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:38.245301 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0b574c-2803-4c9b-a3a5-e91ff1144b92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b0b3ca4ecd41aaba9cf8e0f91fbf54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:38.245943 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0b574c-2803-4c9b-a3a5-e91ff1144b92 service neutron] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:38.246457 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0b574c-2803-4c9b-a3a5-e91ff1144b92 service neutron] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:38.246867 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0b574c-2803-4c9b-a3a5-e91ff1144b92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:38.248711 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169fe23a-80ec-4eaf-92e7-b05ee07b2901 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:38.250063 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-169fe23a-80ec-4eaf-92e7-b05ee07b2901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:38.256808 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0b574c-2803-4c9b-a3a5-e91ff1144b92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:38.258413 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0b574c-2803-4c9b-a3a5-e91ff1144b92 service neutron] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:38.261562 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169fe23a-80ec-4eaf-92e7-b05ee07b2901 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:38.266390 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35052bd4-4cd3-438a-9494-60bc95113d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:38.267189 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35052bd4-4cd3-438a-9494-60bc95113d2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:38.267496 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35052bd4-4cd3-438a-9494-60bc95113d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:38.267790 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35052bd4-4cd3-438a-9494-60bc95113d2b admin admin] PATH_INFO: `/v3/users/f2eedbc3d86946cf91d291b2bb7790a4` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:38.269270 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 950/1907] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:24:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:24:38.269385 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35052bd4-4cd3-438a-9494-60bc95113d2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2eedbc3d86946cf91d291b2bb7790a4)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:38.271440 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35052bd4-4cd3-438a-9494-60bc95113d2b admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:38.328649 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-35052bd4-4cd3-438a-9494-60bc95113d2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2eedbc3d86946cf91d291b2bb7790a4'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:38.336115 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-35052bd4-4cd3-438a-9494-60bc95113d2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2eedbc3d86946cf91d291b2bb7790a4'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:38.336771 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-35052bd4-4cd3-438a-9494-60bc95113d2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2eedbc3d86946cf91d291b2bb7790a4'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:38.337394 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-35052bd4-4cd3-438a-9494-60bc95113d2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2eedbc3d86946cf91d291b2bb7790a4'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:38.345399 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-35052bd4-4cd3-438a-9494-60bc95113d2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2eedbc3d86946cf91d291b2bb7790a4'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:38.363432 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 958/1908] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 20 22:24:38 2022] DELETE /identity/v3/users/f2eedbc3d86946cf91d291b2bb7790a4 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 22:24:38.367897 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d7371a-8579-4ad9-81ec-29c817024300 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:38.368195 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d7371a-8579-4ad9-81ec-29c817024300 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:38.368500 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d7371a-8579-4ad9-81ec-29c817024300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:38.387930 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-55d7371a-8579-4ad9-81ec-29c817024300 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:24:38.389152 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-55d7371a-8579-4ad9-81ec-29c817024300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:38.455680 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 951/1909] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:24:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:24:38.465846 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35052bd4-4cd3-438a-9494-60bc95113d2b admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:38.467291 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-35052bd4-4cd3-438a-9494-60bc95113d2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:38.487278 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:38.528986 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35052bd4-4cd3-438a-9494-60bc95113d2b admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:38.533188 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02bdc35-ff7e-4825-b4fb-0ff6902e1a73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b0b3ca4ecd41aaba9cf8e0f91fbf54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:38.533936 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02bdc35-ff7e-4825-b4fb-0ff6902e1a73 service neutron] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:38.534218 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02bdc35-ff7e-4825-b4fb-0ff6902e1a73 service neutron] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:38.534492 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02bdc35-ff7e-4825-b4fb-0ff6902e1a73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:38.549153 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02bdc35-ff7e-4825-b4fb-0ff6902e1a73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:38.549689 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d7371a-8579-4ad9-81ec-29c817024300 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:38.550740 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02bdc35-ff7e-4825-b4fb-0ff6902e1a73 service neutron] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:38.551244 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-55d7371a-8579-4ad9-81ec-29c817024300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:38.561699 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 959/1910] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:24:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:24:38.570915 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d7371a-8579-4ad9-81ec-29c817024300 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:38.576522 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c461e3f4-83b7-47cc-b9ee-94e5a9737926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:38.577173 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c461e3f4-83b7-47cc-b9ee-94e5a9737926 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:38.577456 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c461e3f4-83b7-47cc-b9ee-94e5a9737926 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:38.577792 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c461e3f4-83b7-47cc-b9ee-94e5a9737926 admin admin] PATH_INFO: `/v3/projects/0a120b3241894c53bd84a5fcd29e81df` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:38.578965 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c461e3f4-83b7-47cc-b9ee-94e5a9737926 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a120b3241894c53bd84a5fcd29e81df)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:38.580953 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c461e3f4-83b7-47cc-b9ee-94e5a9737926 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:38.663860 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-c461e3f4-83b7-47cc-b9ee-94e5a9737926 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a120b3241894c53bd84a5fcd29e81df', 'request_id': 'req-c461e3f4-83b7-47cc-b9ee-94e5a9737926'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:38.677770 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-c461e3f4-83b7-47cc-b9ee-94e5a9737926 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a120b3241894c53bd84a5fcd29e81df', 'request_id': 'req-c461e3f4-83b7-47cc-b9ee-94e5a9737926'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:38.695160 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-c461e3f4-83b7-47cc-b9ee-94e5a9737926 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a120b3241894c53bd84a5fcd29e81df', 'request_id': 'req-c461e3f4-83b7-47cc-b9ee-94e5a9737926'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:38.711415 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-c461e3f4-83b7-47cc-b9ee-94e5a9737926 admin admin] The token cache is being invalidate because project 0a120b3241894c53bd84a5fcd29e81df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81307) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 22:24:38.711865 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-c461e3f4-83b7-47cc-b9ee-94e5a9737926 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:38.712676 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-c461e3f4-83b7-47cc-b9ee-94e5a9737926 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:38.715480 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 952/1911] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 20 22:24:38 2022] DELETE /identity/v3/projects/0a120b3241894c53bd84a5fcd29e81df => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:24:38.719122 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02bdc35-ff7e-4825-b4fb-0ff6902e1a73 service neutron] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:38.733983 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02bdc35-ff7e-4825-b4fb-0ff6902e1a73 service neutron] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:38.812686 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5ab5ef-5780-48b1-acf4-0cd259206de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:38.813239 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5ab5ef-5780-48b1-acf4-0cd259206de7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:38.813519 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5ab5ef-5780-48b1-acf4-0cd259206de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:38.813791 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5ab5ef-5780-48b1-acf4-0cd259206de7 admin admin] PATH_INFO: `/v3/users/dca309558db249b298eb6695e6d8447c` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:38.815003 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5ab5ef-5780-48b1-acf4-0cd259206de7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dca309558db249b298eb6695e6d8447c)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:38.819342 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5ab5ef-5780-48b1-acf4-0cd259206de7 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:38.887405 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-bc5ab5ef-5780-48b1-acf4-0cd259206de7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dca309558db249b298eb6695e6d8447c'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:38.899097 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-bc5ab5ef-5780-48b1-acf4-0cd259206de7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dca309558db249b298eb6695e6d8447c'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:38.899946 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-bc5ab5ef-5780-48b1-acf4-0cd259206de7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dca309558db249b298eb6695e6d8447c'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:38.900846 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-bc5ab5ef-5780-48b1-acf4-0cd259206de7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dca309558db249b298eb6695e6d8447c'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:38.910849 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-bc5ab5ef-5780-48b1-acf4-0cd259206de7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dca309558db249b298eb6695e6d8447c'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:38.939514 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 960/1912] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 20 22:24:38 2022] DELETE /identity/v3/users/dca309558db249b298eb6695e6d8447c => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:24:39.005294 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c461e3f4-83b7-47cc-b9ee-94e5a9737926 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:39.007795 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-c461e3f4-83b7-47cc-b9ee-94e5a9737926 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:39.022990 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c461e3f4-83b7-47cc-b9ee-94e5a9737926 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:39.094775 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:39.105847 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db23f454-f732-4c8d-a256-bdcafb436048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:39.121672 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db23f454-f732-4c8d-a256-bdcafb436048 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:39.121672 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db23f454-f732-4c8d-a256-bdcafb436048 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:39.121672 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db23f454-f732-4c8d-a256-bdcafb436048 admin admin] PATH_INFO: `/v3/projects/189b7480b0ad4738a613b6c3df0ce301` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:39.121672 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db23f454-f732-4c8d-a256-bdcafb436048 admin admin] RBAC: Authorizing `identity:delete_project(project_id=189b7480b0ad4738a613b6c3df0ce301)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:39.121672 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db23f454-f732-4c8d-a256-bdcafb436048 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:39.194613 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-db23f454-f732-4c8d-a256-bdcafb436048 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '189b7480b0ad4738a613b6c3df0ce301', 'request_id': 'req-db23f454-f732-4c8d-a256-bdcafb436048'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:39.203294 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-db23f454-f732-4c8d-a256-bdcafb436048 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '189b7480b0ad4738a613b6c3df0ce301', 'request_id': 'req-db23f454-f732-4c8d-a256-bdcafb436048'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:39.216898 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-db23f454-f732-4c8d-a256-bdcafb436048 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '189b7480b0ad4738a613b6c3df0ce301', 'request_id': 'req-db23f454-f732-4c8d-a256-bdcafb436048'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:39.231463 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-db23f454-f732-4c8d-a256-bdcafb436048 admin admin] The token cache is being invalidate because project 189b7480b0ad4738a613b6c3df0ce301 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81307) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 22:24:39.231964 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-db23f454-f732-4c8d-a256-bdcafb436048 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:39.232792 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-db23f454-f732-4c8d-a256-bdcafb436048 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:39.235338 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 953/1913] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 20 22:24:39 2022] DELETE /identity/v3/projects/189b7480b0ad4738a613b6c3df0ce301 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:24:39.239077 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5ab5ef-5780-48b1-acf4-0cd259206de7 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:39.240520 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-bc5ab5ef-5780-48b1-acf4-0cd259206de7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:39.257180 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5ab5ef-5780-48b1-acf4-0cd259206de7 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:39.285671 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db23f454-f732-4c8d-a256-bdcafb436048 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:39.287512 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-db23f454-f732-4c8d-a256-bdcafb436048 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:39.326557 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:39.353065 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0959f574-f807-4e85-8d1e-3c96fcf870b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:39.354689 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0959f574-f807-4e85-8d1e-3c96fcf870b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:39.355018 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0959f574-f807-4e85-8d1e-3c96fcf870b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:39.355281 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0959f574-f807-4e85-8d1e-3c96fcf870b8 admin admin] PATH_INFO: `/v3/users/f111eadc30a94244a4c5516f8029cc7b` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:39.357345 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0959f574-f807-4e85-8d1e-3c96fcf870b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f111eadc30a94244a4c5516f8029cc7b)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:39.359492 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0959f574-f807-4e85-8d1e-3c96fcf870b8 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:39.419759 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db23f454-f732-4c8d-a256-bdcafb436048 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:39.424873 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1c8e8a-cdb0-463a-b556-570a1b48cefe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:39.426163 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1c8e8a-cdb0-463a-b556-570a1b48cefe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:39.426556 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1c8e8a-cdb0-463a-b556-570a1b48cefe admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:39.426763 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1c8e8a-cdb0-463a-b556-570a1b48cefe admin admin] PATH_INFO: `/v3/users/b50c8efad55446828740d785761c11bc` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:39.428509 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1c8e8a-cdb0-463a-b556-570a1b48cefe admin admin] RBAC: Authorizing `identity:delete_user(user_id=b50c8efad55446828740d785761c11bc)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:39.431548 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1c8e8a-cdb0-463a-b556-570a1b48cefe admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:39.449578 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-0959f574-f807-4e85-8d1e-3c96fcf870b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f111eadc30a94244a4c5516f8029cc7b'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:39.466342 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-0959f574-f807-4e85-8d1e-3c96fcf870b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f111eadc30a94244a4c5516f8029cc7b'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:39.467022 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-0959f574-f807-4e85-8d1e-3c96fcf870b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f111eadc30a94244a4c5516f8029cc7b'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:39.468453 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-0959f574-f807-4e85-8d1e-3c96fcf870b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f111eadc30a94244a4c5516f8029cc7b'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:39.486545 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-0959f574-f807-4e85-8d1e-3c96fcf870b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f111eadc30a94244a4c5516f8029cc7b'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:39.514571 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 961/1914] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 20 22:24:39 2022] DELETE /identity/v3/users/f111eadc30a94244a4c5516f8029cc7b => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:24:39.526360 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-fc1c8e8a-cdb0-463a-b556-570a1b48cefe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b50c8efad55446828740d785761c11bc'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:39.538779 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-fc1c8e8a-cdb0-463a-b556-570a1b48cefe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b50c8efad55446828740d785761c11bc'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:39.540135 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-fc1c8e8a-cdb0-463a-b556-570a1b48cefe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b50c8efad55446828740d785761c11bc'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:39.541902 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-fc1c8e8a-cdb0-463a-b556-570a1b48cefe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b50c8efad55446828740d785761c11bc'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:39.558310 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-fc1c8e8a-cdb0-463a-b556-570a1b48cefe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b50c8efad55446828740d785761c11bc'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:39.589857 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0959f574-f807-4e85-8d1e-3c96fcf870b8 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:39.592678 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-0959f574-f807-4e85-8d1e-3c96fcf870b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:39.607233 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 954/1915] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 20 22:24:39 2022] DELETE /identity/v3/users/b50c8efad55446828740d785761c11bc => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:24:39.614873 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774d22b7-59e8-4f06-ad2b-2c1c52305c3d None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:39.615149 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774d22b7-59e8-4f06-ad2b-2c1c52305c3d None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:39.615507 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774d22b7-59e8-4f06-ad2b-2c1c52305c3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:39.633078 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:39.643236 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-774d22b7-59e8-4f06-ad2b-2c1c52305c3d None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:24:39.646239 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-774d22b7-59e8-4f06-ad2b-2c1c52305c3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:39.724235 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0959f574-f807-4e85-8d1e-3c96fcf870b8 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:39.747967 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 955/1916] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:24:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 22:24:39.759311 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774d22b7-59e8-4f06-ad2b-2c1c52305c3d None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:39.761516 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-774d22b7-59e8-4f06-ad2b-2c1c52305c3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:39.811028 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b622be2e-bca2-4cab-857d-8fb3c023820e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:39.811734 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b622be2e-bca2-4cab-857d-8fb3c023820e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:39.812285 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b622be2e-bca2-4cab-857d-8fb3c023820e admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:39.812285 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b622be2e-bca2-4cab-857d-8fb3c023820e admin admin] PATH_INFO: `/v3/projects/72b8ccc84bf74e8fb9fa885691c3391f` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:39.813480 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b622be2e-bca2-4cab-857d-8fb3c023820e admin admin] RBAC: Authorizing `identity:delete_project(project_id=72b8ccc84bf74e8fb9fa885691c3391f)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:39.815453 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b622be2e-bca2-4cab-857d-8fb3c023820e admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:39.826067 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:39.886737 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774d22b7-59e8-4f06-ad2b-2c1c52305c3d None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:39.902711 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-b622be2e-bca2-4cab-857d-8fb3c023820e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72b8ccc84bf74e8fb9fa885691c3391f', 'request_id': 'req-b622be2e-bca2-4cab-857d-8fb3c023820e'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:39.910107 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-b622be2e-bca2-4cab-857d-8fb3c023820e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72b8ccc84bf74e8fb9fa885691c3391f', 'request_id': 'req-b622be2e-bca2-4cab-857d-8fb3c023820e'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:39.920193 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-b622be2e-bca2-4cab-857d-8fb3c023820e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72b8ccc84bf74e8fb9fa885691c3391f', 'request_id': 'req-b622be2e-bca2-4cab-857d-8fb3c023820e'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:39.935693 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-b622be2e-bca2-4cab-857d-8fb3c023820e admin admin] The token cache is being invalidate because project 72b8ccc84bf74e8fb9fa885691c3391f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81306) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 22:24:39.936384 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-b622be2e-bca2-4cab-857d-8fb3c023820e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:39.936893 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-b622be2e-bca2-4cab-857d-8fb3c023820e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:39.943227 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 962/1917] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 20 22:24:39 2022] DELETE /identity/v3/projects/72b8ccc84bf74e8fb9fa885691c3391f => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:24:39.944232 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b622be2e-bca2-4cab-857d-8fb3c023820e admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:39.945739 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-b622be2e-bca2-4cab-857d-8fb3c023820e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:39.946945 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a69568e-dfa5-4901-ab2f-ba299b76b66d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b0b3ca4ecd41aaba9cf8e0f91fbf54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:39.948265 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a69568e-dfa5-4901-ab2f-ba299b76b66d service neutron] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:39.948702 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a69568e-dfa5-4901-ab2f-ba299b76b66d service neutron] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:39.949107 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a69568e-dfa5-4901-ab2f-ba299b76b66d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:39.951729 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-0a69568e-dfa5-4901-ab2f-ba299b76b66d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:40.076809 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b622be2e-bca2-4cab-857d-8fb3c023820e admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:40.082660 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b01bff7-fece-4f9b-964a-a248ca39e2f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:40.084061 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b01bff7-fece-4f9b-964a-a248ca39e2f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:40.084377 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b01bff7-fece-4f9b-964a-a248ca39e2f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:40.084678 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b01bff7-fece-4f9b-964a-a248ca39e2f0 admin admin] PATH_INFO: `/v3/projects/f4fd2ea342ed4f9893278d716863f133` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:40.086206 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b01bff7-fece-4f9b-964a-a248ca39e2f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4fd2ea342ed4f9893278d716863f133)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:40.089062 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b01bff7-fece-4f9b-964a-a248ca39e2f0 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:40.105371 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a69568e-dfa5-4901-ab2f-ba299b76b66d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:40.106931 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a69568e-dfa5-4901-ab2f-ba299b76b66d service neutron] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:40.127896 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 956/1918] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:24:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:24:40.130556 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa255e4a-9f69-46d4-9c09-f912d9a532fc None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:40.130875 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa255e4a-9f69-46d4-9c09-f912d9a532fc None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:40.131175 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa255e4a-9f69-46d4-9c09-f912d9a532fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:40.190349 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-6b01bff7-fece-4f9b-964a-a248ca39e2f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4fd2ea342ed4f9893278d716863f133', 'request_id': 'req-6b01bff7-fece-4f9b-964a-a248ca39e2f0'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:40.198765 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-fa255e4a-9f69-46d4-9c09-f912d9a532fc None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:24:40.200348 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-fa255e4a-9f69-46d4-9c09-f912d9a532fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:40.211883 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-6b01bff7-fece-4f9b-964a-a248ca39e2f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4fd2ea342ed4f9893278d716863f133', 'request_id': 'req-6b01bff7-fece-4f9b-964a-a248ca39e2f0'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:40.222903 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-6b01bff7-fece-4f9b-964a-a248ca39e2f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4fd2ea342ed4f9893278d716863f133', 'request_id': 'req-6b01bff7-fece-4f9b-964a-a248ca39e2f0'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:40.224474 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:40.247874 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-6b01bff7-fece-4f9b-964a-a248ca39e2f0 admin admin] The token cache is being invalidate because project f4fd2ea342ed4f9893278d716863f133 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81306) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 22:24:40.248174 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-6b01bff7-fece-4f9b-964a-a248ca39e2f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:40.250321 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-6b01bff7-fece-4f9b-964a-a248ca39e2f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:40.254225 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 963/1919] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 20 22:24:39 2022] DELETE /identity/v3/projects/f4fd2ea342ed4f9893278d716863f133 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:24:40.262823 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027cbddd-3b92-4ab5-a836-e8bbc76b228d None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:40.263167 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027cbddd-3b92-4ab5-a836-e8bbc76b228d None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:40.263457 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027cbddd-3b92-4ab5-a836-e8bbc76b228d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:40.311974 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-027cbddd-3b92-4ab5-a836-e8bbc76b228d None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:24:40.313219 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-027cbddd-3b92-4ab5-a836-e8bbc76b228d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:40.362381 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:40.386656 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 957/1920] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:24:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:24:40.400360 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08335ae-9658-4a43-9e6d-1bd08891039b None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:40.401223 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08335ae-9658-4a43-9e6d-1bd08891039b None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:40.403643 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08335ae-9658-4a43-9e6d-1bd08891039b None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:40.408071 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 958/1921] 10.222.0.33 () {54 vars in 921 bytes} [Tue Sep 20 22:24:40 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:24:40.409175 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd131a46-f183-4916-be3a-24404ee146e0 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:40.413950 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd131a46-f183-4916-be3a-24404ee146e0 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:40.414331 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd131a46-f183-4916-be3a-24404ee146e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:40.460321 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-bd131a46-f183-4916-be3a-24404ee146e0 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:24:40.465211 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 964/1922] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:24:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:24:40.466677 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c91b767-b236-4366-a1e6-8fbbf0825121 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:40.467004 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c91b767-b236-4366-a1e6-8fbbf0825121 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:40.467241 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c91b767-b236-4366-a1e6-8fbbf0825121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:40.472045 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-bd131a46-f183-4916-be3a-24404ee146e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:40.503971 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 959/1923] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:24:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:24:40.505450 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ecbb3c-018e-4a8a-b130-ec30c352f781 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:40.505840 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ecbb3c-018e-4a8a-b130-ec30c352f781 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:40.506207 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ecbb3c-018e-4a8a-b130-ec30c352f781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:40.511544 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-9c91b767-b236-4366-a1e6-8fbbf0825121 None None] MFA Rules not processed for user `db7eed561e99452289a662ad326cf919`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:24:40.513025 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-9c91b767-b236-4366-a1e6-8fbbf0825121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:40.539328 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-10ecbb3c-018e-4a8a-b130-ec30c352f781 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:24:40.540665 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-10ecbb3c-018e-4a8a-b130-ec30c352f781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:40.565564 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 960/1924] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:24:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:24:40.569500 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ecbb3c-018e-4a8a-b130-ec30c352f781 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:40.580220 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ecbb3c-018e-4a8a-b130-ec30c352f781 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:40.586562 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035fa658-c4ef-4d0e-8f7d-64350a1e2991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:40.587177 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035fa658-c4ef-4d0e-8f7d-64350a1e2991 admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:40.587714 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035fa658-c4ef-4d0e-8f7d-64350a1e2991 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:40.587714 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035fa658-c4ef-4d0e-8f7d-64350a1e2991 admin admin] PATH_INFO: `/v3/domains` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:40.588388 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035fa658-c4ef-4d0e-8f7d-64350a1e2991 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:24:40.588690 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035fa658-c4ef-4d0e-8f7d-64350a1e2991 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:40.597386 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035fa658-c4ef-4d0e-8f7d-64350a1e2991 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:40.615605 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 961/1925] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 20 22:24:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:24:40.616394 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035fa658-c4ef-4d0e-8f7d-64350a1e2991 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:40.629671 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035fa658-c4ef-4d0e-8f7d-64350a1e2991 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:40.637776 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2cc65d-1971-40f4-a7b3-d38400a0b988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:40.638612 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2cc65d-1971-40f4-a7b3-d38400a0b988 admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:40.639032 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2cc65d-1971-40f4-a7b3-d38400a0b988 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:40.639463 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2cc65d-1971-40f4-a7b3-d38400a0b988 admin admin] PATH_INFO: `/v3/domains` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:40.640249 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2cc65d-1971-40f4-a7b3-d38400a0b988 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:24:40.640705 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2cc65d-1971-40f4-a7b3-d38400a0b988 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:40.642603 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2cc65d-1971-40f4-a7b3-d38400a0b988 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:40.644130 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 965/1926] 10.222.0.33 () {58 vars in 1018 bytes} [Tue Sep 20 22:24:40 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:24:40.644893 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c91b767-b236-4366-a1e6-8fbbf0825121 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:40.656605 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c91b767-b236-4366-a1e6-8fbbf0825121 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:40.661859 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53acd465-acf0-4d69-a23e-2b3042dcbb46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:40.662485 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53acd465-acf0-4d69-a23e-2b3042dcbb46 admin admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:40.662799 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53acd465-acf0-4d69-a23e-2b3042dcbb46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:40.663224 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53acd465-acf0-4d69-a23e-2b3042dcbb46 admin admin] PATH_INFO: `/v3/projects` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:40.664699 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53acd465-acf0-4d69-a23e-2b3042dcbb46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:40.665761 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53acd465-acf0-4d69-a23e-2b3042dcbb46 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:40.674184 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 962/1927] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 20 22:24:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:24:40.678977 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2cc65d-1971-40f4-a7b3-d38400a0b988 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:40.681101 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-4d2cc65d-1971-40f4-a7b3-d38400a0b988 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:40.701551 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2cc65d-1971-40f4-a7b3-d38400a0b988 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:40.716632 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 966/1928] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 20 22:24:40 2022] POST /identity/v3/projects => generated 389 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:24:40.716812 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53acd465-acf0-4d69-a23e-2b3042dcbb46 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:40.718886 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4848cd01-1dd3-480c-a6ec-12c7db93bf6a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db7eed561e99452289a662ad326cf919', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:40.718886 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4848cd01-1dd3-480c-a6ec-12c7db93bf6a service nova] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:40.718886 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4848cd01-1dd3-480c-a6ec-12c7db93bf6a service nova] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:40.718886 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4848cd01-1dd3-480c-a6ec-12c7db93bf6a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:40.737409 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4848cd01-1dd3-480c-a6ec-12c7db93bf6a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:40.739066 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4848cd01-1dd3-480c-a6ec-12c7db93bf6a service nova] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:40.777653 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 963/1929] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:24:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:24:40.778928 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4848cd01-1dd3-480c-a6ec-12c7db93bf6a service nova] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:40.798627 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53acd465-acf0-4d69-a23e-2b3042dcbb46 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:40.801312 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4848cd01-1dd3-480c-a6ec-12c7db93bf6a service nova] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:40.806269 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900b3ef8-c6a7-4acd-9ef7-598868901c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:40.807830 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b3ef8-c6a7-4acd-9ef7-598868901c5a admin admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:40.808466 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b3ef8-c6a7-4acd-9ef7-598868901c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:40.808881 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b3ef8-c6a7-4acd-9ef7-598868901c5a admin admin] PATH_INFO: `/v3/projects` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:40.809858 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900b3ef8-c6a7-4acd-9ef7-598868901c5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:40.812159 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900b3ef8-c6a7-4acd-9ef7-598868901c5a admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:40.814152 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d957335b-4293-4480-857b-9374454bb1d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:40.814694 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d957335b-4293-4480-857b-9374454bb1d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:40.814985 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d957335b-4293-4480-857b-9374454bb1d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:40.815274 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d957335b-4293-4480-857b-9374454bb1d2 admin admin] PATH_INFO: `/v3/users` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:40.815926 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d957335b-4293-4480-857b-9374454bb1d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:40.819086 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d957335b-4293-4480-857b-9374454bb1d2 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:40.866110 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 964/1930] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 20 22:24:40 2022] POST /identity/v3/users => generated 295 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:24:40.870292 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d957335b-4293-4480-857b-9374454bb1d2 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:40.873394 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 967/1931] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 20 22:24:40 2022] POST /identity/v3/projects => generated 381 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:24:40.874880 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900b3ef8-c6a7-4acd-9ef7-598868901c5a admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:40.892089 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d957335b-4293-4480-857b-9374454bb1d2 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:40.917886 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:40.975720 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900b3ef8-c6a7-4acd-9ef7-598868901c5a admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:40.982266 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5680e813-d073-4ef2-b341-0142734b3441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:40.982924 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5680e813-d073-4ef2-b341-0142734b3441 admin admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:40.983216 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5680e813-d073-4ef2-b341-0142734b3441 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:40.983612 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5680e813-d073-4ef2-b341-0142734b3441 admin admin] PATH_INFO: `/v3/users` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:40.983854 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae74dc40-0ba3-41fa-91a0-d04603c863a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:40.984384 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5680e813-d073-4ef2-b341-0142734b3441 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:40.984917 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae74dc40-0ba3-41fa-91a0-d04603c863a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:40.985391 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae74dc40-0ba3-41fa-91a0-d04603c863a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:40.985754 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae74dc40-0ba3-41fa-91a0-d04603c863a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:40.986338 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5680e813-d073-4ef2-b341-0142734b3441 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:40.986877 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae74dc40-0ba3-41fa-91a0-d04603c863a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:40.989463 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae74dc40-0ba3-41fa-91a0-d04603c863a0 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:41.006635 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 965/1932] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:24:40 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 20 22:24:41.012603 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae74dc40-0ba3-41fa-91a0-d04603c863a0 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:41.012834 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 968/1933] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 20 22:24:40 2022] POST /identity/v3/users => generated 291 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:24:41.016330 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5680e813-d073-4ef2-b341-0142734b3441 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:41.027276 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae74dc40-0ba3-41fa-91a0-d04603c863a0 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:41.029843 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5680e813-d073-4ef2-b341-0142734b3441 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:41.034446 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dd7af6-5826-4666-9617-150bbdd79a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:41.035054 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dd7af6-5826-4666-9617-150bbdd79a03 admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:41.035335 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dd7af6-5826-4666-9617-150bbdd79a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:41.035646 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dd7af6-5826-4666-9617-150bbdd79a03 admin admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:41.036300 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dd7af6-5826-4666-9617-150bbdd79a03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:41.036732 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfcdf30-220f-406e-a40d-2e44ac06f0c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:41.037425 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfcdf30-220f-406e-a40d-2e44ac06f0c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:41.037776 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfcdf30-220f-406e-a40d-2e44ac06f0c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:41.037947 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dd7af6-5826-4666-9617-150bbdd79a03 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:41.038209 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfcdf30-220f-406e-a40d-2e44ac06f0c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:41.038958 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfcdf30-220f-406e-a40d-2e44ac06f0c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:41.040904 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfcdf30-220f-406e-a40d-2e44ac06f0c2 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:41.054002 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 966/1934] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:24:41 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:24:41.054201 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 969/1935] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:24:41 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 20 22:24:41.057201 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfcdf30-220f-406e-a40d-2e44ac06f0c2 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:41.057341 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dd7af6-5826-4666-9617-150bbdd79a03 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:41.067809 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfcdf30-220f-406e-a40d-2e44ac06f0c2 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:41.068199 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dd7af6-5826-4666-9617-150bbdd79a03 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:41.073337 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27108b7-193a-45df-9750-769ba690aa03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:41.073702 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eed4798-8236-46c1-a98b-d0a24efd8444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:41.074001 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27108b7-193a-45df-9750-769ba690aa03 admin admin] REQUEST_METHOD: `PUT` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:41.074277 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27108b7-193a-45df-9750-769ba690aa03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:41.074589 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27108b7-193a-45df-9750-769ba690aa03 admin admin] PATH_INFO: `/v3/projects/728efa4eb79642a5881258e61eb6b83e/users/3e1e55ee2a0b4faf8cc7c18ebe15506c/roles/604444e7ad0d437dbd1f5a6e02b761f5` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:41.074697 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eed4798-8236-46c1-a98b-d0a24efd8444 admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:41.075067 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eed4798-8236-46c1-a98b-d0a24efd8444 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:41.075434 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eed4798-8236-46c1-a98b-d0a24efd8444 admin admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:41.076162 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eed4798-8236-46c1-a98b-d0a24efd8444 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:41.077824 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eed4798-8236-46c1-a98b-d0a24efd8444 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:41.089191 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 970/1936] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:24:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:24:41.096222 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eed4798-8236-46c1-a98b-d0a24efd8444 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:41.097313 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27108b7-193a-45df-9750-769ba690aa03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=728efa4eb79642a5881258e61eb6b83e, user_id=3e1e55ee2a0b4faf8cc7c18ebe15506c, role_id=604444e7ad0d437dbd1f5a6e02b761f5)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:41.100665 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27108b7-193a-45df-9750-769ba690aa03 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:41.107190 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eed4798-8236-46c1-a98b-d0a24efd8444 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:41.112532 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c60a128-bf74-48c1-8440-3a0f46f1fbeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:41.113196 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c60a128-bf74-48c1-8440-3a0f46f1fbeb admin admin] REQUEST_METHOD: `PUT` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:41.113518 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c60a128-bf74-48c1-8440-3a0f46f1fbeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:41.113776 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c60a128-bf74-48c1-8440-3a0f46f1fbeb admin admin] PATH_INFO: `/v3/projects/000bd8defc3b4b5cbf4a04c6b1a6d8fa/users/ee0bd59ffb3f40209721d7b8ccd45959/roles/604444e7ad0d437dbd1f5a6e02b761f5` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:41.122661 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 967/1937] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:24:41 2022] PUT /identity/v3/projects/728efa4eb79642a5881258e61eb6b83e/users/3e1e55ee2a0b4faf8cc7c18ebe15506c/roles/604444e7ad0d437dbd1f5a6e02b761f5 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:24:41.130265 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c665e963-0ac5-41a9-b3cc-e77dc92afc73 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:41.130684 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c665e963-0ac5-41a9-b3cc-e77dc92afc73 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:41.131024 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c665e963-0ac5-41a9-b3cc-e77dc92afc73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:41.135397 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c60a128-bf74-48c1-8440-3a0f46f1fbeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=000bd8defc3b4b5cbf4a04c6b1a6d8fa, user_id=ee0bd59ffb3f40209721d7b8ccd45959, role_id=604444e7ad0d437dbd1f5a6e02b761f5)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:41.138435 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c60a128-bf74-48c1-8440-3a0f46f1fbeb admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:41.141433 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:41.155659 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 971/1938] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:24:41 2022] PUT /identity/v3/projects/000bd8defc3b4b5cbf4a04c6b1a6d8fa/users/ee0bd59ffb3f40209721d7b8ccd45959/roles/604444e7ad0d437dbd1f5a6e02b761f5 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:24:41.167529 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6f99d5-2913-4d12-8dd7-08da87164944 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:41.168290 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-c665e963-0ac5-41a9-b3cc-e77dc92afc73 None None] MFA Rules not processed for user `3e1e55ee2a0b4faf8cc7c18ebe15506c`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:24:41.168800 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6f99d5-2913-4d12-8dd7-08da87164944 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:41.169562 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-c665e963-0ac5-41a9-b3cc-e77dc92afc73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:41.169939 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6f99d5-2913-4d12-8dd7-08da87164944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:41.206684 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-0d6f99d5-2913-4d12-8dd7-08da87164944 None None] MFA Rules not processed for user `ee0bd59ffb3f40209721d7b8ccd45959`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:24:41.208002 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-0d6f99d5-2913-4d12-8dd7-08da87164944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:41.250803 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 968/1939] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:24:41 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 22:24:41.255895 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c665e963-0ac5-41a9-b3cc-e77dc92afc73 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:41.281397 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 972/1940] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:24:41 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 22:24:41.282446 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6f99d5-2913-4d12-8dd7-08da87164944 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:41.283910 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-0d6f99d5-2913-4d12-8dd7-08da87164944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:41.340470 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c665e963-0ac5-41a9-b3cc-e77dc92afc73 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:41.345543 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb35e77-8549-41d2-91f7-1b9a35113ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:41.346318 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb35e77-8549-41d2-91f7-1b9a35113ddc admin admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:41.346730 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb35e77-8549-41d2-91f7-1b9a35113ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:41.347062 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb35e77-8549-41d2-91f7-1b9a35113ddc admin admin] PATH_INFO: `/v3/projects` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:41.347793 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb35e77-8549-41d2-91f7-1b9a35113ddc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:41.350109 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb35e77-8549-41d2-91f7-1b9a35113ddc admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:41.363923 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:41.373025 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6f99d5-2913-4d12-8dd7-08da87164944 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:41.379188 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8964faba-eb14-4282-830f-be60c1859b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:41.379858 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8964faba-eb14-4282-830f-be60c1859b20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:41.380135 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8964faba-eb14-4282-830f-be60c1859b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:41.380406 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8964faba-eb14-4282-830f-be60c1859b20 admin admin] PATH_INFO: `/v3/projects/ff33edbaf87a484e8b1f81fe768c2e98` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:41.381558 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8964faba-eb14-4282-830f-be60c1859b20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff33edbaf87a484e8b1f81fe768c2e98)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:41.382541 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 969/1941] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 20 22:24:41 2022] POST /identity/v3/projects => generated 389 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:24:41.383532 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8964faba-eb14-4282-830f-be60c1859b20 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:41.383874 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb35e77-8549-41d2-91f7-1b9a35113ddc admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:41.439482 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-8964faba-eb14-4282-830f-be60c1859b20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff33edbaf87a484e8b1f81fe768c2e98', 'request_id': 'req-8964faba-eb14-4282-830f-be60c1859b20'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:41.445930 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-8964faba-eb14-4282-830f-be60c1859b20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff33edbaf87a484e8b1f81fe768c2e98', 'request_id': 'req-8964faba-eb14-4282-830f-be60c1859b20'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:41.458647 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb35e77-8549-41d2-91f7-1b9a35113ddc admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:41.460124 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-8964faba-eb14-4282-830f-be60c1859b20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff33edbaf87a484e8b1f81fe768c2e98', 'request_id': 'req-8964faba-eb14-4282-830f-be60c1859b20'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:41.475444 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-8964faba-eb14-4282-830f-be60c1859b20 admin admin] The token cache is being invalidate because project ff33edbaf87a484e8b1f81fe768c2e98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81306) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 22:24:41.475867 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-8964faba-eb14-4282-830f-be60c1859b20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:41.476767 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-8964faba-eb14-4282-830f-be60c1859b20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:41.479377 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 973/1942] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 20 22:24:41 2022] DELETE /identity/v3/projects/ff33edbaf87a484e8b1f81fe768c2e98 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:24:41.484167 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8964faba-eb14-4282-830f-be60c1859b20 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:41.485545 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-8964faba-eb14-4282-830f-be60c1859b20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:41.486580 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:41.525588 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7e3abf-3543-4980-821e-c34bf3454ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:41.526210 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7e3abf-3543-4980-821e-c34bf3454ac0 admin admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:41.526491 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7e3abf-3543-4980-821e-c34bf3454ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:41.526791 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7e3abf-3543-4980-821e-c34bf3454ac0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:41.527431 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7e3abf-3543-4980-821e-c34bf3454ac0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:41.529580 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7e3abf-3543-4980-821e-c34bf3454ac0 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:41.558009 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8964faba-eb14-4282-830f-be60c1859b20 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:41.564865 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcae5e9e-d32d-4607-a675-33105d6a27b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:41.565486 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcae5e9e-d32d-4607-a675-33105d6a27b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:41.565833 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcae5e9e-d32d-4607-a675-33105d6a27b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:41.566115 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcae5e9e-d32d-4607-a675-33105d6a27b4 admin admin] PATH_INFO: `/v3/users` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:41.566688 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcae5e9e-d32d-4607-a675-33105d6a27b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:41.569447 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcae5e9e-d32d-4607-a675-33105d6a27b4 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:41.579519 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 970/1943] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 20 22:24:41 2022] POST /identity/v3/projects => generated 379 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:24:41.580482 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7e3abf-3543-4980-821e-c34bf3454ac0 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:41.583182 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-0a7e3abf-3543-4980-821e-c34bf3454ac0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:41.597385 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 974/1944] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 20 22:24:41 2022] POST /identity/v3/users => generated 301 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:24:41.598478 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcae5e9e-d32d-4607-a675-33105d6a27b4 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:41.600363 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-fcae5e9e-d32d-4607-a675-33105d6a27b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:41.614115 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcae5e9e-d32d-4607-a675-33105d6a27b4 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:41.685383 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7e3abf-3543-4980-821e-c34bf3454ac0 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:41.692060 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9132969a-ddec-42aa-b11d-77650f5973ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:41.692629 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6625eb-246a-4af9-8f72-78ab366a0c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:41.692824 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9132969a-ddec-42aa-b11d-77650f5973ca admin admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:41.693160 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9132969a-ddec-42aa-b11d-77650f5973ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:41.693493 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9132969a-ddec-42aa-b11d-77650f5973ca admin admin] PATH_INFO: `/v3/users` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:41.694088 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6625eb-246a-4af9-8f72-78ab366a0c45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:41.694195 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9132969a-ddec-42aa-b11d-77650f5973ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:41.694363 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6625eb-246a-4af9-8f72-78ab366a0c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:41.694688 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6625eb-246a-4af9-8f72-78ab366a0c45 admin admin] PATH_INFO: `/v3/users/6f0a4ab80ed9442fbd07cc9c201dc2f4` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:41.697027 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6625eb-246a-4af9-8f72-78ab366a0c45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f0a4ab80ed9442fbd07cc9c201dc2f4)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:41.698182 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9132969a-ddec-42aa-b11d-77650f5973ca admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:41.699424 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6625eb-246a-4af9-8f72-78ab366a0c45 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:41.733160 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 975/1945] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 20 22:24:41 2022] POST /identity/v3/users => generated 296 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:24:41.733160 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9132969a-ddec-42aa-b11d-77650f5973ca admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:41.744989 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=86,keystone:DELETE=7,keystone:INSERT=7 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:41.749771 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9132969a-ddec-42aa-b11d-77650f5973ca admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:41.755105 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81467f95-2fee-4dbc-a2bf-d02ac9b0df55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:41.755840 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81467f95-2fee-4dbc-a2bf-d02ac9b0df55 admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:41.756131 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81467f95-2fee-4dbc-a2bf-d02ac9b0df55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:41.756815 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81467f95-2fee-4dbc-a2bf-d02ac9b0df55 admin admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:41.757959 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81467f95-2fee-4dbc-a2bf-d02ac9b0df55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:41.760312 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81467f95-2fee-4dbc-a2bf-d02ac9b0df55 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:41.773867 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 976/1946] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:24:41 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:24:41.774801 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81467f95-2fee-4dbc-a2bf-d02ac9b0df55 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:41.786379 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81467f95-2fee-4dbc-a2bf-d02ac9b0df55 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:41.788391 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-fb6625eb-246a-4af9-8f72-78ab366a0c45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f0a4ab80ed9442fbd07cc9c201dc2f4'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:41.792423 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a39f98a-1562-457b-adfc-3240753f3b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:41.793137 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a39f98a-1562-457b-adfc-3240753f3b9d admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:41.793423 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a39f98a-1562-457b-adfc-3240753f3b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:41.793765 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a39f98a-1562-457b-adfc-3240753f3b9d admin admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:41.794610 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a39f98a-1562-457b-adfc-3240753f3b9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:41.796731 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a39f98a-1562-457b-adfc-3240753f3b9d admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:41.797211 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-fb6625eb-246a-4af9-8f72-78ab366a0c45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f0a4ab80ed9442fbd07cc9c201dc2f4'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:41.798066 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-fb6625eb-246a-4af9-8f72-78ab366a0c45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f0a4ab80ed9442fbd07cc9c201dc2f4'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:41.798823 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-fb6625eb-246a-4af9-8f72-78ab366a0c45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f0a4ab80ed9442fbd07cc9c201dc2f4'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:41.809516 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 977/1947] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:24:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:24:41.811149 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-fb6625eb-246a-4af9-8f72-78ab366a0c45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f0a4ab80ed9442fbd07cc9c201dc2f4'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:41.811589 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a39f98a-1562-457b-adfc-3240753f3b9d admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:41.815336 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-8a39f98a-1562-457b-adfc-3240753f3b9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:41.836660 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 971/1948] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 20 22:24:41 2022] DELETE /identity/v3/users/6f0a4ab80ed9442fbd07cc9c201dc2f4 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:24:41.836660 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6625eb-246a-4af9-8f72-78ab366a0c45 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:41.838902 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-fb6625eb-246a-4af9-8f72-78ab366a0c45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:41.839957 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a39f98a-1562-457b-adfc-3240753f3b9d admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:41.883256 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:41.931205 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6625eb-246a-4af9-8f72-78ab366a0c45 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:41.939059 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ed6952-9acd-4c6e-b43f-7e5c6c2dd2d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:41.939954 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed6952-9acd-4c6e-b43f-7e5c6c2dd2d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:41.940401 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed6952-9acd-4c6e-b43f-7e5c6c2dd2d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:41.940827 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed6952-9acd-4c6e-b43f-7e5c6c2dd2d9 admin admin] PATH_INFO: `/v3/projects/f0066bf3f33c4ff39d227bd7d9fcc3ae/users/0afeea11519f4227906d17f3bb690616/roles/8a829170b29d42d6af589399e51edb0f` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:41.943379 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abdb3a3-c543-4b55-9b8f-91dbe328b01d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:41.944026 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abdb3a3-c543-4b55-9b8f-91dbe328b01d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:41.944388 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abdb3a3-c543-4b55-9b8f-91dbe328b01d admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:41.944751 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abdb3a3-c543-4b55-9b8f-91dbe328b01d admin admin] PATH_INFO: `/v3/users/0ecff300895b413486739cefcc32d400` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:41.947412 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abdb3a3-c543-4b55-9b8f-91dbe328b01d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ecff300895b413486739cefcc32d400)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:41.949540 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abdb3a3-c543-4b55-9b8f-91dbe328b01d admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:41.968776 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ed6952-9acd-4c6e-b43f-7e5c6c2dd2d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0066bf3f33c4ff39d227bd7d9fcc3ae, user_id=0afeea11519f4227906d17f3bb690616, role_id=8a829170b29d42d6af589399e51edb0f)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:41.972924 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ed6952-9acd-4c6e-b43f-7e5c6c2dd2d9 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:41.991168 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 972/1949] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:24:41 2022] PUT /identity/v3/projects/f0066bf3f33c4ff39d227bd7d9fcc3ae/users/0afeea11519f4227906d17f3bb690616/roles/8a829170b29d42d6af589399e51edb0f => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:24:41.992797 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ed6952-9acd-4c6e-b43f-7e5c6c2dd2d9 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:41.995936 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-98ed6952-9acd-4c6e-b43f-7e5c6c2dd2d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:42.027784 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-0abdb3a3-c543-4b55-9b8f-91dbe328b01d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ecff300895b413486739cefcc32d400'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:42.048269 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-0abdb3a3-c543-4b55-9b8f-91dbe328b01d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ecff300895b413486739cefcc32d400'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:42.049630 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-0abdb3a3-c543-4b55-9b8f-91dbe328b01d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ecff300895b413486739cefcc32d400'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:42.050975 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-0abdb3a3-c543-4b55-9b8f-91dbe328b01d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ecff300895b413486739cefcc32d400'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:42.061206 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-0abdb3a3-c543-4b55-9b8f-91dbe328b01d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ecff300895b413486739cefcc32d400'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:42.091478 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 978/1950] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 20 22:24:41 2022] DELETE /identity/v3/users/0ecff300895b413486739cefcc32d400 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:24:42.093261 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abdb3a3-c543-4b55-9b8f-91dbe328b01d admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:42.094742 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-0abdb3a3-c543-4b55-9b8f-91dbe328b01d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:42.111548 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ed6952-9acd-4c6e-b43f-7e5c6c2dd2d9 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:42.198174 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abdb3a3-c543-4b55-9b8f-91dbe328b01d admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:42.203293 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34c07f0-4e77-4280-916e-55e9d71aac3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:42.203917 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c07f0-4e77-4280-916e-55e9d71aac3c admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:42.204198 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c07f0-4e77-4280-916e-55e9d71aac3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:42.204659 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c07f0-4e77-4280-916e-55e9d71aac3c admin admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:42.205828 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34c07f0-4e77-4280-916e-55e9d71aac3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:42.207163 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34c07f0-4e77-4280-916e-55e9d71aac3c admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:42.209572 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:42.218155 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b99d8d-11d9-44c5-aad3-68bd34e268fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:42.220814 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b99d8d-11d9-44c5-aad3-68bd34e268fd admin admin] REQUEST_METHOD: `PUT` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:42.221121 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b99d8d-11d9-44c5-aad3-68bd34e268fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:42.223656 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b99d8d-11d9-44c5-aad3-68bd34e268fd admin admin] PATH_INFO: `/v3/projects/66ea75118db7450e8ee9961d12716a24/users/505746d545284430a1ed976d8c8b1932/roles/8a829170b29d42d6af589399e51edb0f` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:42.227468 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 979/1951] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:24:42 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:24:42.236948 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e17289-7144-4327-9413-f776947becfb None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:42.237239 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e17289-7144-4327-9413-f776947becfb None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:42.237509 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e17289-7144-4327-9413-f776947becfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:42.252013 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b99d8d-11d9-44c5-aad3-68bd34e268fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=66ea75118db7450e8ee9961d12716a24, user_id=505746d545284430a1ed976d8c8b1932, role_id=8a829170b29d42d6af589399e51edb0f)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:42.255534 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b99d8d-11d9-44c5-aad3-68bd34e268fd admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:42.266349 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-23e17289-7144-4327-9413-f776947becfb None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:24:42.267623 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-23e17289-7144-4327-9413-f776947becfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:42.285793 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 973/1952] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:24:41 2022] PUT /identity/v3/projects/66ea75118db7450e8ee9961d12716a24/users/505746d545284430a1ed976d8c8b1932/roles/8a829170b29d42d6af589399e51edb0f => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:24:42.287830 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b99d8d-11d9-44c5-aad3-68bd34e268fd admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:42.351403 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:42.361402 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 980/1953] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:24:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:24:42.362316 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e17289-7144-4327-9413-f776947becfb None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:42.363684 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-23e17289-7144-4327-9413-f776947becfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:42.377578 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b99d8d-11d9-44c5-aad3-68bd34e268fd admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:42.379507 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e17289-7144-4327-9413-f776947becfb None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:42.383318 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ccbbb5-bcf7-444f-8c71-46139192da43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:42.384022 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ccbbb5-bcf7-444f-8c71-46139192da43 admin admin] REQUEST_METHOD: `PUT` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:42.384311 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ccbbb5-bcf7-444f-8c71-46139192da43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:42.384573 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ccbbb5-bcf7-444f-8c71-46139192da43 admin admin] PATH_INFO: `/v3/projects/f0066bf3f33c4ff39d227bd7d9fcc3ae/users/0afeea11519f4227906d17f3bb690616/roles/8a829170b29d42d6af589399e51edb0f` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:42.385464 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7bc0c8-c282-4314-a360-180eab5622a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:42.386454 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7bc0c8-c282-4314-a360-180eab5622a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:42.386593 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ccbbb5-bcf7-444f-8c71-46139192da43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0066bf3f33c4ff39d227bd7d9fcc3ae, user_id=0afeea11519f4227906d17f3bb690616, role_id=8a829170b29d42d6af589399e51edb0f)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:42.387125 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7bc0c8-c282-4314-a360-180eab5622a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:42.387596 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7bc0c8-c282-4314-a360-180eab5622a6 admin admin] PATH_INFO: `/v3/projects/330b726fb38843819b02b630907f5a10` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:42.389105 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7bc0c8-c282-4314-a360-180eab5622a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=330b726fb38843819b02b630907f5a10)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:42.389212 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ccbbb5-bcf7-444f-8c71-46139192da43 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:42.391770 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7bc0c8-c282-4314-a360-180eab5622a6 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:42.401413 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 974/1954] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:24:42 2022] PUT /identity/v3/projects/f0066bf3f33c4ff39d227bd7d9fcc3ae/users/0afeea11519f4227906d17f3bb690616/roles/8a829170b29d42d6af589399e51edb0f => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:24:42.402005 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ccbbb5-bcf7-444f-8c71-46139192da43 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:42.405554 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-d7ccbbb5-bcf7-444f-8c71-46139192da43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:42.464461 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-ba7bc0c8-c282-4314-a360-180eab5622a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '330b726fb38843819b02b630907f5a10', 'request_id': 'req-ba7bc0c8-c282-4314-a360-180eab5622a6'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:42.471351 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-ba7bc0c8-c282-4314-a360-180eab5622a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '330b726fb38843819b02b630907f5a10', 'request_id': 'req-ba7bc0c8-c282-4314-a360-180eab5622a6'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:42.481211 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ccbbb5-bcf7-444f-8c71-46139192da43 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:42.481374 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-ba7bc0c8-c282-4314-a360-180eab5622a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '330b726fb38843819b02b630907f5a10', 'request_id': 'req-ba7bc0c8-c282-4314-a360-180eab5622a6'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:42.507147 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-ba7bc0c8-c282-4314-a360-180eab5622a6 admin admin] The token cache is being invalidate because project 330b726fb38843819b02b630907f5a10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81306) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 22:24:42.507582 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-ba7bc0c8-c282-4314-a360-180eab5622a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:42.508312 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-ba7bc0c8-c282-4314-a360-180eab5622a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:42.514137 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 981/1955] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 20 22:24:42 2022] DELETE /identity/v3/projects/330b726fb38843819b02b630907f5a10 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:24:42.514137 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7bc0c8-c282-4314-a360-180eab5622a6 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:42.515428 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-ba7bc0c8-c282-4314-a360-180eab5622a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:42.562052 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2789e3e-582f-45fc-b6a9-d06a9eed330a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:42.562708 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2789e3e-582f-45fc-b6a9-d06a9eed330a admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:42.562993 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2789e3e-582f-45fc-b6a9-d06a9eed330a admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:42.563268 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2789e3e-582f-45fc-b6a9-d06a9eed330a admin admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:42.564307 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2789e3e-582f-45fc-b6a9-d06a9eed330a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:42.565655 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2789e3e-582f-45fc-b6a9-d06a9eed330a admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:42.576480 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 975/1956] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:24:42 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:24:42.577704 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13416438-14f7-4a84-8152-a655463d65f3 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:42.577990 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13416438-14f7-4a84-8152-a655463d65f3 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:42.578331 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13416438-14f7-4a84-8152-a655463d65f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:42.590929 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7bc0c8-c282-4314-a360-180eab5622a6 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:42.594936 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048ccac2-f19b-4f12-b5ca-231204fbf6c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b0b3ca4ecd41aaba9cf8e0f91fbf54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:42.595532 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048ccac2-f19b-4f12-b5ca-231204fbf6c3 service neutron] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:42.595813 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048ccac2-f19b-4f12-b5ca-231204fbf6c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:42.596091 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048ccac2-f19b-4f12-b5ca-231204fbf6c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:42.598044 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-048ccac2-f19b-4f12-b5ca-231204fbf6c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:42.611144 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-13416438-14f7-4a84-8152-a655463d65f3 None None] MFA Rules not processed for user `0afeea11519f4227906d17f3bb690616`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:24:42.612964 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048ccac2-f19b-4f12-b5ca-231204fbf6c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:42.613243 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-13416438-14f7-4a84-8152-a655463d65f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:42.614667 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048ccac2-f19b-4f12-b5ca-231204fbf6c3 service neutron] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:42.627444 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 982/1957] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:24:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:24:42.627724 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048ccac2-f19b-4f12-b5ca-231204fbf6c3 service neutron] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:42.629135 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-048ccac2-f19b-4f12-b5ca-231204fbf6c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:42.641465 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048ccac2-f19b-4f12-b5ca-231204fbf6c3 service neutron] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:42.649680 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afd53ee-c9f7-463b-b11d-ff8c3d663469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:42.651059 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd53ee-c9f7-463b-b11d-ff8c3d663469 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:42.651477 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd53ee-c9f7-463b-b11d-ff8c3d663469 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:42.651914 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd53ee-c9f7-463b-b11d-ff8c3d663469 admin admin] PATH_INFO: `/v3/users/42a71816399f404b865397c04f60494e` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:42.654544 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afd53ee-c9f7-463b-b11d-ff8c3d663469 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42a71816399f404b865397c04f60494e)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:42.661594 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afd53ee-c9f7-463b-b11d-ff8c3d663469 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:42.684478 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:42.714167 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 976/1958] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:24:42 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:24:42.715069 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13416438-14f7-4a84-8152-a655463d65f3 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:42.715795 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-5afd53ee-c9f7-463b-b11d-ff8c3d663469 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42a71816399f404b865397c04f60494e'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:42.716388 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-13416438-14f7-4a84-8152-a655463d65f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:42.731532 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-5afd53ee-c9f7-463b-b11d-ff8c3d663469 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42a71816399f404b865397c04f60494e'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:42.732464 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-5afd53ee-c9f7-463b-b11d-ff8c3d663469 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42a71816399f404b865397c04f60494e'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:42.732700 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13416438-14f7-4a84-8152-a655463d65f3 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:42.733247 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-5afd53ee-c9f7-463b-b11d-ff8c3d663469 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42a71816399f404b865397c04f60494e'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:42.739184 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74af5ba3-2e72-45a8-aa29-3182b58dcf48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:42.739963 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74af5ba3-2e72-45a8-aa29-3182b58dcf48 admin admin] REQUEST_METHOD: `PUT` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:42.740254 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74af5ba3-2e72-45a8-aa29-3182b58dcf48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:42.740532 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74af5ba3-2e72-45a8-aa29-3182b58dcf48 admin admin] PATH_INFO: `/v3/projects/66ea75118db7450e8ee9961d12716a24/users/505746d545284430a1ed976d8c8b1932/roles/8a829170b29d42d6af589399e51edb0f` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:42.742530 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74af5ba3-2e72-45a8-aa29-3182b58dcf48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66ea75118db7450e8ee9961d12716a24, user_id=505746d545284430a1ed976d8c8b1932, role_id=8a829170b29d42d6af589399e51edb0f)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:42.742741 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-5afd53ee-c9f7-463b-b11d-ff8c3d663469 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42a71816399f404b865397c04f60494e'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:42.745311 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74af5ba3-2e72-45a8-aa29-3182b58dcf48 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:42.747854 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:42.758636 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 977/1959] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:24:42 2022] PUT /identity/v3/projects/66ea75118db7450e8ee9961d12716a24/users/505746d545284430a1ed976d8c8b1932/roles/8a829170b29d42d6af589399e51edb0f => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:24:42.760357 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74af5ba3-2e72-45a8-aa29-3182b58dcf48 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:42.763873 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-74af5ba3-2e72-45a8-aa29-3182b58dcf48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:42.774936 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 983/1960] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 20 22:24:42 2022] DELETE /identity/v3/users/42a71816399f404b865397c04f60494e => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:24:42.778421 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fb429d-75a2-40b7-b713-c0c3b5087217 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:42.778421 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fb429d-75a2-40b7-b713-c0c3b5087217 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:42.778421 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fb429d-75a2-40b7-b713-c0c3b5087217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:42.814706 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-d9fb429d-75a2-40b7-b713-c0c3b5087217 None None] MFA Rules not processed for user `505746d545284430a1ed976d8c8b1932`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:24:42.816021 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-d9fb429d-75a2-40b7-b713-c0c3b5087217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:42.917567 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 984/1961] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:24:42 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:24:42.930485 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74af5ba3-2e72-45a8-aa29-3182b58dcf48 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:42.942147 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fb429d-75a2-40b7-b713-c0c3b5087217 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:42.944266 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-d9fb429d-75a2-40b7-b713-c0c3b5087217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:43.040725 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f2fd45-92d6-41c4-8ed6-fed883a23083 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577c8b14c1f4279beac13b9ba11aba1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:43.041447 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f2fd45-92d6-41c4-8ed6-fed883a23083 service cinder] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:43.041822 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f2fd45-92d6-41c4-8ed6-fed883a23083 service cinder] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:43.042284 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f2fd45-92d6-41c4-8ed6-fed883a23083 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:43.044720 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-48f2fd45-92d6-41c4-8ed6-fed883a23083 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:43.067579 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fb429d-75a2-40b7-b713-c0c3b5087217 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:43.075557 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadecebe-3a27-4e8e-8b2f-cc38e49b7049 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577c8b14c1f4279beac13b9ba11aba1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:43.076024 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadecebe-3a27-4e8e-8b2f-cc38e49b7049 service cinder] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:43.076303 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadecebe-3a27-4e8e-8b2f-cc38e49b7049 service cinder] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:43.076573 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadecebe-3a27-4e8e-8b2f-cc38e49b7049 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:43.115692 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadecebe-3a27-4e8e-8b2f-cc38e49b7049 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:43.117530 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadecebe-3a27-4e8e-8b2f-cc38e49b7049 service cinder] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:43.131328 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 985/1962] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:24:42 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 20 22:24:43.136919 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadecebe-3a27-4e8e-8b2f-cc38e49b7049 service cinder] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:43.138361 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-dadecebe-3a27-4e8e-8b2f-cc38e49b7049 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:43.162859 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f2fd45-92d6-41c4-8ed6-fed883a23083 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:43.164472 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f2fd45-92d6-41c4-8ed6-fed883a23083 service cinder] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:43.177649 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 978/1963] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:24:42 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:24:43.177999 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:43.276341 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadecebe-3a27-4e8e-8b2f-cc38e49b7049 service cinder] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:43.288775 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae8dc27-0c26-4119-ae34-fa9685ab4d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:43.290625 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae8dc27-0c26-4119-ae34-fa9685ab4d17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:43.290625 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae8dc27-0c26-4119-ae34-fa9685ab4d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:43.290625 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae8dc27-0c26-4119-ae34-fa9685ab4d17 admin admin] PATH_INFO: `/v3/projects/0d8513090dc24b0ab3204b47d934e742` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:43.293765 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae8dc27-0c26-4119-ae34-fa9685ab4d17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d8513090dc24b0ab3204b47d934e742)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:43.296769 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae8dc27-0c26-4119-ae34-fa9685ab4d17 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:43.390549 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-9ae8dc27-0c26-4119-ae34-fa9685ab4d17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d8513090dc24b0ab3204b47d934e742', 'request_id': 'req-9ae8dc27-0c26-4119-ae34-fa9685ab4d17'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:43.397055 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-9ae8dc27-0c26-4119-ae34-fa9685ab4d17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d8513090dc24b0ab3204b47d934e742', 'request_id': 'req-9ae8dc27-0c26-4119-ae34-fa9685ab4d17'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:43.409901 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-9ae8dc27-0c26-4119-ae34-fa9685ab4d17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d8513090dc24b0ab3204b47d934e742', 'request_id': 'req-9ae8dc27-0c26-4119-ae34-fa9685ab4d17'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:43.421234 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f2fd45-92d6-41c4-8ed6-fed883a23083 service cinder] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:43.422813 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-48f2fd45-92d6-41c4-8ed6-fed883a23083 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:43.432120 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-9ae8dc27-0c26-4119-ae34-fa9685ab4d17 admin admin] The token cache is being invalidate because project 0d8513090dc24b0ab3204b47d934e742 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81306) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 22:24:43.432631 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-9ae8dc27-0c26-4119-ae34-fa9685ab4d17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:43.433617 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-9ae8dc27-0c26-4119-ae34-fa9685ab4d17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:43.435478 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 986/1964] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 20 22:24:43 2022] DELETE /identity/v3/projects/0d8513090dc24b0ab3204b47d934e742 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 22:24:43.439187 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f2fd45-92d6-41c4-8ed6-fed883a23083 service cinder] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:43.439861 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae8dc27-0c26-4119-ae34-fa9685ab4d17 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:43.442696 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-9ae8dc27-0c26-4119-ae34-fa9685ab4d17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:43.521824 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3724754-b05d-4f23-8fb1-c235362d517e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:43.522855 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3724754-b05d-4f23-8fb1-c235362d517e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:43.523216 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3724754-b05d-4f23-8fb1-c235362d517e admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:43.523579 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3724754-b05d-4f23-8fb1-c235362d517e admin admin] PATH_INFO: `/v3/users/3e1e55ee2a0b4faf8cc7c18ebe15506c` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:43.526061 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3724754-b05d-4f23-8fb1-c235362d517e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e1e55ee2a0b4faf8cc7c18ebe15506c)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:43.528403 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3724754-b05d-4f23-8fb1-c235362d517e admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:43.531271 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:43.565416 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae8dc27-0c26-4119-ae34-fa9685ab4d17 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:43.571523 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edef4350-596a-45fd-a4ff-f45f73f5b91d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:43.572352 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edef4350-596a-45fd-a4ff-f45f73f5b91d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:43.572638 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edef4350-596a-45fd-a4ff-f45f73f5b91d admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:43.573455 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edef4350-596a-45fd-a4ff-f45f73f5b91d admin admin] PATH_INFO: `/v3/users/8c5e953e9d93403a8974c914e8d66136` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:43.574649 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edef4350-596a-45fd-a4ff-f45f73f5b91d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c5e953e9d93403a8974c914e8d66136)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:43.576756 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edef4350-596a-45fd-a4ff-f45f73f5b91d admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:43.584796 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-e3724754-b05d-4f23-8fb1-c235362d517e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e1e55ee2a0b4faf8cc7c18ebe15506c'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:43.595347 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-e3724754-b05d-4f23-8fb1-c235362d517e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e1e55ee2a0b4faf8cc7c18ebe15506c'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:43.595970 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-e3724754-b05d-4f23-8fb1-c235362d517e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e1e55ee2a0b4faf8cc7c18ebe15506c'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:43.596675 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-e3724754-b05d-4f23-8fb1-c235362d517e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e1e55ee2a0b4faf8cc7c18ebe15506c'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:43.605645 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-e3724754-b05d-4f23-8fb1-c235362d517e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e1e55ee2a0b4faf8cc7c18ebe15506c'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:43.631804 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 979/1965] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 20 22:24:43 2022] DELETE /identity/v3/users/3e1e55ee2a0b4faf8cc7c18ebe15506c => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 22:24:43.633069 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-edef4350-596a-45fd-a4ff-f45f73f5b91d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c5e953e9d93403a8974c914e8d66136'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:43.633666 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3724754-b05d-4f23-8fb1-c235362d517e admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:43.637228 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-e3724754-b05d-4f23-8fb1-c235362d517e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:43.646818 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-edef4350-596a-45fd-a4ff-f45f73f5b91d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c5e953e9d93403a8974c914e8d66136'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:43.647811 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-edef4350-596a-45fd-a4ff-f45f73f5b91d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c5e953e9d93403a8974c914e8d66136'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:43.648802 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-edef4350-596a-45fd-a4ff-f45f73f5b91d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c5e953e9d93403a8974c914e8d66136'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:43.652693 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:43.661207 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-edef4350-596a-45fd-a4ff-f45f73f5b91d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c5e953e9d93403a8974c914e8d66136'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:43.685765 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 987/1966] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 20 22:24:43 2022] DELETE /identity/v3/users/8c5e953e9d93403a8974c914e8d66136 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:24:43.688171 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00500fd8-d8a3-4a6e-9b56-0688e12a2632 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:43.688716 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00500fd8-d8a3-4a6e-9b56-0688e12a2632 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:43.689193 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00500fd8-d8a3-4a6e-9b56-0688e12a2632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:43.718608 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-00500fd8-d8a3-4a6e-9b56-0688e12a2632 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:24:43.720208 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-00500fd8-d8a3-4a6e-9b56-0688e12a2632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:43.747529 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3724754-b05d-4f23-8fb1-c235362d517e admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:43.875152 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 988/1967] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:24:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:24:43.875152 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00500fd8-d8a3-4a6e-9b56-0688e12a2632 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:43.875152 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-00500fd8-d8a3-4a6e-9b56-0688e12a2632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:43.882712 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1f9be3-8f1f-464a-981b-34cb5cd9a663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:43.883622 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1f9be3-8f1f-464a-981b-34cb5cd9a663 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:43.884010 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1f9be3-8f1f-464a-981b-34cb5cd9a663 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:43.884455 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1f9be3-8f1f-464a-981b-34cb5cd9a663 admin admin] PATH_INFO: `/v3/projects/d81b714d4bc54ea9a0ed4beb051d84f6` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:43.892067 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1f9be3-8f1f-464a-981b-34cb5cd9a663 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d81b714d4bc54ea9a0ed4beb051d84f6)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:43.896625 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1f9be3-8f1f-464a-981b-34cb5cd9a663 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:43.959100 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:43.987581 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-4d1f9be3-8f1f-464a-981b-34cb5cd9a663 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd81b714d4bc54ea9a0ed4beb051d84f6', 'request_id': 'req-4d1f9be3-8f1f-464a-981b-34cb5cd9a663'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:43.996735 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-4d1f9be3-8f1f-464a-981b-34cb5cd9a663 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd81b714d4bc54ea9a0ed4beb051d84f6', 'request_id': 'req-4d1f9be3-8f1f-464a-981b-34cb5cd9a663'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:44.006824 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00500fd8-d8a3-4a6e-9b56-0688e12a2632 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:44.009494 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-4d1f9be3-8f1f-464a-981b-34cb5cd9a663 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd81b714d4bc54ea9a0ed4beb051d84f6', 'request_id': 'req-4d1f9be3-8f1f-464a-981b-34cb5cd9a663'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:44.040958 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-4d1f9be3-8f1f-464a-981b-34cb5cd9a663 admin admin] The token cache is being invalidate because project d81b714d4bc54ea9a0ed4beb051d84f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81307) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 22:24:44.041471 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-4d1f9be3-8f1f-464a-981b-34cb5cd9a663 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:44.043076 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-4d1f9be3-8f1f-464a-981b-34cb5cd9a663 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:44.045619 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 980/1968] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 20 22:24:43 2022] DELETE /identity/v3/projects/d81b714d4bc54ea9a0ed4beb051d84f6 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:24:44.047129 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1f9be3-8f1f-464a-981b-34cb5cd9a663 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:44.048821 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-4d1f9be3-8f1f-464a-981b-34cb5cd9a663 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:44.126849 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1f9be3-8f1f-464a-981b-34cb5cd9a663 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:44.130872 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd18255-1dd8-4a35-8b6b-e00ae1a3b4aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b0b3ca4ecd41aaba9cf8e0f91fbf54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:44.131493 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd18255-1dd8-4a35-8b6b-e00ae1a3b4aa service neutron] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:44.131828 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd18255-1dd8-4a35-8b6b-e00ae1a3b4aa service neutron] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:44.132160 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd18255-1dd8-4a35-8b6b-e00ae1a3b4aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:44.134162 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-fbd18255-1dd8-4a35-8b6b-e00ae1a3b4aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:44.140347 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd88ec19-9413-4d82-b28e-a3a08591cd4f tempest-VolumeQuotaClassesTest-308868602 tempest-VolumeQuotaClassesTest-308868602-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '505746d545284430a1ed976d8c8b1932', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ea75118db7450e8ee9961d12716a24', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:44.140978 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd88ec19-9413-4d82-b28e-a3a08591cd4f tempest-VolumeQuotaClassesTest-308868602 tempest-VolumeQuotaClassesTest-308868602-project-admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:44.141819 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd88ec19-9413-4d82-b28e-a3a08591cd4f tempest-VolumeQuotaClassesTest-308868602 tempest-VolumeQuotaClassesTest-308868602-project-admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:44.142106 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd88ec19-9413-4d82-b28e-a3a08591cd4f tempest-VolumeQuotaClassesTest-308868602 tempest-VolumeQuotaClassesTest-308868602-project-admin] PATH_INFO: `/v3/domains` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:44.142977 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd88ec19-9413-4d82-b28e-a3a08591cd4f tempest-VolumeQuotaClassesTest-308868602 tempest-VolumeQuotaClassesTest-308868602-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:24:44.143288 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd88ec19-9413-4d82-b28e-a3a08591cd4f tempest-VolumeQuotaClassesTest-308868602 tempest-VolumeQuotaClassesTest-308868602-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:44.145208 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd88ec19-9413-4d82-b28e-a3a08591cd4f tempest-VolumeQuotaClassesTest-308868602 tempest-VolumeQuotaClassesTest-308868602-project-admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:44.165540 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 989/1969] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 20 22:24:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:24:44.171424 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd88ec19-9413-4d82-b28e-a3a08591cd4f tempest-VolumeQuotaClassesTest-308868602 tempest-VolumeQuotaClassesTest-308868602-project-admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:44.173343 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-dd88ec19-9413-4d82-b28e-a3a08591cd4f tempest-VolumeQuotaClassesTest-308868602 tempest-VolumeQuotaClassesTest-308868602-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:44.199443 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:44.225324 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd18255-1dd8-4a35-8b6b-e00ae1a3b4aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:44.227143 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd18255-1dd8-4a35-8b6b-e00ae1a3b4aa service neutron] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:44.240971 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 981/1970] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:24:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:24:44.242177 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f499b823-4a61-4338-9e5f-d9453019db0e None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:44.242468 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f499b823-4a61-4338-9e5f-d9453019db0e None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:44.242766 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f499b823-4a61-4338-9e5f-d9453019db0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:44.267816 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-f499b823-4a61-4338-9e5f-d9453019db0e None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:24:44.269863 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-f499b823-4a61-4338-9e5f-d9453019db0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:44.272648 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd88ec19-9413-4d82-b28e-a3a08591cd4f tempest-VolumeQuotaClassesTest-308868602 tempest-VolumeQuotaClassesTest-308868602-project-admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:44.277369 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac2d691-d241-41f3-8948-bbaa25d43e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:44.278002 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac2d691-d241-41f3-8948-bbaa25d43e7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:44.278280 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac2d691-d241-41f3-8948-bbaa25d43e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:44.278640 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac2d691-d241-41f3-8948-bbaa25d43e7c admin admin] PATH_INFO: `/v3/projects/554a91343cda411482be11a2dc37a39d` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:44.279736 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac2d691-d241-41f3-8948-bbaa25d43e7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=554a91343cda411482be11a2dc37a39d)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:44.281851 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac2d691-d241-41f3-8948-bbaa25d43e7c admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:44.284447 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 982/1971] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:24:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:24:44.285354 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f499b823-4a61-4338-9e5f-d9453019db0e None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:44.286794 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-f499b823-4a61-4338-9e5f-d9453019db0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:44.303000 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f499b823-4a61-4338-9e5f-d9453019db0e None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:44.310752 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab778021-64da-4bac-a697-1b6f139dc5aa tempest-VolumeQuotaClassesTest-308868602 tempest-VolumeQuotaClassesTest-308868602-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '505746d545284430a1ed976d8c8b1932', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ea75118db7450e8ee9961d12716a24', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:44.311552 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab778021-64da-4bac-a697-1b6f139dc5aa tempest-VolumeQuotaClassesTest-308868602 tempest-VolumeQuotaClassesTest-308868602-project-admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:44.311958 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab778021-64da-4bac-a697-1b6f139dc5aa tempest-VolumeQuotaClassesTest-308868602 tempest-VolumeQuotaClassesTest-308868602-project-admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:44.312235 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab778021-64da-4bac-a697-1b6f139dc5aa tempest-VolumeQuotaClassesTest-308868602 tempest-VolumeQuotaClassesTest-308868602-project-admin] PATH_INFO: `/v3/projects` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:44.313774 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab778021-64da-4bac-a697-1b6f139dc5aa tempest-VolumeQuotaClassesTest-308868602 tempest-VolumeQuotaClassesTest-308868602-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:44.315961 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab778021-64da-4bac-a697-1b6f139dc5aa tempest-VolumeQuotaClassesTest-308868602 tempest-VolumeQuotaClassesTest-308868602-project-admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:44.344456 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-3ac2d691-d241-41f3-8948-bbaa25d43e7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '554a91343cda411482be11a2dc37a39d', 'request_id': 'req-3ac2d691-d241-41f3-8948-bbaa25d43e7c'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:44.352055 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-3ac2d691-d241-41f3-8948-bbaa25d43e7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '554a91343cda411482be11a2dc37a39d', 'request_id': 'req-3ac2d691-d241-41f3-8948-bbaa25d43e7c'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:44.354574 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 983/1972] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 20 22:24:44 2022] POST /identity/v3/projects => generated 354 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:24:44.355849 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21f01f6-8f13-4b3f-bb85-e4a33ad9980b None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:44.356140 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21f01f6-8f13-4b3f-bb85-e4a33ad9980b None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:44.356418 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21f01f6-8f13-4b3f-bb85-e4a33ad9980b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:44.365926 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-3ac2d691-d241-41f3-8948-bbaa25d43e7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '554a91343cda411482be11a2dc37a39d', 'request_id': 'req-3ac2d691-d241-41f3-8948-bbaa25d43e7c'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:44.386540 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-c21f01f6-8f13-4b3f-bb85-e4a33ad9980b None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:24:44.386738 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-3ac2d691-d241-41f3-8948-bbaa25d43e7c admin admin] The token cache is being invalidate because project 554a91343cda411482be11a2dc37a39d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81306) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 22:24:44.386738 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-3ac2d691-d241-41f3-8948-bbaa25d43e7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:44.386901 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-c21f01f6-8f13-4b3f-bb85-e4a33ad9980b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:44.387018 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-3ac2d691-d241-41f3-8948-bbaa25d43e7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:44.387018 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 990/1973] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 20 22:24:44 2022] DELETE /identity/v3/projects/554a91343cda411482be11a2dc37a39d => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:24:44.387018 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac2d691-d241-41f3-8948-bbaa25d43e7c admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:44.388386 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-3ac2d691-d241-41f3-8948-bbaa25d43e7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:44.437156 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:44.469260 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac2d691-d241-41f3-8948-bbaa25d43e7c admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:44.486468 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 984/1974] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:24:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:24:44.487621 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd1050-bd5e-46bd-b1fa-a17cd556d212 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:44.487910 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd1050-bd5e-46bd-b1fa-a17cd556d212 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:44.488184 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd1050-bd5e-46bd-b1fa-a17cd556d212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:44.520480 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-46cd1050-bd5e-46bd-b1fa-a17cd556d212 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:24:44.521817 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-46cd1050-bd5e-46bd-b1fa-a17cd556d212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:44.533446 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:44.534029 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 985/1975] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:24:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:24:44.535971 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cd1050-bd5e-46bd-b1fa-a17cd556d212 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:44.556473 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cd1050-bd5e-46bd-b1fa-a17cd556d212 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:44.561429 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaa9b67-29eb-47ee-8f0c-ca908726b35e tempest-VolumeQuotaClassesTest-308868602 tempest-VolumeQuotaClassesTest-308868602-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '505746d545284430a1ed976d8c8b1932', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ea75118db7450e8ee9961d12716a24', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:44.562598 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaa9b67-29eb-47ee-8f0c-ca908726b35e tempest-VolumeQuotaClassesTest-308868602 tempest-VolumeQuotaClassesTest-308868602-project-admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:44.563382 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaa9b67-29eb-47ee-8f0c-ca908726b35e tempest-VolumeQuotaClassesTest-308868602 tempest-VolumeQuotaClassesTest-308868602-project-admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:44.563766 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaa9b67-29eb-47ee-8f0c-ca908726b35e tempest-VolumeQuotaClassesTest-308868602 tempest-VolumeQuotaClassesTest-308868602-project-admin] PATH_INFO: `/v3/domains` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:44.564715 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaa9b67-29eb-47ee-8f0c-ca908726b35e tempest-VolumeQuotaClassesTest-308868602 tempest-VolumeQuotaClassesTest-308868602-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:24:44.565084 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e44ef84-5616-4841-a214-f524f54aecd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:44.565225 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaa9b67-29eb-47ee-8f0c-ca908726b35e tempest-VolumeQuotaClassesTest-308868602 tempest-VolumeQuotaClassesTest-308868602-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:44.565709 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e44ef84-5616-4841-a214-f524f54aecd7 admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:44.566204 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e44ef84-5616-4841-a214-f524f54aecd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:44.566556 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e44ef84-5616-4841-a214-f524f54aecd7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:44.567639 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e44ef84-5616-4841-a214-f524f54aecd7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:24:44.567797 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaa9b67-29eb-47ee-8f0c-ca908726b35e tempest-VolumeQuotaClassesTest-308868602 tempest-VolumeQuotaClassesTest-308868602-project-admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:44.567940 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e44ef84-5616-4841-a214-f524f54aecd7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:44.569826 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e44ef84-5616-4841-a214-f524f54aecd7 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:44.598768 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 991/1976] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 20 22:24:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:24:44.601227 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c9b820-5fc7-4589-b63f-1bfc304cdebe None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:44.601736 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c9b820-5fc7-4589-b63f-1bfc304cdebe None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:44.602117 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c9b820-5fc7-4589-b63f-1bfc304cdebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:44.604732 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 986/1977] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 20 22:24:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:24:44.609264 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e44ef84-5616-4841-a214-f524f54aecd7 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:44.623819 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e44ef84-5616-4841-a214-f524f54aecd7 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:44.628912 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77618a47-1a01-4b73-911d-30b5addd876f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:44.629602 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77618a47-1a01-4b73-911d-30b5addd876f admin admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:44.629987 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77618a47-1a01-4b73-911d-30b5addd876f admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:44.630325 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77618a47-1a01-4b73-911d-30b5addd876f admin admin] PATH_INFO: `/v3/projects` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:44.631250 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77618a47-1a01-4b73-911d-30b5addd876f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:44.635016 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77618a47-1a01-4b73-911d-30b5addd876f admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:44.637636 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-63c9b820-5fc7-4589-b63f-1bfc304cdebe None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:24:44.645341 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-63c9b820-5fc7-4589-b63f-1bfc304cdebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:44.655100 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 992/1978] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:24:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:24:44.656155 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c9b820-5fc7-4589-b63f-1bfc304cdebe None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:44.670174 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c9b820-5fc7-4589-b63f-1bfc304cdebe None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:44.675596 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 987/1979] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 20 22:24:44 2022] POST /identity/v3/projects => generated 377 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:24:44.676543 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77618a47-1a01-4b73-911d-30b5addd876f admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:44.737849 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abb6029-ba97-4c71-b964-b990f94675d2 tempest-VolumeQuotaClassesTest-308868602 tempest-VolumeQuotaClassesTest-308868602-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '505746d545284430a1ed976d8c8b1932', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ea75118db7450e8ee9961d12716a24', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:44.738481 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abb6029-ba97-4c71-b964-b990f94675d2 tempest-VolumeQuotaClassesTest-308868602 tempest-VolumeQuotaClassesTest-308868602-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:44.738810 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abb6029-ba97-4c71-b964-b990f94675d2 tempest-VolumeQuotaClassesTest-308868602 tempest-VolumeQuotaClassesTest-308868602-project-admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:44.739633 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abb6029-ba97-4c71-b964-b990f94675d2 tempest-VolumeQuotaClassesTest-308868602 tempest-VolumeQuotaClassesTest-308868602-project-admin] PATH_INFO: `/v3/projects/162bc1c7584d4557bf40f8a15d7eb356` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:44.741402 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abb6029-ba97-4c71-b964-b990f94675d2 tempest-VolumeQuotaClassesTest-308868602 tempest-VolumeQuotaClassesTest-308868602-project-admin] RBAC: Authorizing `identity:delete_project(project_id=162bc1c7584d4557bf40f8a15d7eb356)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:44.743714 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abb6029-ba97-4c71-b964-b990f94675d2 tempest-VolumeQuotaClassesTest-308868602 tempest-VolumeQuotaClassesTest-308868602-project-admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:44.757359 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77618a47-1a01-4b73-911d-30b5addd876f admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:44.762470 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20698e08-159b-407a-a792-e647b9724eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:44.763201 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20698e08-159b-407a-a792-e647b9724eb8 admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:44.763459 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20698e08-159b-407a-a792-e647b9724eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:44.763721 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20698e08-159b-407a-a792-e647b9724eb8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:44.778752 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20698e08-159b-407a-a792-e647b9724eb8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:24:44.778752 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20698e08-159b-407a-a792-e647b9724eb8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:44.778752 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20698e08-159b-407a-a792-e647b9724eb8 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:44.793561 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 988/1980] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 20 22:24:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:24:44.794421 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20698e08-159b-407a-a792-e647b9724eb8 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:44.797707 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-9abb6029-ba97-4c71-b964-b990f94675d2 tempest-VolumeQuotaClassesTest-308868602 tempest-VolumeQuotaClassesTest-308868602-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '162bc1c7584d4557bf40f8a15d7eb356', 'request_id': 'req-9abb6029-ba97-4c71-b964-b990f94675d2'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:44.804099 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-9abb6029-ba97-4c71-b964-b990f94675d2 tempest-VolumeQuotaClassesTest-308868602 tempest-VolumeQuotaClassesTest-308868602-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '162bc1c7584d4557bf40f8a15d7eb356', 'request_id': 'req-9abb6029-ba97-4c71-b964-b990f94675d2'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:44.804328 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20698e08-159b-407a-a792-e647b9724eb8 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:44.813060 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-9abb6029-ba97-4c71-b964-b990f94675d2 tempest-VolumeQuotaClassesTest-308868602 tempest-VolumeQuotaClassesTest-308868602-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '162bc1c7584d4557bf40f8a15d7eb356', 'request_id': 'req-9abb6029-ba97-4c71-b964-b990f94675d2'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:44.823508 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-9abb6029-ba97-4c71-b964-b990f94675d2 tempest-VolumeQuotaClassesTest-308868602 tempest-VolumeQuotaClassesTest-308868602-project-admin] The token cache is being invalidate because project 162bc1c7584d4557bf40f8a15d7eb356 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81306) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 22:24:44.823795 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-9abb6029-ba97-4c71-b964-b990f94675d2 tempest-VolumeQuotaClassesTest-308868602 tempest-VolumeQuotaClassesTest-308868602-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:44.824451 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-9abb6029-ba97-4c71-b964-b990f94675d2 tempest-VolumeQuotaClassesTest-308868602 tempest-VolumeQuotaClassesTest-308868602-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:44.825958 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 993/1981] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 20 22:24:44 2022] DELETE /identity/v3/projects/162bc1c7584d4557bf40f8a15d7eb356 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:24:44.826739 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abb6029-ba97-4c71-b964-b990f94675d2 tempest-VolumeQuotaClassesTest-308868602 tempest-VolumeQuotaClassesTest-308868602-project-admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:44.828033 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-9abb6029-ba97-4c71-b964-b990f94675d2 tempest-VolumeQuotaClassesTest-308868602 tempest-VolumeQuotaClassesTest-308868602-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:44.867065 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5925abf4-dd93-4537-8f2e-6391ca2c702a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:44.867697 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5925abf4-dd93-4537-8f2e-6391ca2c702a admin admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:44.867971 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5925abf4-dd93-4537-8f2e-6391ca2c702a admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:44.868239 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5925abf4-dd93-4537-8f2e-6391ca2c702a admin admin] PATH_INFO: `/v3/users` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:44.868864 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5925abf4-dd93-4537-8f2e-6391ca2c702a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:44.871215 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5925abf4-dd93-4537-8f2e-6391ca2c702a admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:44.895186 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 989/1982] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 20 22:24:44 2022] POST /identity/v3/users => generated 289 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:24:44.896313 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5925abf4-dd93-4537-8f2e-6391ca2c702a admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:44.898288 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-5925abf4-dd93-4537-8f2e-6391ca2c702a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:44.906184 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abb6029-ba97-4c71-b964-b990f94675d2 tempest-VolumeQuotaClassesTest-308868602 tempest-VolumeQuotaClassesTest-308868602-project-admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:44.913050 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5925abf4-dd93-4537-8f2e-6391ca2c702a admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:44.913224 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e7627a-b9aa-4776-bd6d-a7c08c0b64b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:44.913335 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e7627a-b9aa-4776-bd6d-a7c08c0b64b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:44.913560 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e7627a-b9aa-4776-bd6d-a7c08c0b64b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:44.913832 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e7627a-b9aa-4776-bd6d-a7c08c0b64b1 admin admin] PATH_INFO: `/v3/projects/728efa4eb79642a5881258e61eb6b83e` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:44.915664 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e7627a-b9aa-4776-bd6d-a7c08c0b64b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=728efa4eb79642a5881258e61eb6b83e)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:44.918389 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10e3025-a896-4e6b-98cb-2229315adc3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:44.918550 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e7627a-b9aa-4776-bd6d-a7c08c0b64b1 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:44.919357 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10e3025-a896-4e6b-98cb-2229315adc3d admin admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:44.919780 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10e3025-a896-4e6b-98cb-2229315adc3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:44.920510 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10e3025-a896-4e6b-98cb-2229315adc3d admin admin] PATH_INFO: `/v3/projects` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:44.921312 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10e3025-a896-4e6b-98cb-2229315adc3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:44.923833 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10e3025-a896-4e6b-98cb-2229315adc3d admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:44.933111 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:44.954948 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:44.970516 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 990/1983] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 20 22:24:44 2022] POST /identity/v3/projects => generated 371 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:24:44.971539 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10e3025-a896-4e6b-98cb-2229315adc3d admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:44.973825 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-e10e3025-a896-4e6b-98cb-2229315adc3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:44.990338 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-51e7627a-b9aa-4776-bd6d-a7c08c0b64b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '728efa4eb79642a5881258e61eb6b83e', 'request_id': 'req-51e7627a-b9aa-4776-bd6d-a7c08c0b64b1'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:45.000268 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-51e7627a-b9aa-4776-bd6d-a7c08c0b64b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '728efa4eb79642a5881258e61eb6b83e', 'request_id': 'req-51e7627a-b9aa-4776-bd6d-a7c08c0b64b1'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:45.016296 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-51e7627a-b9aa-4776-bd6d-a7c08c0b64b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '728efa4eb79642a5881258e61eb6b83e', 'request_id': 'req-51e7627a-b9aa-4776-bd6d-a7c08c0b64b1'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:45.033357 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-51e7627a-b9aa-4776-bd6d-a7c08c0b64b1 admin admin] The token cache is being invalidate because project 728efa4eb79642a5881258e61eb6b83e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81306) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 22:24:45.033792 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-51e7627a-b9aa-4776-bd6d-a7c08c0b64b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:45.034600 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-51e7627a-b9aa-4776-bd6d-a7c08c0b64b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:45.036687 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 994/1984] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 20 22:24:44 2022] DELETE /identity/v3/projects/728efa4eb79642a5881258e61eb6b83e => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:24:45.039991 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e7627a-b9aa-4776-bd6d-a7c08c0b64b1 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:45.039991 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-51e7627a-b9aa-4776-bd6d-a7c08c0b64b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:45.065544 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10e3025-a896-4e6b-98cb-2229315adc3d admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:45.128120 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e7627a-b9aa-4776-bd6d-a7c08c0b64b1 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:45.133094 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde4dfa0-1034-485a-a35e-b4c7777efbab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:45.133772 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde4dfa0-1034-485a-a35e-b4c7777efbab admin admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:45.134122 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde4dfa0-1034-485a-a35e-b4c7777efbab admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:45.134464 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde4dfa0-1034-485a-a35e-b4c7777efbab admin admin] PATH_INFO: `/v3/users` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:45.135746 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde4dfa0-1034-485a-a35e-b4c7777efbab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:45.137871 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde4dfa0-1034-485a-a35e-b4c7777efbab admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:45.141046 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8a4276-af8b-4df3-967b-215a58171913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:45.141751 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a4276-af8b-4df3-967b-215a58171913 admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:45.142038 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a4276-af8b-4df3-967b-215a58171913 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:45.142311 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a4276-af8b-4df3-967b-215a58171913 admin admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:45.143004 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8a4276-af8b-4df3-967b-215a58171913 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:45.144595 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8a4276-af8b-4df3-967b-215a58171913 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:45.157378 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 991/1985] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:24:44 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:24:45.158160 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8a4276-af8b-4df3-967b-215a58171913 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:45.159917 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-bb8a4276-af8b-4df3-967b-215a58171913 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:45.170637 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 995/1986] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 20 22:24:45 2022] POST /identity/v3/users => generated 286 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:24:45.170637 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde4dfa0-1034-485a-a35e-b4c7777efbab admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:45.172642 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-fde4dfa0-1034-485a-a35e-b4c7777efbab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:45.174210 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8a4276-af8b-4df3-967b-215a58171913 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:45.179220 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1939f55e-06c0-4a90-ac2b-224c059b36de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:45.180505 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1939f55e-06c0-4a90-ac2b-224c059b36de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:45.180505 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1939f55e-06c0-4a90-ac2b-224c059b36de admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:45.180836 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1939f55e-06c0-4a90-ac2b-224c059b36de admin admin] PATH_INFO: `/v3/users/0afeea11519f4227906d17f3bb690616` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:45.182698 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1939f55e-06c0-4a90-ac2b-224c059b36de admin admin] RBAC: Authorizing `identity:delete_user(user_id=0afeea11519f4227906d17f3bb690616)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:45.184683 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1939f55e-06c0-4a90-ac2b-224c059b36de admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:45.186814 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde4dfa0-1034-485a-a35e-b4c7777efbab admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:45.191678 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4533a4-0dac-4c50-a948-53c53f71d86d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:45.192385 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4533a4-0dac-4c50-a948-53c53f71d86d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:45.192730 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4533a4-0dac-4c50-a948-53c53f71d86d admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:45.193066 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4533a4-0dac-4c50-a948-53c53f71d86d admin admin] PATH_INFO: `/v3/users/ee0bd59ffb3f40209721d7b8ccd45959` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:45.194250 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4533a4-0dac-4c50-a948-53c53f71d86d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee0bd59ffb3f40209721d7b8ccd45959)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:45.196245 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4533a4-0dac-4c50-a948-53c53f71d86d admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:45.232292 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-1939f55e-06c0-4a90-ac2b-224c059b36de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0afeea11519f4227906d17f3bb690616'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:45.238995 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-1939f55e-06c0-4a90-ac2b-224c059b36de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0afeea11519f4227906d17f3bb690616'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:45.239915 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-1939f55e-06c0-4a90-ac2b-224c059b36de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0afeea11519f4227906d17f3bb690616'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:45.240837 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-1939f55e-06c0-4a90-ac2b-224c059b36de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0afeea11519f4227906d17f3bb690616'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:45.242615 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-2b4533a4-0dac-4c50-a948-53c53f71d86d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee0bd59ffb3f40209721d7b8ccd45959'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:45.249431 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-1939f55e-06c0-4a90-ac2b-224c059b36de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0afeea11519f4227906d17f3bb690616'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:45.252091 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-2b4533a4-0dac-4c50-a948-53c53f71d86d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee0bd59ffb3f40209721d7b8ccd45959'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:45.253081 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-2b4533a4-0dac-4c50-a948-53c53f71d86d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee0bd59ffb3f40209721d7b8ccd45959'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:45.253704 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-2b4533a4-0dac-4c50-a948-53c53f71d86d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee0bd59ffb3f40209721d7b8ccd45959'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:45.264592 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-2b4533a4-0dac-4c50-a948-53c53f71d86d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee0bd59ffb3f40209721d7b8ccd45959'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:45.277873 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 992/1987] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 20 22:24:45 2022] DELETE /identity/v3/users/0afeea11519f4227906d17f3bb690616 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:24:45.278921 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1939f55e-06c0-4a90-ac2b-224c059b36de admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:45.280284 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-1939f55e-06c0-4a90-ac2b-224c059b36de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:45.287386 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 996/1988] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 20 22:24:45 2022] DELETE /identity/v3/users/ee0bd59ffb3f40209721d7b8ccd45959 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:24:45.288350 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4533a4-0dac-4c50-a948-53c53f71d86d admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:45.292856 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-2b4533a4-0dac-4c50-a948-53c53f71d86d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:45.304365 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=78,keystone:DELETE=17,keystone:INSERT=5 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:45.336104 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:45.469661 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4533a4-0dac-4c50-a948-53c53f71d86d admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:45.476368 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1939f55e-06c0-4a90-ac2b-224c059b36de admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:45.485576 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef87c53-4c49-488d-8a98-c9b289dabfaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:45.487000 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef87c53-4c49-488d-8a98-c9b289dabfaf admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:45.489650 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef87c53-4c49-488d-8a98-c9b289dabfaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:45.490028 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef87c53-4c49-488d-8a98-c9b289dabfaf admin admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:45.491492 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132d057e-7b7d-4af4-bc67-ba1c846ed54f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:45.493324 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef87c53-4c49-488d-8a98-c9b289dabfaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:45.493445 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132d057e-7b7d-4af4-bc67-ba1c846ed54f admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:45.494661 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132d057e-7b7d-4af4-bc67-ba1c846ed54f admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:45.495107 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132d057e-7b7d-4af4-bc67-ba1c846ed54f admin admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:45.496985 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef87c53-4c49-488d-8a98-c9b289dabfaf admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:45.497769 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132d057e-7b7d-4af4-bc67-ba1c846ed54f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:45.502110 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132d057e-7b7d-4af4-bc67-ba1c846ed54f admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:45.529994 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 997/1989] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:24:45 2022] GET /identity/v3/roles => generated 1420 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:24:45.531318 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1774fc7f-9266-4529-ba36-6ab2b5b66e4d None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:45.531606 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1774fc7f-9266-4529-ba36-6ab2b5b66e4d None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:45.531904 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1774fc7f-9266-4529-ba36-6ab2b5b66e4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:45.535802 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 993/1990] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:24:45 2022] GET /identity/v3/roles => generated 1420 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:24:45.537036 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132d057e-7b7d-4af4-bc67-ba1c846ed54f admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:45.563035 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132d057e-7b7d-4af4-bc67-ba1c846ed54f admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:45.574089 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84628a1a-5184-4f40-9054-e9d4bc1edb6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:45.575461 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84628a1a-5184-4f40-9054-e9d4bc1edb6e admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:45.577891 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84628a1a-5184-4f40-9054-e9d4bc1edb6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:45.578196 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84628a1a-5184-4f40-9054-e9d4bc1edb6e admin admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:45.578943 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84628a1a-5184-4f40-9054-e9d4bc1edb6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:45.580497 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-1774fc7f-9266-4529-ba36-6ab2b5b66e4d None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:24:45.581783 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-1774fc7f-9266-4529-ba36-6ab2b5b66e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:45.583127 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84628a1a-5184-4f40-9054-e9d4bc1edb6e admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:45.616794 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 998/1991] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:24:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:24:45.616794 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1774fc7f-9266-4529-ba36-6ab2b5b66e4d None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:45.619723 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 994/1992] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:24:45 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:24:45.620283 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-1774fc7f-9266-4529-ba36-6ab2b5b66e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:45.623358 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84628a1a-5184-4f40-9054-e9d4bc1edb6e admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:45.656771 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84628a1a-5184-4f40-9054-e9d4bc1edb6e admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:45.662123 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1774fc7f-9266-4529-ba36-6ab2b5b66e4d None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:45.672243 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025c074c-2e64-48a1-83c9-fb18bbe357ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:45.675676 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025c074c-2e64-48a1-83c9-fb18bbe357ea admin admin] REQUEST_METHOD: `PUT` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:45.676941 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025c074c-2e64-48a1-83c9-fb18bbe357ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:45.678628 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025c074c-2e64-48a1-83c9-fb18bbe357ea admin admin] PATH_INFO: `/v3/projects/51ca212236254e828b1a59c98ed65314/users/5f32e325258a414187ae2f09584c5213/roles/604444e7ad0d437dbd1f5a6e02b761f5` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:45.682163 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6e64e8-89d9-4225-837b-ec561f514628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:45.683242 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6e64e8-89d9-4225-837b-ec561f514628 admin admin] REQUEST_METHOD: `PUT` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:45.683675 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6e64e8-89d9-4225-837b-ec561f514628 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:45.684098 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6e64e8-89d9-4225-837b-ec561f514628 admin admin] PATH_INFO: `/v3/projects/b63218033a734750b846281d0533cd9e/users/89b360e0e34a4d19a267835d4697efa9/roles/604444e7ad0d437dbd1f5a6e02b761f5` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:45.712632 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025c074c-2e64-48a1-83c9-fb18bbe357ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=51ca212236254e828b1a59c98ed65314, user_id=5f32e325258a414187ae2f09584c5213, role_id=604444e7ad0d437dbd1f5a6e02b761f5)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:45.719747 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6e64e8-89d9-4225-837b-ec561f514628 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b63218033a734750b846281d0533cd9e, user_id=89b360e0e34a4d19a267835d4697efa9, role_id=604444e7ad0d437dbd1f5a6e02b761f5)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:45.722628 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6e64e8-89d9-4225-837b-ec561f514628 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:45.722969 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025c074c-2e64-48a1-83c9-fb18bbe357ea admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:45.740851 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 999/1993] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:24:45 2022] PUT /identity/v3/projects/b63218033a734750b846281d0533cd9e/users/89b360e0e34a4d19a267835d4697efa9/roles/604444e7ad0d437dbd1f5a6e02b761f5 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:24:45.742096 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6e64e8-89d9-4225-837b-ec561f514628 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:45.751497 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-bd6e64e8-89d9-4225-837b-ec561f514628 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:45.755318 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 995/1994] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:24:45 2022] PUT /identity/v3/projects/51ca212236254e828b1a59c98ed65314/users/5f32e325258a414187ae2f09584c5213/roles/604444e7ad0d437dbd1f5a6e02b761f5 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:24:45.756709 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8163322f-abe9-4ec9-a102-bf3a64812eb7 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:45.757049 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8163322f-abe9-4ec9-a102-bf3a64812eb7 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:45.757324 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8163322f-abe9-4ec9-a102-bf3a64812eb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:45.803196 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-8163322f-abe9-4ec9-a102-bf3a64812eb7 None None] MFA Rules not processed for user `89b360e0e34a4d19a267835d4697efa9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:24:45.804828 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-8163322f-abe9-4ec9-a102-bf3a64812eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:45.841888 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6e64e8-89d9-4225-837b-ec561f514628 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:45.891703 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 996/1995] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:24:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:24:45.893713 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378eb34-6efd-4faa-8e1e-710ac6ec11c8 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:45.894403 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378eb34-6efd-4faa-8e1e-710ac6ec11c8 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:45.894981 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378eb34-6efd-4faa-8e1e-710ac6ec11c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:45.906058 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e38dae-f5de-4df2-b1c9-34b69d66bfb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b0b3ca4ecd41aaba9cf8e0f91fbf54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:45.907147 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e38dae-f5de-4df2-b1c9-34b69d66bfb3 service neutron] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:45.907688 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e38dae-f5de-4df2-b1c9-34b69d66bfb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:45.907688 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e38dae-f5de-4df2-b1c9-34b69d66bfb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:45.979564 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-c378eb34-6efd-4faa-8e1e-710ac6ec11c8 None None] MFA Rules not processed for user `5f32e325258a414187ae2f09584c5213`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:24:45.981180 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-c378eb34-6efd-4faa-8e1e-710ac6ec11c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:45.982302 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:46.015622 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e38dae-f5de-4df2-b1c9-34b69d66bfb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:46.017528 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e38dae-f5de-4df2-b1c9-34b69d66bfb3 service neutron] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:46.032106 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1000/1996] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:24:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:24:46.033186 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e38dae-f5de-4df2-b1c9-34b69d66bfb3 service neutron] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:46.048356 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e38dae-f5de-4df2-b1c9-34b69d66bfb3 service neutron] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:46.055484 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addef5bb-97c8-4f58-826f-df7bb516fe41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:46.056397 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addef5bb-97c8-4f58-826f-df7bb516fe41 admin admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:46.057355 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addef5bb-97c8-4f58-826f-df7bb516fe41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:46.058635 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addef5bb-97c8-4f58-826f-df7bb516fe41 admin admin] PATH_INFO: `/v3/projects` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:46.060200 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addef5bb-97c8-4f58-826f-df7bb516fe41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:46.062396 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addef5bb-97c8-4f58-826f-df7bb516fe41 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:46.119677 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1001/1997] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 20 22:24:46 2022] POST /identity/v3/projects => generated 379 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:24:46.127563 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addef5bb-97c8-4f58-826f-df7bb516fe41 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:46.129326 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:46.154529 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 997/1998] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:24:45 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:24:46.156038 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c378eb34-6efd-4faa-8e1e-710ac6ec11c8 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:46.184479 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c378eb34-6efd-4faa-8e1e-710ac6ec11c8 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:46.294354 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addef5bb-97c8-4f58-826f-df7bb516fe41 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:46.313995 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b5a573-8d00-4197-a37a-2c3d066934bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:46.313995 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b5a573-8d00-4197-a37a-2c3d066934bf admin admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:46.313995 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b5a573-8d00-4197-a37a-2c3d066934bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:46.313995 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b5a573-8d00-4197-a37a-2c3d066934bf admin admin] PATH_INFO: `/v3/users` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:46.327045 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b5a573-8d00-4197-a37a-2c3d066934bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:46.333804 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b5a573-8d00-4197-a37a-2c3d066934bf admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:46.383884 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1002/1999] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 20 22:24:46 2022] POST /identity/v3/users => generated 290 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:24:46.386875 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4b6f9e-353f-47f8-b2f6-e47085978a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:46.388778 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b5a573-8d00-4197-a37a-2c3d066934bf admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:46.389298 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4b6f9e-353f-47f8-b2f6-e47085978a80 admin admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:46.389753 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4b6f9e-353f-47f8-b2f6-e47085978a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:46.391509 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4b6f9e-353f-47f8-b2f6-e47085978a80 admin admin] PATH_INFO: `/v3/projects` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:46.392733 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4b6f9e-353f-47f8-b2f6-e47085978a80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:46.402356 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4b6f9e-353f-47f8-b2f6-e47085978a80 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:46.417820 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b5a573-8d00-4197-a37a-2c3d066934bf admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:46.429606 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96f4b99-e8aa-4bcc-9202-f3d23e3a07bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:46.430887 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f4b99-e8aa-4bcc-9202-f3d23e3a07bd admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:46.432630 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f4b99-e8aa-4bcc-9202-f3d23e3a07bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:46.432979 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f4b99-e8aa-4bcc-9202-f3d23e3a07bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:46.433701 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96f4b99-e8aa-4bcc-9202-f3d23e3a07bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:46.437783 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96f4b99-e8aa-4bcc-9202-f3d23e3a07bd admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:46.476404 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 998/2000] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 20 22:24:46 2022] POST /identity/v3/projects => generated 375 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:24:46.479117 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4b6f9e-353f-47f8-b2f6-e47085978a80 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:46.479905 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1003/2001] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:24:46 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:24:46.481245 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96f4b99-e8aa-4bcc-9202-f3d23e3a07bd admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:46.483300 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-6b4b6f9e-353f-47f8-b2f6-e47085978a80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:46.500265 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96f4b99-e8aa-4bcc-9202-f3d23e3a07bd admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:46.630100 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b85e87a-6f2a-4700-a050-3da6b947273b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:46.630100 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b85e87a-6f2a-4700-a050-3da6b947273b admin admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:46.630100 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b85e87a-6f2a-4700-a050-3da6b947273b admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:46.630100 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b85e87a-6f2a-4700-a050-3da6b947273b admin admin] PATH_INFO: `/v3/users` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:46.631202 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b85e87a-6f2a-4700-a050-3da6b947273b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:46.631202 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b85e87a-6f2a-4700-a050-3da6b947273b admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:46.637501 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4b6f9e-353f-47f8-b2f6-e47085978a80 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:46.642661 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14353565-9dff-4e65-83d2-dd47802226fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:46.643300 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14353565-9dff-4e65-83d2-dd47802226fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:46.643575 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14353565-9dff-4e65-83d2-dd47802226fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:46.644212 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14353565-9dff-4e65-83d2-dd47802226fd admin admin] PATH_INFO: `/v3/projects/f0066bf3f33c4ff39d227bd7d9fcc3ae` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:46.645070 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14353565-9dff-4e65-83d2-dd47802226fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0066bf3f33c4ff39d227bd7d9fcc3ae)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:46.647283 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14353565-9dff-4e65-83d2-dd47802226fd admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:46.652311 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1004/2002] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 20 22:24:46 2022] POST /identity/v3/users => generated 294 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:24:46.656157 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b85e87a-6f2a-4700-a050-3da6b947273b admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:46.671300 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b85e87a-6f2a-4700-a050-3da6b947273b admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:46.676516 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8234e96a-f7bf-496e-a0e5-417d24759910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:46.676725 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8234e96a-f7bf-496e-a0e5-417d24759910 admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:46.676991 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8234e96a-f7bf-496e-a0e5-417d24759910 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:46.677264 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8234e96a-f7bf-496e-a0e5-417d24759910 admin admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:46.677908 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8234e96a-f7bf-496e-a0e5-417d24759910 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:46.679540 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8234e96a-f7bf-496e-a0e5-417d24759910 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:46.693577 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1005/2003] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:24:46 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:24:46.693577 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8234e96a-f7bf-496e-a0e5-417d24759910 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:46.702036 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8234e96a-f7bf-496e-a0e5-417d24759910 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:46.707522 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:46.714813 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-14353565-9dff-4e65-83d2-dd47802226fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0066bf3f33c4ff39d227bd7d9fcc3ae', 'request_id': 'req-14353565-9dff-4e65-83d2-dd47802226fd'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:46.730340 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-14353565-9dff-4e65-83d2-dd47802226fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0066bf3f33c4ff39d227bd7d9fcc3ae', 'request_id': 'req-14353565-9dff-4e65-83d2-dd47802226fd'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:46.741435 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-14353565-9dff-4e65-83d2-dd47802226fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0066bf3f33c4ff39d227bd7d9fcc3ae', 'request_id': 'req-14353565-9dff-4e65-83d2-dd47802226fd'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:46.754463 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-14353565-9dff-4e65-83d2-dd47802226fd admin admin] The token cache is being invalidate because project f0066bf3f33c4ff39d227bd7d9fcc3ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81307) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 22:24:46.755069 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-14353565-9dff-4e65-83d2-dd47802226fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:46.755842 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-14353565-9dff-4e65-83d2-dd47802226fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:46.758005 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 999/2004] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 20 22:24:46 2022] DELETE /identity/v3/projects/f0066bf3f33c4ff39d227bd7d9fcc3ae => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:24:46.758690 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14353565-9dff-4e65-83d2-dd47802226fd admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:46.760931 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-14353565-9dff-4e65-83d2-dd47802226fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:46.769763 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a634cac7-acc8-44e3-81f9-dd84e3da8559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:46.770571 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a634cac7-acc8-44e3-81f9-dd84e3da8559 admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:46.770856 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a634cac7-acc8-44e3-81f9-dd84e3da8559 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:46.771127 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a634cac7-acc8-44e3-81f9-dd84e3da8559 admin admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:46.771767 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a634cac7-acc8-44e3-81f9-dd84e3da8559 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:46.773357 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a634cac7-acc8-44e3-81f9-dd84e3da8559 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:46.774180 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:46.788491 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1006/2005] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:24:46 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:24:46.791700 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047f80c8-3bc5-465b-94a6-94b4bc2a70e1 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:46.792245 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047f80c8-3bc5-465b-94a6-94b4bc2a70e1 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:46.792858 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047f80c8-3bc5-465b-94a6-94b4bc2a70e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:46.817931 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-047f80c8-3bc5-465b-94a6-94b4bc2a70e1 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:24:46.818749 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-047f80c8-3bc5-465b-94a6-94b4bc2a70e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:46.828469 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1007/2006] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:24:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:24:46.829366 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047f80c8-3bc5-465b-94a6-94b4bc2a70e1 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:46.830798 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-047f80c8-3bc5-465b-94a6-94b4bc2a70e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:46.872889 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047f80c8-3bc5-465b-94a6-94b4bc2a70e1 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:46.889341 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a6b7d8-6d11-4e87-916d-fdd1597895a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:46.890073 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a6b7d8-6d11-4e87-916d-fdd1597895a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:46.890301 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a6b7d8-6d11-4e87-916d-fdd1597895a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:46.890600 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a6b7d8-6d11-4e87-916d-fdd1597895a4 admin admin] PATH_INFO: `/v3/projects/5e85ec92dad745728ad698e8bbb81b86/users/637261b6b7d54f259cbc9cce56b6152f/roles/8a829170b29d42d6af589399e51edb0f` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:46.897421 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14353565-9dff-4e65-83d2-dd47802226fd admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:46.906543 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bad329-745a-4d57-8b8d-9940e97e8715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:46.907308 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bad329-745a-4d57-8b8d-9940e97e8715 admin admin] REQUEST_METHOD: `PUT` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:46.907752 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bad329-745a-4d57-8b8d-9940e97e8715 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:46.908138 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bad329-745a-4d57-8b8d-9940e97e8715 admin admin] PATH_INFO: `/v3/projects/866dce0a788744c098ff1baa499d791c/users/267709f15b81472ca7e9f9e7fc9c1d65/roles/604444e7ad0d437dbd1f5a6e02b761f5` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:46.926641 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a6b7d8-6d11-4e87-916d-fdd1597895a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e85ec92dad745728ad698e8bbb81b86, user_id=637261b6b7d54f259cbc9cce56b6152f, role_id=8a829170b29d42d6af589399e51edb0f)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:46.927333 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bad329-745a-4d57-8b8d-9940e97e8715 admin admin] RBAC: Authorizing `identity:create_grant(project_id=866dce0a788744c098ff1baa499d791c, user_id=267709f15b81472ca7e9f9e7fc9c1d65, role_id=604444e7ad0d437dbd1f5a6e02b761f5)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:46.929332 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a6b7d8-6d11-4e87-916d-fdd1597895a4 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:46.930266 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bad329-745a-4d57-8b8d-9940e97e8715 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:46.953573 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1008/2007] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:24:46 2022] PUT /identity/v3/projects/5e85ec92dad745728ad698e8bbb81b86/users/637261b6b7d54f259cbc9cce56b6152f/roles/8a829170b29d42d6af589399e51edb0f => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:24:46.960461 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c4f95a-9c1d-4af6-bcd5-28f611cf06cd None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:46.961283 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c4f95a-9c1d-4af6-bcd5-28f611cf06cd None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:46.961283 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c4f95a-9c1d-4af6-bcd5-28f611cf06cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:46.992422 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1000/2008] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:24:46 2022] PUT /identity/v3/projects/866dce0a788744c098ff1baa499d791c/users/267709f15b81472ca7e9f9e7fc9c1d65/roles/604444e7ad0d437dbd1f5a6e02b761f5 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:24:46.992422 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bad329-745a-4d57-8b8d-9940e97e8715 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:46.993026 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-56c4f95a-9c1d-4af6-bcd5-28f611cf06cd None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:24:46.993026 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-56c4f95a-9c1d-4af6-bcd5-28f611cf06cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:46.994116 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-39bad329-745a-4d57-8b8d-9940e97e8715 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:47.073314 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1009/2009] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:24:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:24:47.074257 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c4f95a-9c1d-4af6-bcd5-28f611cf06cd None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:47.086648 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c4f95a-9c1d-4af6-bcd5-28f611cf06cd None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:47.104906 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ce00fc-1424-4e63-9ef5-083a83dea3f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:47.105530 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ce00fc-1424-4e63-9ef5-083a83dea3f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:47.105837 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ce00fc-1424-4e63-9ef5-083a83dea3f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:47.106110 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ce00fc-1424-4e63-9ef5-083a83dea3f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:47.106785 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ce00fc-1424-4e63-9ef5-083a83dea3f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:47.108382 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ce00fc-1424-4e63-9ef5-083a83dea3f5 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:47.120043 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bad329-745a-4d57-8b8d-9940e97e8715 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:47.126344 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1010/2010] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:24:47 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:24:47.131893 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e804dfca-37da-4dbd-a8b2-978cb6d5d905 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:47.132184 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e804dfca-37da-4dbd-a8b2-978cb6d5d905 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:47.132459 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e804dfca-37da-4dbd-a8b2-978cb6d5d905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:47.138309 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb90888f-857e-4553-890e-42abec7ef380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:47.139041 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb90888f-857e-4553-890e-42abec7ef380 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:47.139330 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb90888f-857e-4553-890e-42abec7ef380 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:47.139598 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb90888f-857e-4553-890e-42abec7ef380 admin admin] PATH_INFO: `/v3/projects/000bd8defc3b4b5cbf4a04c6b1a6d8fa` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:47.140744 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb90888f-857e-4553-890e-42abec7ef380 admin admin] RBAC: Authorizing `identity:delete_project(project_id=000bd8defc3b4b5cbf4a04c6b1a6d8fa)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:47.142699 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb90888f-857e-4553-890e-42abec7ef380 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:47.182893 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-e804dfca-37da-4dbd-a8b2-978cb6d5d905 None None] MFA Rules not processed for user `267709f15b81472ca7e9f9e7fc9c1d65`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:24:47.184424 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-e804dfca-37da-4dbd-a8b2-978cb6d5d905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:47.198017 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-fb90888f-857e-4553-890e-42abec7ef380 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '000bd8defc3b4b5cbf4a04c6b1a6d8fa', 'request_id': 'req-fb90888f-857e-4553-890e-42abec7ef380'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:47.204629 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-fb90888f-857e-4553-890e-42abec7ef380 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '000bd8defc3b4b5cbf4a04c6b1a6d8fa', 'request_id': 'req-fb90888f-857e-4553-890e-42abec7ef380'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:47.214147 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-fb90888f-857e-4553-890e-42abec7ef380 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '000bd8defc3b4b5cbf4a04c6b1a6d8fa', 'request_id': 'req-fb90888f-857e-4553-890e-42abec7ef380'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:47.225977 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-fb90888f-857e-4553-890e-42abec7ef380 admin admin] The token cache is being invalidate because project 000bd8defc3b4b5cbf4a04c6b1a6d8fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81307) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 22:24:47.226274 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-fb90888f-857e-4553-890e-42abec7ef380 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:47.226992 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-fb90888f-857e-4553-890e-42abec7ef380 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:47.230990 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1001/2011] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 20 22:24:46 2022] DELETE /identity/v3/projects/000bd8defc3b4b5cbf4a04c6b1a6d8fa => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:24:47.230990 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb90888f-857e-4553-890e-42abec7ef380 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:47.230990 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-fb90888f-857e-4553-890e-42abec7ef380 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:47.249778 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:47.260879 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:47.266168 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1011/2012] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:24:47 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:24:47.270917 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e804dfca-37da-4dbd-a8b2-978cb6d5d905 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:47.272244 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-e804dfca-37da-4dbd-a8b2-978cb6d5d905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:47.311053 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb90888f-857e-4553-890e-42abec7ef380 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:47.317392 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5207b311-40d6-46c7-b3b6-65d7a0138938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:47.318018 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5207b311-40d6-46c7-b3b6-65d7a0138938 admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:47.318292 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5207b311-40d6-46c7-b3b6-65d7a0138938 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:47.318587 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5207b311-40d6-46c7-b3b6-65d7a0138938 admin admin] PATH_INFO: `/v3/domains` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:47.319230 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5207b311-40d6-46c7-b3b6-65d7a0138938 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:24:47.319528 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5207b311-40d6-46c7-b3b6-65d7a0138938 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:47.321638 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5207b311-40d6-46c7-b3b6-65d7a0138938 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:47.337202 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1002/2013] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 20 22:24:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:24:47.338177 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5207b311-40d6-46c7-b3b6-65d7a0138938 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:47.339942 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-5207b311-40d6-46c7-b3b6-65d7a0138938 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:47.349093 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e804dfca-37da-4dbd-a8b2-978cb6d5d905 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:47.353633 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5207b311-40d6-46c7-b3b6-65d7a0138938 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:47.354895 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4934db-501c-4bb8-ad0e-fbb9b165e0e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:47.355573 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4934db-501c-4bb8-ad0e-fbb9b165e0e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:47.355978 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4934db-501c-4bb8-ad0e-fbb9b165e0e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:47.356316 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4934db-501c-4bb8-ad0e-fbb9b165e0e8 admin admin] PATH_INFO: `/v3/projects/5e85ec92dad745728ad698e8bbb81b86/users/637261b6b7d54f259cbc9cce56b6152f/roles/8a829170b29d42d6af589399e51edb0f` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:47.358227 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4934db-501c-4bb8-ad0e-fbb9b165e0e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e85ec92dad745728ad698e8bbb81b86, user_id=637261b6b7d54f259cbc9cce56b6152f, role_id=8a829170b29d42d6af589399e51edb0f)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:47.359656 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a86d711-f2dd-45ec-b230-339b31216d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:47.360355 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a86d711-f2dd-45ec-b230-339b31216d01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:47.360703 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a86d711-f2dd-45ec-b230-339b31216d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:47.360938 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4934db-501c-4bb8-ad0e-fbb9b165e0e8 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:47.361188 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a86d711-f2dd-45ec-b230-339b31216d01 admin admin] PATH_INFO: `/v3/users/505746d545284430a1ed976d8c8b1932` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:47.362349 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a86d711-f2dd-45ec-b230-339b31216d01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=505746d545284430a1ed976d8c8b1932)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:47.365505 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a86d711-f2dd-45ec-b230-339b31216d01 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:47.373358 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1012/2014] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:24:47 2022] PUT /identity/v3/projects/5e85ec92dad745728ad698e8bbb81b86/users/637261b6b7d54f259cbc9cce56b6152f/roles/8a829170b29d42d6af589399e51edb0f => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:24:47.375354 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4934db-501c-4bb8-ad0e-fbb9b165e0e8 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:47.377385 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-9f4934db-501c-4bb8-ad0e-fbb9b165e0e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:47.428855 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-8a86d711-f2dd-45ec-b230-339b31216d01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '505746d545284430a1ed976d8c8b1932'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:47.437435 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-8a86d711-f2dd-45ec-b230-339b31216d01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '505746d545284430a1ed976d8c8b1932'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:47.438108 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-8a86d711-f2dd-45ec-b230-339b31216d01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '505746d545284430a1ed976d8c8b1932'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:47.438878 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-8a86d711-f2dd-45ec-b230-339b31216d01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '505746d545284430a1ed976d8c8b1932'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:47.446375 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-8a86d711-f2dd-45ec-b230-339b31216d01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '505746d545284430a1ed976d8c8b1932'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:47.455576 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4934db-501c-4bb8-ad0e-fbb9b165e0e8 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:47.460536 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba55a3c-6266-4b39-b755-547abfda39d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:47.461224 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba55a3c-6266-4b39-b755-547abfda39d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:47.461626 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba55a3c-6266-4b39-b755-547abfda39d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:47.461995 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba55a3c-6266-4b39-b755-547abfda39d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:47.462761 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba55a3c-6266-4b39-b755-547abfda39d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:47.464729 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba55a3c-6266-4b39-b755-547abfda39d5 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:47.464851 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1003/2015] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 20 22:24:47 2022] DELETE /identity/v3/users/505746d545284430a1ed976d8c8b1932 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:24:47.467487 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a86d711-f2dd-45ec-b230-339b31216d01 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:47.471937 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-8a86d711-f2dd-45ec-b230-339b31216d01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:47.493929 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1013/2016] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 20 22:24:47 2022] POST /identity/v3/projects => generated 379 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:24:47.495739 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c2d726-cbd4-4a07-b75d-b94282a64044 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:47.496026 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c2d726-cbd4-4a07-b75d-b94282a64044 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:47.496297 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c2d726-cbd4-4a07-b75d-b94282a64044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:47.526276 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-86c2d726-cbd4-4a07-b75d-b94282a64044 None None] MFA Rules not processed for user `637261b6b7d54f259cbc9cce56b6152f`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:24:47.527668 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-86c2d726-cbd4-4a07-b75d-b94282a64044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:47.557759 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a86d711-f2dd-45ec-b230-339b31216d01 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:47.594912 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:47.597480 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:47.619648 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1014/2017] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:24:47 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:24:47.620643 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c2d726-cbd4-4a07-b75d-b94282a64044 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:47.623491 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-86c2d726-cbd4-4a07-b75d-b94282a64044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:47.628227 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db1e3d5-72f0-4559-ae9d-08f07b949d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:47.628949 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db1e3d5-72f0-4559-ae9d-08f07b949d1c admin admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:47.629300 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db1e3d5-72f0-4559-ae9d-08f07b949d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:47.629645 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db1e3d5-72f0-4559-ae9d-08f07b949d1c admin admin] PATH_INFO: `/v3/projects` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:47.630370 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db1e3d5-72f0-4559-ae9d-08f07b949d1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:47.633114 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db1e3d5-72f0-4559-ae9d-08f07b949d1c admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:47.640188 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c2d726-cbd4-4a07-b75d-b94282a64044 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:47.645078 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8873e1-4437-42e4-981c-0b059e1ecbff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:47.645780 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8873e1-4437-42e4-981c-0b059e1ecbff admin admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:47.646122 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8873e1-4437-42e4-981c-0b059e1ecbff admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:47.646583 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8873e1-4437-42e4-981c-0b059e1ecbff admin admin] PATH_INFO: `/v3/users` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:47.647216 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8873e1-4437-42e4-981c-0b059e1ecbff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:47.649203 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8873e1-4437-42e4-981c-0b059e1ecbff admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:47.687771 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1015/2018] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 20 22:24:47 2022] POST /identity/v3/users => generated 296 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:24:47.687771 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8873e1-4437-42e4-981c-0b059e1ecbff admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:47.688059 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1004/2019] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 20 22:24:47 2022] POST /identity/v3/projects => generated 409 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:24:47.688059 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db1e3d5-72f0-4559-ae9d-08f07b949d1c admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:47.688215 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-2c8873e1-4437-42e4-981c-0b059e1ecbff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:47.753055 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8873e1-4437-42e4-981c-0b059e1ecbff admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:47.775351 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db1e3d5-72f0-4559-ae9d-08f07b949d1c admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:47.782487 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be8da4c-a76a-48aa-8460-17cec4074b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:47.783168 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be8da4c-a76a-48aa-8460-17cec4074b0e admin admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:47.783484 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be8da4c-a76a-48aa-8460-17cec4074b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:47.783844 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be8da4c-a76a-48aa-8460-17cec4074b0e admin admin] PATH_INFO: `/v3/users` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:47.784948 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be8da4c-a76a-48aa-8460-17cec4074b0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:47.788403 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be8da4c-a76a-48aa-8460-17cec4074b0e admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:47.819828 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2393d471-bd49-4dc6-9925-bf67fed9a6e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577c8b14c1f4279beac13b9ba11aba1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:47.823619 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1005/2020] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 20 22:24:47 2022] POST /identity/v3/users => generated 305 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:24:47.823619 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be8da4c-a76a-48aa-8460-17cec4074b0e admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:47.825299 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2393d471-bd49-4dc6-9925-bf67fed9a6e8 service cinder] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:47.825805 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2393d471-bd49-4dc6-9925-bf67fed9a6e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:47.826900 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2393d471-bd49-4dc6-9925-bf67fed9a6e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:47.828825 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-2393d471-bd49-4dc6-9925-bf67fed9a6e8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:47.840991 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be8da4c-a76a-48aa-8460-17cec4074b0e admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:47.848041 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8789af46-094a-4e23-b65c-500e73934e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:47.849487 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8789af46-094a-4e23-b65c-500e73934e7a admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:47.850342 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8789af46-094a-4e23-b65c-500e73934e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:47.850342 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8789af46-094a-4e23-b65c-500e73934e7a admin admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:47.853954 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8789af46-094a-4e23-b65c-500e73934e7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:47.854428 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8789af46-094a-4e23-b65c-500e73934e7a admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:47.870006 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1006/2021] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:24:47 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:24:47.874092 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8789af46-094a-4e23-b65c-500e73934e7a admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:47.886715 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8789af46-094a-4e23-b65c-500e73934e7a admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:47.893364 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d89674f-f99b-4271-9b0c-d62052b526fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:47.893953 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d89674f-f99b-4271-9b0c-d62052b526fa admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:47.894242 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d89674f-f99b-4271-9b0c-d62052b526fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:47.894488 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d89674f-f99b-4271-9b0c-d62052b526fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:47.895260 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d89674f-f99b-4271-9b0c-d62052b526fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:47.896860 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d89674f-f99b-4271-9b0c-d62052b526fa admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:47.903357 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2393d471-bd49-4dc6-9925-bf67fed9a6e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:47.905321 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2393d471-bd49-4dc6-9925-bf67fed9a6e8 service cinder] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:47.917375 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1007/2022] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:24:47 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:24:47.918238 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d89674f-f99b-4271-9b0c-d62052b526fa admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:47.920454 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1016/2023] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:24:47 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:24:47.921352 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2393d471-bd49-4dc6-9925-bf67fed9a6e8 service cinder] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:47.923254 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-2393d471-bd49-4dc6-9925-bf67fed9a6e8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:47.933607 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d89674f-f99b-4271-9b0c-d62052b526fa admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:47.938201 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2393d471-bd49-4dc6-9925-bf67fed9a6e8 service cinder] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:47.938973 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f283b152-1d8e-4a20-af37-48977450e459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:47.939859 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f283b152-1d8e-4a20-af37-48977450e459 admin admin] REQUEST_METHOD: `PUT` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:47.940227 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f283b152-1d8e-4a20-af37-48977450e459 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:47.940543 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f283b152-1d8e-4a20-af37-48977450e459 admin admin] PATH_INFO: `/v3/projects/2a8f6033330744b6a8f62c37a1e2ed58/users/63e7032eee2d4bf3ba3554fc7c83be38/roles/8a829170b29d42d6af589399e51edb0f` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:47.944359 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ed89af-21f4-4290-a130-685b18823a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:47.945603 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed89af-21f4-4290-a130-685b18823a65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:47.945934 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed89af-21f4-4290-a130-685b18823a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:47.946284 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed89af-21f4-4290-a130-685b18823a65 admin admin] PATH_INFO: `/v3/projects/66ea75118db7450e8ee9961d12716a24` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:47.947821 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ed89af-21f4-4290-a130-685b18823a65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66ea75118db7450e8ee9961d12716a24)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:47.961736 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f283b152-1d8e-4a20-af37-48977450e459 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a8f6033330744b6a8f62c37a1e2ed58, user_id=63e7032eee2d4bf3ba3554fc7c83be38, role_id=8a829170b29d42d6af589399e51edb0f)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:47.963707 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ed89af-21f4-4290-a130-685b18823a65 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:47.969556 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f283b152-1d8e-4a20-af37-48977450e459 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:47.992575 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1008/2024] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:24:47 2022] PUT /identity/v3/projects/2a8f6033330744b6a8f62c37a1e2ed58/users/63e7032eee2d4bf3ba3554fc7c83be38/roles/8a829170b29d42d6af589399e51edb0f => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:24:47.993506 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f283b152-1d8e-4a20-af37-48977450e459 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:48.041676 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:48.048351 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-99ed89af-21f4-4290-a130-685b18823a65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66ea75118db7450e8ee9961d12716a24', 'request_id': 'req-99ed89af-21f4-4290-a130-685b18823a65'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:48.060396 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-99ed89af-21f4-4290-a130-685b18823a65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66ea75118db7450e8ee9961d12716a24', 'request_id': 'req-99ed89af-21f4-4290-a130-685b18823a65'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:48.075463 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-99ed89af-21f4-4290-a130-685b18823a65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66ea75118db7450e8ee9961d12716a24', 'request_id': 'req-99ed89af-21f4-4290-a130-685b18823a65'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:48.081673 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f283b152-1d8e-4a20-af37-48977450e459 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:48.094338 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:48.104841 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-99ed89af-21f4-4290-a130-685b18823a65 admin admin] The token cache is being invalidate because project 66ea75118db7450e8ee9961d12716a24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81306) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 22:24:48.106030 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-99ed89af-21f4-4290-a130-685b18823a65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:48.107803 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-99ed89af-21f4-4290-a130-685b18823a65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:48.112023 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1017/2025] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 20 22:24:47 2022] DELETE /identity/v3/projects/66ea75118db7450e8ee9961d12716a24 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:24:48.116057 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ed89af-21f4-4290-a130-685b18823a65 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:48.116057 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-99ed89af-21f4-4290-a130-685b18823a65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:48.176579 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3c285c-8a05-452d-83ee-eb2ab26f7b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:48.179083 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3c285c-8a05-452d-83ee-eb2ab26f7b3e admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:48.179473 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3c285c-8a05-452d-83ee-eb2ab26f7b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:48.181248 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3c285c-8a05-452d-83ee-eb2ab26f7b3e admin admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:48.181985 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3c285c-8a05-452d-83ee-eb2ab26f7b3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:48.184544 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3c285c-8a05-452d-83ee-eb2ab26f7b3e admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:48.203173 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1009/2026] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:24:47 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:24:48.203173 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d6dee-0ea0-4dd8-a8bc-212a02955573 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:48.203173 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d6dee-0ea0-4dd8-a8bc-212a02955573 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:48.203173 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d6dee-0ea0-4dd8-a8bc-212a02955573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:48.236177 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-349d6dee-0ea0-4dd8-a8bc-212a02955573 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:24:48.243546 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-349d6dee-0ea0-4dd8-a8bc-212a02955573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:48.257677 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ed89af-21f4-4290-a130-685b18823a65 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:48.260281 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1010/2027] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:24:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:24:48.261240 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349d6dee-0ea0-4dd8-a8bc-212a02955573 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:48.262714 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-349d6dee-0ea0-4dd8-a8bc-212a02955573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:48.276818 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349d6dee-0ea0-4dd8-a8bc-212a02955573 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:48.294065 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a51631-4039-4d6e-864a-9b24b8730d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:48.295399 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908a3f88-ab9c-4daa-82f7-3677f4323248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:48.296574 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908a3f88-ab9c-4daa-82f7-3677f4323248 admin admin] REQUEST_METHOD: `PUT` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:48.296723 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a51631-4039-4d6e-864a-9b24b8730d36 admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:48.296822 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a51631-4039-4d6e-864a-9b24b8730d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:48.296913 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908a3f88-ab9c-4daa-82f7-3677f4323248 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:48.297002 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a51631-4039-4d6e-864a-9b24b8730d36 admin admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:48.297349 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908a3f88-ab9c-4daa-82f7-3677f4323248 admin admin] PATH_INFO: `/v3/projects/e96ba247ae904dfe942586e4b25fbbc9/users/1656c253f74c4c598b23a0fdb826b27b/roles/604444e7ad0d437dbd1f5a6e02b761f5` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:48.297708 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a51631-4039-4d6e-864a-9b24b8730d36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:48.299367 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a51631-4039-4d6e-864a-9b24b8730d36 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:48.343141 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1018/2028] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:24:48 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:24:48.343141 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee8d0a8-b1a8-4192-b57b-dd43f7ca67bf None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:48.345254 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee8d0a8-b1a8-4192-b57b-dd43f7ca67bf None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:48.345603 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee8d0a8-b1a8-4192-b57b-dd43f7ca67bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:48.354912 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908a3f88-ab9c-4daa-82f7-3677f4323248 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e96ba247ae904dfe942586e4b25fbbc9, user_id=1656c253f74c4c598b23a0fdb826b27b, role_id=604444e7ad0d437dbd1f5a6e02b761f5)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:48.359437 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908a3f88-ab9c-4daa-82f7-3677f4323248 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:48.381510 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-2ee8d0a8-b1a8-4192-b57b-dd43f7ca67bf None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:24:48.383028 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-2ee8d0a8-b1a8-4192-b57b-dd43f7ca67bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:48.397634 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1011/2029] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:24:48 2022] PUT /identity/v3/projects/e96ba247ae904dfe942586e4b25fbbc9/users/1656c253f74c4c598b23a0fdb826b27b/roles/604444e7ad0d437dbd1f5a6e02b761f5 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:24:48.397634 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908a3f88-ab9c-4daa-82f7-3677f4323248 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:48.484668 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908a3f88-ab9c-4daa-82f7-3677f4323248 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:48.491289 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0aac68-aad4-4109-9c3a-5305c93ceddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:48.492208 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0aac68-aad4-4109-9c3a-5305c93ceddf admin admin] REQUEST_METHOD: `PUT` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:48.492579 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0aac68-aad4-4109-9c3a-5305c93ceddf admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:48.493108 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0aac68-aad4-4109-9c3a-5305c93ceddf admin admin] PATH_INFO: `/v3/projects/2a8f6033330744b6a8f62c37a1e2ed58/users/63e7032eee2d4bf3ba3554fc7c83be38/roles/8a829170b29d42d6af589399e51edb0f` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:48.496122 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0aac68-aad4-4109-9c3a-5305c93ceddf admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a8f6033330744b6a8f62c37a1e2ed58, user_id=63e7032eee2d4bf3ba3554fc7c83be38, role_id=8a829170b29d42d6af589399e51edb0f)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:48.499564 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0aac68-aad4-4109-9c3a-5305c93ceddf admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:48.508010 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1019/2030] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:24:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:24:48.516032 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1012/2031] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:24:48 2022] PUT /identity/v3/projects/2a8f6033330744b6a8f62c37a1e2ed58/users/63e7032eee2d4bf3ba3554fc7c83be38/roles/8a829170b29d42d6af589399e51edb0f => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:24:48.516984 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0aac68-aad4-4109-9c3a-5305c93ceddf admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:48.518829 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15359a51-e07f-4dde-ac91-c737c914b101 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:48.521425 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15359a51-e07f-4dde-ac91-c737c914b101 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:48.521780 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15359a51-e07f-4dde-ac91-c737c914b101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:48.560236 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-15359a51-e07f-4dde-ac91-c737c914b101 None None] MFA Rules not processed for user `1656c253f74c4c598b23a0fdb826b27b`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:24:48.561601 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-15359a51-e07f-4dde-ac91-c737c914b101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:48.626125 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0aac68-aad4-4109-9c3a-5305c93ceddf admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:48.628293 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:48.632340 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a665a293-f3cb-4311-9beb-15e961191d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:48.633134 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a665a293-f3cb-4311-9beb-15e961191d4a admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:48.633471 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a665a293-f3cb-4311-9beb-15e961191d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:48.634051 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a665a293-f3cb-4311-9beb-15e961191d4a admin admin] PATH_INFO: `/v3/domains` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:48.635192 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a665a293-f3cb-4311-9beb-15e961191d4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:24:48.635476 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1020/2032] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:24:48 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:24:48.635730 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a665a293-f3cb-4311-9beb-15e961191d4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:48.636570 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913aec32-520e-4000-90ed-8efebb164ae6 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:48.637665 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a665a293-f3cb-4311-9beb-15e961191d4a admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:48.638972 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913aec32-520e-4000-90ed-8efebb164ae6 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:48.639962 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913aec32-520e-4000-90ed-8efebb164ae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:48.656142 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1013/2033] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 20 22:24:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:24:48.656142 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a665a293-f3cb-4311-9beb-15e961191d4a admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:48.660231 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:48.663855 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a665a293-f3cb-4311-9beb-15e961191d4a admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:48.668843 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6680ad9-4c39-4310-9730-fde712a671f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:48.669577 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6680ad9-4c39-4310-9730-fde712a671f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:48.670376 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6680ad9-4c39-4310-9730-fde712a671f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:48.670890 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6680ad9-4c39-4310-9730-fde712a671f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:48.672690 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6680ad9-4c39-4310-9730-fde712a671f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:48.676540 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6680ad9-4c39-4310-9730-fde712a671f0 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:48.682520 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-913aec32-520e-4000-90ed-8efebb164ae6 None None] MFA Rules not processed for user `63e7032eee2d4bf3ba3554fc7c83be38`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:24:48.683731 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-913aec32-520e-4000-90ed-8efebb164ae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:48.707851 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1014/2034] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 20 22:24:48 2022] POST /identity/v3/projects => generated 409 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:24:48.708781 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6680ad9-4c39-4310-9730-fde712a671f0 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:48.753354 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1021/2035] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:24:48 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:24:48.754178 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913aec32-520e-4000-90ed-8efebb164ae6 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:48.764702 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913aec32-520e-4000-90ed-8efebb164ae6 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:48.781086 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6680ad9-4c39-4310-9730-fde712a671f0 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:48.786523 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a7e95f-dc96-4f89-ac3c-4ba0b60141ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:48.787133 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a7e95f-dc96-4f89-ac3c-4ba0b60141ea admin admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:48.787437 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a7e95f-dc96-4f89-ac3c-4ba0b60141ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:48.787707 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a7e95f-dc96-4f89-ac3c-4ba0b60141ea admin admin] PATH_INFO: `/v3/projects` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:48.788377 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a7e95f-dc96-4f89-ac3c-4ba0b60141ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:48.790396 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a7e95f-dc96-4f89-ac3c-4ba0b60141ea admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:48.825459 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1015/2036] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 20 22:24:48 2022] POST /identity/v3/projects => generated 397 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:24:48.825899 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277e93c2-39f7-4c15-bb41-c56372c153fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:48.826432 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a7e95f-dc96-4f89-ac3c-4ba0b60141ea admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:48.826627 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e93c2-39f7-4c15-bb41-c56372c153fc admin admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:48.826964 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e93c2-39f7-4c15-bb41-c56372c153fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:48.827246 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e93c2-39f7-4c15-bb41-c56372c153fc admin admin] PATH_INFO: `/v3/users` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:48.827882 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277e93c2-39f7-4c15-bb41-c56372c153fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:48.829804 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277e93c2-39f7-4c15-bb41-c56372c153fc admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:48.829921 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-72a7e95f-dc96-4f89-ac3c-4ba0b60141ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:48.852757 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1022/2037] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 20 22:24:48 2022] POST /identity/v3/users => generated 311 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:24:48.853629 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277e93c2-39f7-4c15-bb41-c56372c153fc admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:48.863438 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277e93c2-39f7-4c15-bb41-c56372c153fc admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:48.897277 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a7e95f-dc96-4f89-ac3c-4ba0b60141ea admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:48.905715 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb824bc-dda5-43d7-b009-57c0f1167ca4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577c8b14c1f4279beac13b9ba11aba1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:48.905715 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb824bc-dda5-43d7-b009-57c0f1167ca4 service cinder] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:48.905715 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb824bc-dda5-43d7-b009-57c0f1167ca4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:48.906029 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb824bc-dda5-43d7-b009-57c0f1167ca4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:48.927194 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cb4ada-7831-4eaf-9302-409ca7537e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:48.927863 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cb4ada-7831-4eaf-9302-409ca7537e0f admin admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:48.928147 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cb4ada-7831-4eaf-9302-409ca7537e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:48.928425 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cb4ada-7831-4eaf-9302-409ca7537e0f admin admin] PATH_INFO: `/v3/users` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:48.929062 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cb4ada-7831-4eaf-9302-409ca7537e0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:48.932777 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cb4ada-7831-4eaf-9302-409ca7537e0f admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:48.986651 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1023/2038] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 20 22:24:48 2022] POST /identity/v3/users => generated 299 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:24:48.988343 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cb4ada-7831-4eaf-9302-409ca7537e0f admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:49.002370 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:49.009371 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cb4ada-7831-4eaf-9302-409ca7537e0f admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:49.020916 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cebfa51-ee4f-439b-9935-ff26d2cc440b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:49.022387 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cebfa51-ee4f-439b-9935-ff26d2cc440b admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:49.026964 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cebfa51-ee4f-439b-9935-ff26d2cc440b admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:49.027516 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cebfa51-ee4f-439b-9935-ff26d2cc440b admin admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:49.027622 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb824bc-dda5-43d7-b009-57c0f1167ca4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:49.030490 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb824bc-dda5-43d7-b009-57c0f1167ca4 service cinder] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:49.031655 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cebfa51-ee4f-439b-9935-ff26d2cc440b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:49.033995 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cebfa51-ee4f-439b-9935-ff26d2cc440b admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:49.045694 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1016/2039] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:24:48 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:24:49.046772 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb824bc-dda5-43d7-b009-57c0f1167ca4 service cinder] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:49.058436 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1024/2040] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:24:48 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:24:49.059516 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cebfa51-ee4f-439b-9935-ff26d2cc440b admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:49.061595 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb824bc-dda5-43d7-b009-57c0f1167ca4 service cinder] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:49.071782 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cebfa51-ee4f-439b-9935-ff26d2cc440b admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:49.077007 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4895be-aa41-4bb6-bc8c-dd6814394dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:49.077825 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4895be-aa41-4bb6-bc8c-dd6814394dcc admin admin] REQUEST_METHOD: `PUT` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:49.078214 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4895be-aa41-4bb6-bc8c-dd6814394dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:49.078740 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4895be-aa41-4bb6-bc8c-dd6814394dcc admin admin] PATH_INFO: `/v3/projects/29773d7f9614414a8a31a44a46079c9d/users/00cd3b8d33e7428d98f1acd259f10a2b/roles/8a829170b29d42d6af589399e51edb0f` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:49.085457 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b385a44e-0ea5-4134-b669-6da21baf8e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:49.087773 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b385a44e-0ea5-4134-b669-6da21baf8e97 admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:49.088062 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b385a44e-0ea5-4134-b669-6da21baf8e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:49.089606 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b385a44e-0ea5-4134-b669-6da21baf8e97 admin admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:49.091437 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b385a44e-0ea5-4134-b669-6da21baf8e97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:49.094886 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b385a44e-0ea5-4134-b669-6da21baf8e97 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:49.098812 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4895be-aa41-4bb6-bc8c-dd6814394dcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=29773d7f9614414a8a31a44a46079c9d, user_id=00cd3b8d33e7428d98f1acd259f10a2b, role_id=8a829170b29d42d6af589399e51edb0f)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:49.101610 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4895be-aa41-4bb6-bc8c-dd6814394dcc admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:49.110143 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1017/2041] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:24:49 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:24:49.118349 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b385a44e-0ea5-4134-b669-6da21baf8e97 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:49.132836 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1025/2042] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:24:49 2022] PUT /identity/v3/projects/29773d7f9614414a8a31a44a46079c9d/users/00cd3b8d33e7428d98f1acd259f10a2b/roles/8a829170b29d42d6af589399e51edb0f => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:24:49.136273 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b385a44e-0ea5-4134-b669-6da21baf8e97 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:49.138168 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4895be-aa41-4bb6-bc8c-dd6814394dcc admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:49.140047 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:49.140377 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-1a4895be-aa41-4bb6-bc8c-dd6814394dcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:49.213143 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4895be-aa41-4bb6-bc8c-dd6814394dcc admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:49.217022 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b69743e-05a7-4edd-931a-5086b38935d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577c8b14c1f4279beac13b9ba11aba1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:49.217715 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b69743e-05a7-4edd-931a-5086b38935d4 service cinder] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:49.218170 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b69743e-05a7-4edd-931a-5086b38935d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:49.218538 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b69743e-05a7-4edd-931a-5086b38935d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:49.220596 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-0b69743e-05a7-4edd-931a-5086b38935d4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:49.222062 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421fde2b-7668-4c55-b136-b33540e40756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:49.222837 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421fde2b-7668-4c55-b136-b33540e40756 admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:49.223183 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421fde2b-7668-4c55-b136-b33540e40756 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:49.223553 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421fde2b-7668-4c55-b136-b33540e40756 admin admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:49.224297 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421fde2b-7668-4c55-b136-b33540e40756 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:49.226039 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421fde2b-7668-4c55-b136-b33540e40756 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:49.239704 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1018/2043] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:24:49 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:24:49.240580 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421fde2b-7668-4c55-b136-b33540e40756 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:49.251042 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421fde2b-7668-4c55-b136-b33540e40756 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:49.256180 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac041f8a-4ba8-4862-8a1f-a52f577151a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:49.256771 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac041f8a-4ba8-4862-8a1f-a52f577151a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:49.257050 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac041f8a-4ba8-4862-8a1f-a52f577151a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:49.257317 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac041f8a-4ba8-4862-8a1f-a52f577151a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:49.257961 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac041f8a-4ba8-4862-8a1f-a52f577151a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:49.259599 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac041f8a-4ba8-4862-8a1f-a52f577151a3 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:49.272572 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1019/2044] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:24:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:24:49.273378 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac041f8a-4ba8-4862-8a1f-a52f577151a3 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:49.283204 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac041f8a-4ba8-4862-8a1f-a52f577151a3 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:49.287849 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6b0c8b-408c-4e8f-8492-2b9dfcf7504c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:49.288494 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6b0c8b-408c-4e8f-8492-2b9dfcf7504c admin admin] REQUEST_METHOD: `PUT` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:49.288776 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6b0c8b-408c-4e8f-8492-2b9dfcf7504c admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:49.289065 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6b0c8b-408c-4e8f-8492-2b9dfcf7504c admin admin] PATH_INFO: `/v3/projects/d15db981cc674e74a19c63b4506b66c8/users/dbc62ce3380448f3b5155e6b26a6dd43/roles/604444e7ad0d437dbd1f5a6e02b761f5` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:49.296490 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b69743e-05a7-4edd-931a-5086b38935d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:49.297932 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b69743e-05a7-4edd-931a-5086b38935d4 service cinder] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:49.308812 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1026/2045] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:24:49 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:24:49.309706 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b69743e-05a7-4edd-931a-5086b38935d4 service cinder] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:49.318315 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6b0c8b-408c-4e8f-8492-2b9dfcf7504c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d15db981cc674e74a19c63b4506b66c8, user_id=dbc62ce3380448f3b5155e6b26a6dd43, role_id=604444e7ad0d437dbd1f5a6e02b761f5)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:49.320598 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b69743e-05a7-4edd-931a-5086b38935d4 service cinder] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:49.321034 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6b0c8b-408c-4e8f-8492-2b9dfcf7504c admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:49.325705 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c929d9-5b51-473d-bacd-1a9b411614c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:49.326345 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c929d9-5b51-473d-bacd-1a9b411614c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:49.326717 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c929d9-5b51-473d-bacd-1a9b411614c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:49.327001 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c929d9-5b51-473d-bacd-1a9b411614c6 admin admin] PATH_INFO: `/v3/projects/29773d7f9614414a8a31a44a46079c9d/users/00cd3b8d33e7428d98f1acd259f10a2b/roles/8a829170b29d42d6af589399e51edb0f` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:49.329066 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c929d9-5b51-473d-bacd-1a9b411614c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29773d7f9614414a8a31a44a46079c9d, user_id=00cd3b8d33e7428d98f1acd259f10a2b, role_id=8a829170b29d42d6af589399e51edb0f)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:49.331758 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c929d9-5b51-473d-bacd-1a9b411614c6 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:49.339626 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1020/2046] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:24:49 2022] PUT /identity/v3/projects/d15db981cc674e74a19c63b4506b66c8/users/dbc62ce3380448f3b5155e6b26a6dd43/roles/604444e7ad0d437dbd1f5a6e02b761f5 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:24:49.350955 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1643b6e-8daa-403c-9577-c4f6e9270ae1 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:49.351247 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1643b6e-8daa-403c-9577-c4f6e9270ae1 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:49.351549 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1643b6e-8daa-403c-9577-c4f6e9270ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:49.355854 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1027/2047] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:24:49 2022] PUT /identity/v3/projects/29773d7f9614414a8a31a44a46079c9d/users/00cd3b8d33e7428d98f1acd259f10a2b/roles/8a829170b29d42d6af589399e51edb0f => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:24:49.367013 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c743a4f-c696-497f-ac53-bfd9ed7e5295 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:49.367637 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c743a4f-c696-497f-ac53-bfd9ed7e5295 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:49.368050 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c743a4f-c696-497f-ac53-bfd9ed7e5295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:49.385287 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-a1643b6e-8daa-403c-9577-c4f6e9270ae1 None None] MFA Rules not processed for user `dbc62ce3380448f3b5155e6b26a6dd43`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:24:49.386454 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-a1643b6e-8daa-403c-9577-c4f6e9270ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:49.408751 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-4c743a4f-c696-497f-ac53-bfd9ed7e5295 None None] MFA Rules not processed for user `00cd3b8d33e7428d98f1acd259f10a2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:24:49.410213 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-4c743a4f-c696-497f-ac53-bfd9ed7e5295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:49.478954 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1021/2048] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:24:49 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 22:24:49.487893 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1643b6e-8daa-403c-9577-c4f6e9270ae1 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:49.490325 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:49.506410 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1028/2049] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:24:49 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:24:49.555058 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1643b6e-8daa-403c-9577-c4f6e9270ae1 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:49.559917 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584ee3c8-7ee4-4d6a-9f3f-e400aab21cf7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577c8b14c1f4279beac13b9ba11aba1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:49.560549 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584ee3c8-7ee4-4d6a-9f3f-e400aab21cf7 service cinder] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:49.560832 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584ee3c8-7ee4-4d6a-9f3f-e400aab21cf7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:49.561215 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584ee3c8-7ee4-4d6a-9f3f-e400aab21cf7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:49.572187 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584ee3c8-7ee4-4d6a-9f3f-e400aab21cf7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:49.573855 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584ee3c8-7ee4-4d6a-9f3f-e400aab21cf7 service cinder] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:49.579498 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:49.590907 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1022/2050] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:24:49 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:24:49.672687 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c743a4f-c696-497f-ac53-bfd9ed7e5295 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:49.702435 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c743a4f-c696-497f-ac53-bfd9ed7e5295 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:49.718426 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0f1ffc-a0e1-466e-b589-49c10931fc39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577c8b14c1f4279beac13b9ba11aba1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:49.719175 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0f1ffc-a0e1-466e-b589-49c10931fc39 service cinder] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:49.719467 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0f1ffc-a0e1-466e-b589-49c10931fc39 service cinder] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:49.719748 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0f1ffc-a0e1-466e-b589-49c10931fc39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:49.762860 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0f1ffc-a0e1-466e-b589-49c10931fc39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:49.766750 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0f1ffc-a0e1-466e-b589-49c10931fc39 service cinder] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:49.804771 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1029/2051] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:24:49 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:24:50.047791 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584ee3c8-7ee4-4d6a-9f3f-e400aab21cf7 service cinder] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:50.056738 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584ee3c8-7ee4-4d6a-9f3f-e400aab21cf7 service cinder] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:50.061305 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694bfa1b-af9f-418c-a6de-7b68506639ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577c8b14c1f4279beac13b9ba11aba1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:50.061940 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694bfa1b-af9f-418c-a6de-7b68506639ab service cinder] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:50.062401 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694bfa1b-af9f-418c-a6de-7b68506639ab service cinder] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:50.062809 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694bfa1b-af9f-418c-a6de-7b68506639ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:50.156475 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694bfa1b-af9f-418c-a6de-7b68506639ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:50.158112 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694bfa1b-af9f-418c-a6de-7b68506639ab service cinder] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:50.182928 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1023/2052] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:24:50 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:24:51.016463 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0f1ffc-a0e1-466e-b589-49c10931fc39 service cinder] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:51.020016 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-9a0f1ffc-a0e1-466e-b589-49c10931fc39 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:51.157120 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0f1ffc-a0e1-466e-b589-49c10931fc39 service cinder] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:51.163386 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c43877-cb6d-47ec-ac62-ad89501520a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:51.164057 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c43877-cb6d-47ec-ac62-ad89501520a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:51.164335 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c43877-cb6d-47ec-ac62-ad89501520a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:51.164641 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c43877-cb6d-47ec-ac62-ad89501520a1 admin admin] PATH_INFO: `/v3/users/5f32e325258a414187ae2f09584c5213` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:51.166350 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c43877-cb6d-47ec-ac62-ad89501520a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f32e325258a414187ae2f09584c5213)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:51.168780 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c43877-cb6d-47ec-ac62-ad89501520a1 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:51.242396 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-e3c43877-cb6d-47ec-ac62-ad89501520a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f32e325258a414187ae2f09584c5213'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:51.252587 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-e3c43877-cb6d-47ec-ac62-ad89501520a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f32e325258a414187ae2f09584c5213'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:51.253517 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-e3c43877-cb6d-47ec-ac62-ad89501520a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f32e325258a414187ae2f09584c5213'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:51.254640 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-e3c43877-cb6d-47ec-ac62-ad89501520a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f32e325258a414187ae2f09584c5213'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:51.265634 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-e3c43877-cb6d-47ec-ac62-ad89501520a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f32e325258a414187ae2f09584c5213'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:51.330430 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1030/2053] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 20 22:24:51 2022] DELETE /identity/v3/users/5f32e325258a414187ae2f09584c5213 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:24:51.332382 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb2ebc-94da-4451-a397-9799bd901063 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:51.333377 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb2ebc-94da-4451-a397-9799bd901063 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:51.334331 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb2ebc-94da-4451-a397-9799bd901063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:51.374472 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-9bcb2ebc-94da-4451-a397-9799bd901063 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:24:51.376207 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-9bcb2ebc-94da-4451-a397-9799bd901063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:51.489619 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1024/2054] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:24:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:24:51.502756 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c43877-cb6d-47ec-ac62-ad89501520a1 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:51.504540 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-e3c43877-cb6d-47ec-ac62-ad89501520a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:51.597307 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c43877-cb6d-47ec-ac62-ad89501520a1 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:51.601833 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5897feb2-b5e7-4e8b-a990-622c443d9e4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b0b3ca4ecd41aaba9cf8e0f91fbf54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:51.604048 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5897feb2-b5e7-4e8b-a990-622c443d9e4f service neutron] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:51.604048 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5897feb2-b5e7-4e8b-a990-622c443d9e4f service neutron] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:51.604048 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5897feb2-b5e7-4e8b-a990-622c443d9e4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:51.615767 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5897feb2-b5e7-4e8b-a990-622c443d9e4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:51.617651 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5897feb2-b5e7-4e8b-a990-622c443d9e4f service neutron] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:51.629554 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1031/2055] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:24:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:24:52.378085 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcb2ebc-94da-4451-a397-9799bd901063 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:52.379908 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-9bcb2ebc-94da-4451-a397-9799bd901063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:52.395537 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcb2ebc-94da-4451-a397-9799bd901063 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:52.401354 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfbadfa-6e1e-4d32-bd18-7c82f17cff97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:52.402209 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfbadfa-6e1e-4d32-bd18-7c82f17cff97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:52.402715 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfbadfa-6e1e-4d32-bd18-7c82f17cff97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:52.403134 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfbadfa-6e1e-4d32-bd18-7c82f17cff97 admin admin] PATH_INFO: `/v3/projects/51ca212236254e828b1a59c98ed65314` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:52.404524 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfbadfa-6e1e-4d32-bd18-7c82f17cff97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51ca212236254e828b1a59c98ed65314)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:52.406895 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfbadfa-6e1e-4d32-bd18-7c82f17cff97 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:52.495752 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-fcfbadfa-6e1e-4d32-bd18-7c82f17cff97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51ca212236254e828b1a59c98ed65314', 'request_id': 'req-fcfbadfa-6e1e-4d32-bd18-7c82f17cff97'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:52.503160 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-fcfbadfa-6e1e-4d32-bd18-7c82f17cff97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51ca212236254e828b1a59c98ed65314', 'request_id': 'req-fcfbadfa-6e1e-4d32-bd18-7c82f17cff97'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:52.512714 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-fcfbadfa-6e1e-4d32-bd18-7c82f17cff97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51ca212236254e828b1a59c98ed65314', 'request_id': 'req-fcfbadfa-6e1e-4d32-bd18-7c82f17cff97'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:52.526349 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-fcfbadfa-6e1e-4d32-bd18-7c82f17cff97 admin admin] The token cache is being invalidate because project 51ca212236254e828b1a59c98ed65314 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81307) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 22:24:52.527559 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-fcfbadfa-6e1e-4d32-bd18-7c82f17cff97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:52.528557 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-fcfbadfa-6e1e-4d32-bd18-7c82f17cff97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:52.530858 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1025/2056] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 20 22:24:52 2022] DELETE /identity/v3/projects/51ca212236254e828b1a59c98ed65314 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:24:52.534929 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5897feb2-b5e7-4e8b-a990-622c443d9e4f service neutron] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:52.541083 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:52.545959 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5897feb2-b5e7-4e8b-a990-622c443d9e4f service neutron] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:52.612997 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44028b34-8ef0-4f73-b097-e61dbc3c5fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:52.613640 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44028b34-8ef0-4f73-b097-e61dbc3c5fc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:52.613936 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44028b34-8ef0-4f73-b097-e61dbc3c5fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:52.614192 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44028b34-8ef0-4f73-b097-e61dbc3c5fc0 admin admin] PATH_INFO: `/v3/users/637261b6b7d54f259cbc9cce56b6152f` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:52.615435 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44028b34-8ef0-4f73-b097-e61dbc3c5fc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=637261b6b7d54f259cbc9cce56b6152f)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:52.617335 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44028b34-8ef0-4f73-b097-e61dbc3c5fc0 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:52.692418 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-44028b34-8ef0-4f73-b097-e61dbc3c5fc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '637261b6b7d54f259cbc9cce56b6152f'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:52.705418 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-44028b34-8ef0-4f73-b097-e61dbc3c5fc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '637261b6b7d54f259cbc9cce56b6152f'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:52.706062 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-44028b34-8ef0-4f73-b097-e61dbc3c5fc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '637261b6b7d54f259cbc9cce56b6152f'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:52.706721 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-44028b34-8ef0-4f73-b097-e61dbc3c5fc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '637261b6b7d54f259cbc9cce56b6152f'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:52.714907 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-44028b34-8ef0-4f73-b097-e61dbc3c5fc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '637261b6b7d54f259cbc9cce56b6152f'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:52.740718 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1032/2057] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 20 22:24:52 2022] DELETE /identity/v3/users/637261b6b7d54f259cbc9cce56b6152f => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:24:52.745104 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfbadfa-6e1e-4d32-bd18-7c82f17cff97 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:52.746681 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-fcfbadfa-6e1e-4d32-bd18-7c82f17cff97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:52.759747 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfbadfa-6e1e-4d32-bd18-7c82f17cff97 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:52.778865 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:52.836241 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e1376b-bb60-4300-8747-9c159a4c1aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:52.836919 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e1376b-bb60-4300-8747-9c159a4c1aeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:52.837167 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e1376b-bb60-4300-8747-9c159a4c1aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:52.837476 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e1376b-bb60-4300-8747-9c159a4c1aeb admin admin] PATH_INFO: `/v3/users/89b360e0e34a4d19a267835d4697efa9` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:52.839031 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e1376b-bb60-4300-8747-9c159a4c1aeb admin admin] RBAC: Authorizing `identity:delete_user(user_id=89b360e0e34a4d19a267835d4697efa9)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:52.840533 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e1376b-bb60-4300-8747-9c159a4c1aeb admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:52.898162 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-52e1376b-bb60-4300-8747-9c159a4c1aeb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89b360e0e34a4d19a267835d4697efa9'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:52.909604 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-52e1376b-bb60-4300-8747-9c159a4c1aeb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89b360e0e34a4d19a267835d4697efa9'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:52.910562 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-52e1376b-bb60-4300-8747-9c159a4c1aeb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89b360e0e34a4d19a267835d4697efa9'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:52.911479 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-52e1376b-bb60-4300-8747-9c159a4c1aeb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89b360e0e34a4d19a267835d4697efa9'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:52.921096 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-52e1376b-bb60-4300-8747-9c159a4c1aeb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89b360e0e34a4d19a267835d4697efa9'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:52.942553 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1026/2058] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 20 22:24:52 2022] DELETE /identity/v3/users/89b360e0e34a4d19a267835d4697efa9 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:24:52.947488 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2e5741-9d64-4f2e-be6b-185444139ce0 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:52.948026 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2e5741-9d64-4f2e-be6b-185444139ce0 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:52.948556 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2e5741-9d64-4f2e-be6b-185444139ce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:52.993158 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-5f2e5741-9d64-4f2e-be6b-185444139ce0 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:24:52.995317 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-5f2e5741-9d64-4f2e-be6b-185444139ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:53.077238 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1033/2059] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:24:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 22:24:53.094855 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e1376b-bb60-4300-8747-9c159a4c1aeb admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:53.096795 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-52e1376b-bb60-4300-8747-9c159a4c1aeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:53.190780 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e1376b-bb60-4300-8747-9c159a4c1aeb admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:53.196778 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936dd176-da3d-4712-9dac-369122a92a95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b0b3ca4ecd41aaba9cf8e0f91fbf54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:53.197596 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936dd176-da3d-4712-9dac-369122a92a95 service neutron] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:53.197971 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936dd176-da3d-4712-9dac-369122a92a95 service neutron] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:53.199017 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936dd176-da3d-4712-9dac-369122a92a95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:53.210937 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936dd176-da3d-4712-9dac-369122a92a95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:53.213119 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936dd176-da3d-4712-9dac-369122a92a95 service neutron] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:53.235249 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1027/2060] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:24:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:24:53.615378 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2e5741-9d64-4f2e-be6b-185444139ce0 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:53.617228 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-5f2e5741-9d64-4f2e-be6b-185444139ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:53.638631 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2e5741-9d64-4f2e-be6b-185444139ce0 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:53.656515 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d608d506-ac59-4413-bb84-c855f4906c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:53.657178 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d608d506-ac59-4413-bb84-c855f4906c5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:53.657462 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d608d506-ac59-4413-bb84-c855f4906c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:53.657744 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d608d506-ac59-4413-bb84-c855f4906c5a admin admin] PATH_INFO: `/v3/projects/b63218033a734750b846281d0533cd9e` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:53.659403 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d608d506-ac59-4413-bb84-c855f4906c5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b63218033a734750b846281d0533cd9e)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:53.661448 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d608d506-ac59-4413-bb84-c855f4906c5a admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:53.685670 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:53.726110 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-d608d506-ac59-4413-bb84-c855f4906c5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b63218033a734750b846281d0533cd9e', 'request_id': 'req-d608d506-ac59-4413-bb84-c855f4906c5a'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:53.734868 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-d608d506-ac59-4413-bb84-c855f4906c5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b63218033a734750b846281d0533cd9e', 'request_id': 'req-d608d506-ac59-4413-bb84-c855f4906c5a'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:53.744818 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-d608d506-ac59-4413-bb84-c855f4906c5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b63218033a734750b846281d0533cd9e', 'request_id': 'req-d608d506-ac59-4413-bb84-c855f4906c5a'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:53.763470 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-d608d506-ac59-4413-bb84-c855f4906c5a admin admin] The token cache is being invalidate because project b63218033a734750b846281d0533cd9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81306) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 22:24:53.763470 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-d608d506-ac59-4413-bb84-c855f4906c5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:53.764696 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-d608d506-ac59-4413-bb84-c855f4906c5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:53.766464 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1034/2061] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 20 22:24:53 2022] DELETE /identity/v3/projects/b63218033a734750b846281d0533cd9e => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:24:53.771739 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936dd176-da3d-4712-9dac-369122a92a95 service neutron] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:53.784307 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936dd176-da3d-4712-9dac-369122a92a95 service neutron] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:53.792936 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d608d506-ac59-4413-bb84-c855f4906c5a admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:53.794485 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-d608d506-ac59-4413-bb84-c855f4906c5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:53.847399 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:53.891925 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f2f2cf-f6bb-4025-97d8-6094b7905baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:53.894271 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f2f2cf-f6bb-4025-97d8-6094b7905baa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:53.894887 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f2f2cf-f6bb-4025-97d8-6094b7905baa admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:53.896056 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f2f2cf-f6bb-4025-97d8-6094b7905baa admin admin] PATH_INFO: `/v3/users/267709f15b81472ca7e9f9e7fc9c1d65` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:53.899575 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f2f2cf-f6bb-4025-97d8-6094b7905baa admin admin] RBAC: Authorizing `identity:delete_user(user_id=267709f15b81472ca7e9f9e7fc9c1d65)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:53.905811 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f2f2cf-f6bb-4025-97d8-6094b7905baa admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:53.925952 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d608d506-ac59-4413-bb84-c855f4906c5a admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:53.932655 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed65029-c487-40e6-9c57-7387d61d7992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:53.933564 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed65029-c487-40e6-9c57-7387d61d7992 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:53.934013 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed65029-c487-40e6-9c57-7387d61d7992 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:53.934460 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed65029-c487-40e6-9c57-7387d61d7992 admin admin] PATH_INFO: `/v3/projects/5e85ec92dad745728ad698e8bbb81b86` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:53.936058 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed65029-c487-40e6-9c57-7387d61d7992 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e85ec92dad745728ad698e8bbb81b86)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:53.938495 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed65029-c487-40e6-9c57-7387d61d7992 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:53.989875 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-47f2f2cf-f6bb-4025-97d8-6094b7905baa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '267709f15b81472ca7e9f9e7fc9c1d65'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:54.000492 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-47f2f2cf-f6bb-4025-97d8-6094b7905baa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '267709f15b81472ca7e9f9e7fc9c1d65'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:54.001384 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-47f2f2cf-f6bb-4025-97d8-6094b7905baa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '267709f15b81472ca7e9f9e7fc9c1d65'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:54.002135 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-47f2f2cf-f6bb-4025-97d8-6094b7905baa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '267709f15b81472ca7e9f9e7fc9c1d65'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:54.008083 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-6ed65029-c487-40e6-9c57-7387d61d7992 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e85ec92dad745728ad698e8bbb81b86', 'request_id': 'req-6ed65029-c487-40e6-9c57-7387d61d7992'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:54.016132 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-47f2f2cf-f6bb-4025-97d8-6094b7905baa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '267709f15b81472ca7e9f9e7fc9c1d65'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:54.016642 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-6ed65029-c487-40e6-9c57-7387d61d7992 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e85ec92dad745728ad698e8bbb81b86', 'request_id': 'req-6ed65029-c487-40e6-9c57-7387d61d7992'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:54.026900 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-6ed65029-c487-40e6-9c57-7387d61d7992 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e85ec92dad745728ad698e8bbb81b86', 'request_id': 'req-6ed65029-c487-40e6-9c57-7387d61d7992'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:54.049714 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1028/2062] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 20 22:24:53 2022] DELETE /identity/v3/users/267709f15b81472ca7e9f9e7fc9c1d65 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:24:54.059589 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-6ed65029-c487-40e6-9c57-7387d61d7992 admin admin] The token cache is being invalidate because project 5e85ec92dad745728ad698e8bbb81b86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81306) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 22:24:54.059947 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-6ed65029-c487-40e6-9c57-7387d61d7992 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:54.060676 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-6ed65029-c487-40e6-9c57-7387d61d7992 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:54.062648 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1035/2063] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 20 22:24:53 2022] DELETE /identity/v3/projects/5e85ec92dad745728ad698e8bbb81b86 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:24:54.067187 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b3fac-6826-4064-be0b-08c71a78fa44 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:54.067609 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b3fac-6826-4064-be0b-08c71a78fa44 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:54.067935 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b3fac-6826-4064-be0b-08c71a78fa44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:54.099049 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-a15b3fac-6826-4064-be0b-08c71a78fa44 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:24:54.100850 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-a15b3fac-6826-4064-be0b-08c71a78fa44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:54.187140 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1029/2064] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:24:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 22:24:54.189999 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef80b26-a30a-49cc-af7e-37bb2b1e3f0b None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:54.191110 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef80b26-a30a-49cc-af7e-37bb2b1e3f0b None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:54.191110 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef80b26-a30a-49cc-af7e-37bb2b1e3f0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:54.225938 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-7ef80b26-a30a-49cc-af7e-37bb2b1e3f0b None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:24:54.227556 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-7ef80b26-a30a-49cc-af7e-37bb2b1e3f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:54.249229 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1036/2065] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:24:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:24:54.250970 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15b3fac-6826-4064-be0b-08c71a78fa44 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:54.265920 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15b3fac-6826-4064-be0b-08c71a78fa44 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:54.272353 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a867f9-811a-4bae-b351-735daaba441d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:54.273028 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a867f9-811a-4bae-b351-735daaba441d admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:54.273429 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a867f9-811a-4bae-b351-735daaba441d admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:54.273798 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a867f9-811a-4bae-b351-735daaba441d admin admin] PATH_INFO: `/v3/domains` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:54.274907 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a867f9-811a-4bae-b351-735daaba441d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:24:54.275193 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a867f9-811a-4bae-b351-735daaba441d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:54.277168 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a867f9-811a-4bae-b351-735daaba441d admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:54.310007 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1030/2066] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 20 22:24:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:24:54.314639 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef80b26-a30a-49cc-af7e-37bb2b1e3f0b None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:54.325946 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef80b26-a30a-49cc-af7e-37bb2b1e3f0b None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:54.339978 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cea340c-0c7a-4627-9735-3d2ec6fe743b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:54.340529 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cea340c-0c7a-4627-9735-3d2ec6fe743b admin admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:54.341482 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cea340c-0c7a-4627-9735-3d2ec6fe743b admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:54.341866 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cea340c-0c7a-4627-9735-3d2ec6fe743b admin admin] PATH_INFO: `/v3/projects` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:54.342762 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cea340c-0c7a-4627-9735-3d2ec6fe743b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:54.344910 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cea340c-0c7a-4627-9735-3d2ec6fe743b admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:54.406446 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1037/2067] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 20 22:24:54 2022] POST /identity/v3/projects => generated 385 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 20 22:24:54.407990 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a867f9-811a-4bae-b351-735daaba441d admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:54.419595 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a867f9-811a-4bae-b351-735daaba441d admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:54.483563 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:54.497019 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54f66d1-6ff2-49bb-badc-ac911d3069a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:54.497971 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54f66d1-6ff2-49bb-badc-ac911d3069a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:54.498185 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54f66d1-6ff2-49bb-badc-ac911d3069a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:54.498677 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54f66d1-6ff2-49bb-badc-ac911d3069a1 admin admin] PATH_INFO: `/v3/users` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:54.499613 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54f66d1-6ff2-49bb-badc-ac911d3069a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:54.502102 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54f66d1-6ff2-49bb-badc-ac911d3069a1 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:54.540067 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1031/2068] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 20 22:24:54 2022] POST /identity/v3/users => generated 293 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:24:54.542256 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cea340c-0c7a-4627-9735-3d2ec6fe743b admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:54.556588 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cea340c-0c7a-4627-9735-3d2ec6fe743b admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:54.570583 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e63a24-58a0-442b-ace0-0b597ae5076c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:54.570583 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e63a24-58a0-442b-ace0-0b597ae5076c admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:54.570583 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e63a24-58a0-442b-ace0-0b597ae5076c admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:54.570583 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e63a24-58a0-442b-ace0-0b597ae5076c admin admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:54.571048 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e63a24-58a0-442b-ace0-0b597ae5076c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:54.571048 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e63a24-58a0-442b-ace0-0b597ae5076c admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:54.571048 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:54.597825 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1038/2069] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:24:54 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:24:54.599258 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54f66d1-6ff2-49bb-badc-ac911d3069a1 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:54.610173 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54f66d1-6ff2-49bb-badc-ac911d3069a1 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:54.637439 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f9ae85-374a-43b1-bfa8-c24b49056f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:54.639066 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e63a24-58a0-442b-ace0-0b597ae5076c admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:54.641642 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-85e63a24-58a0-442b-ace0-0b597ae5076c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:54.649427 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f9ae85-374a-43b1-bfa8-c24b49056f4a admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:54.651474 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f9ae85-374a-43b1-bfa8-c24b49056f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:54.651758 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f9ae85-374a-43b1-bfa8-c24b49056f4a admin admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:54.652590 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f9ae85-374a-43b1-bfa8-c24b49056f4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:54.660367 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f9ae85-374a-43b1-bfa8-c24b49056f4a admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:54.676154 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e63a24-58a0-442b-ace0-0b597ae5076c admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:54.688679 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800b1588-72fe-496e-9694-6e3c5fffbe8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:54.690785 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800b1588-72fe-496e-9694-6e3c5fffbe8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:54.691070 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800b1588-72fe-496e-9694-6e3c5fffbe8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:54.691346 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800b1588-72fe-496e-9694-6e3c5fffbe8c admin admin] PATH_INFO: `/v3/projects/866dce0a788744c098ff1baa499d791c` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:54.695502 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800b1588-72fe-496e-9694-6e3c5fffbe8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=866dce0a788744c098ff1baa499d791c)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:54.701162 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800b1588-72fe-496e-9694-6e3c5fffbe8c admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:54.715650 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1032/2070] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:24:54 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:24:54.720438 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f9ae85-374a-43b1-bfa8-c24b49056f4a admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:54.731598 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f9ae85-374a-43b1-bfa8-c24b49056f4a admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:54.737109 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625d70e4-62be-421c-842c-2aafe721febd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:54.737937 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625d70e4-62be-421c-842c-2aafe721febd admin admin] REQUEST_METHOD: `PUT` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:54.738318 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625d70e4-62be-421c-842c-2aafe721febd admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:54.738740 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625d70e4-62be-421c-842c-2aafe721febd admin admin] PATH_INFO: `/v3/projects/98e090a884914d20ad36f3b3c946db9e/users/e518a43f6cef42199b096d056325fec4/roles/604444e7ad0d437dbd1f5a6e02b761f5` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:54.767635 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625d70e4-62be-421c-842c-2aafe721febd admin admin] RBAC: Authorizing `identity:create_grant(project_id=98e090a884914d20ad36f3b3c946db9e, user_id=e518a43f6cef42199b096d056325fec4, role_id=604444e7ad0d437dbd1f5a6e02b761f5)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:54.770964 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625d70e4-62be-421c-842c-2aafe721febd admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:54.806927 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1033/2071] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:24:54 2022] PUT /identity/v3/projects/98e090a884914d20ad36f3b3c946db9e/users/e518a43f6cef42199b096d056325fec4/roles/604444e7ad0d437dbd1f5a6e02b761f5 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 22:24:54.809301 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb69c53f-9375-4653-b7a2-dc2643c022f6 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:54.810032 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb69c53f-9375-4653-b7a2-dc2643c022f6 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:54.810540 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb69c53f-9375-4653-b7a2-dc2643c022f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:54.823095 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-800b1588-72fe-496e-9694-6e3c5fffbe8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '866dce0a788744c098ff1baa499d791c', 'request_id': 'req-800b1588-72fe-496e-9694-6e3c5fffbe8c'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:54.833540 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-800b1588-72fe-496e-9694-6e3c5fffbe8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '866dce0a788744c098ff1baa499d791c', 'request_id': 'req-800b1588-72fe-496e-9694-6e3c5fffbe8c'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:54.848076 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-800b1588-72fe-496e-9694-6e3c5fffbe8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '866dce0a788744c098ff1baa499d791c', 'request_id': 'req-800b1588-72fe-496e-9694-6e3c5fffbe8c'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:54.851538 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-fb69c53f-9375-4653-b7a2-dc2643c022f6 None None] MFA Rules not processed for user `e518a43f6cef42199b096d056325fec4`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:24:54.853053 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-fb69c53f-9375-4653-b7a2-dc2643c022f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:54.870872 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-800b1588-72fe-496e-9694-6e3c5fffbe8c admin admin] The token cache is being invalidate because project 866dce0a788744c098ff1baa499d791c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81306) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 22:24:54.871273 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-800b1588-72fe-496e-9694-6e3c5fffbe8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:54.875033 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-800b1588-72fe-496e-9694-6e3c5fffbe8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:54.878590 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1039/2072] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 20 22:24:54 2022] DELETE /identity/v3/projects/866dce0a788744c098ff1baa499d791c => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 22:24:54.882492 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800b1588-72fe-496e-9694-6e3c5fffbe8c admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:54.884017 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-800b1588-72fe-496e-9694-6e3c5fffbe8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:54.961886 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1034/2073] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:24:54 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:24:54.975061 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb69c53f-9375-4653-b7a2-dc2643c022f6 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:54.976884 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-fb69c53f-9375-4653-b7a2-dc2643c022f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:54.977692 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800b1588-72fe-496e-9694-6e3c5fffbe8c admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:55.057933 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53f723c-ab44-47b9-a1ff-d94c89422eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:55.058654 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53f723c-ab44-47b9-a1ff-d94c89422eb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:55.058943 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53f723c-ab44-47b9-a1ff-d94c89422eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:55.059259 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53f723c-ab44-47b9-a1ff-d94c89422eb4 admin admin] PATH_INFO: `/v3/users/63e7032eee2d4bf3ba3554fc7c83be38` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:55.061750 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53f723c-ab44-47b9-a1ff-d94c89422eb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63e7032eee2d4bf3ba3554fc7c83be38)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:55.062564 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb69c53f-9375-4653-b7a2-dc2643c022f6 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:55.063814 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53f723c-ab44-47b9-a1ff-d94c89422eb4 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:55.066400 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beca2ac6-ef28-4f90-929e-5f8fa5a7c42a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577c8b14c1f4279beac13b9ba11aba1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:55.067140 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca2ac6-ef28-4f90-929e-5f8fa5a7c42a service cinder] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:55.067492 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca2ac6-ef28-4f90-929e-5f8fa5a7c42a service cinder] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:55.067834 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca2ac6-ef28-4f90-929e-5f8fa5a7c42a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:55.079486 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beca2ac6-ef28-4f90-929e-5f8fa5a7c42a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:55.083220 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beca2ac6-ef28-4f90-929e-5f8fa5a7c42a service cinder] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:55.099608 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1035/2074] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:24:54 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 20 22:24:55.108515 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:55.180030 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-d53f723c-ab44-47b9-a1ff-d94c89422eb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63e7032eee2d4bf3ba3554fc7c83be38'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:55.210398 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-d53f723c-ab44-47b9-a1ff-d94c89422eb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63e7032eee2d4bf3ba3554fc7c83be38'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:55.213119 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-d53f723c-ab44-47b9-a1ff-d94c89422eb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63e7032eee2d4bf3ba3554fc7c83be38'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:55.216071 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-d53f723c-ab44-47b9-a1ff-d94c89422eb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63e7032eee2d4bf3ba3554fc7c83be38'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:55.244713 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-d53f723c-ab44-47b9-a1ff-d94c89422eb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63e7032eee2d4bf3ba3554fc7c83be38'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:55.273784 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1040/2075] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 20 22:24:54 2022] DELETE /identity/v3/users/63e7032eee2d4bf3ba3554fc7c83be38 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:24:55.344438 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beca2ac6-ef28-4f90-929e-5f8fa5a7c42a service cinder] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:55.346039 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-beca2ac6-ef28-4f90-929e-5f8fa5a7c42a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:55.373852 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beca2ac6-ef28-4f90-929e-5f8fa5a7c42a service cinder] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:55.428304 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:55.461787 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09d6fc1-54a0-4572-b756-c6265cdb6f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:55.463277 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09d6fc1-54a0-4572-b756-c6265cdb6f47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:55.463788 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09d6fc1-54a0-4572-b756-c6265cdb6f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:55.463949 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09d6fc1-54a0-4572-b756-c6265cdb6f47 admin admin] PATH_INFO: `/v3/users/dbc62ce3380448f3b5155e6b26a6dd43` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:55.465225 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09d6fc1-54a0-4572-b756-c6265cdb6f47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbc62ce3380448f3b5155e6b26a6dd43)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:55.467665 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09d6fc1-54a0-4572-b756-c6265cdb6f47 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:55.564369 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-e09d6fc1-54a0-4572-b756-c6265cdb6f47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbc62ce3380448f3b5155e6b26a6dd43'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:55.594419 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-e09d6fc1-54a0-4572-b756-c6265cdb6f47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbc62ce3380448f3b5155e6b26a6dd43'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:55.595309 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-e09d6fc1-54a0-4572-b756-c6265cdb6f47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbc62ce3380448f3b5155e6b26a6dd43'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:55.595932 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-e09d6fc1-54a0-4572-b756-c6265cdb6f47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbc62ce3380448f3b5155e6b26a6dd43'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:55.606785 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-e09d6fc1-54a0-4572-b756-c6265cdb6f47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbc62ce3380448f3b5155e6b26a6dd43'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:55.652734 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1036/2076] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 20 22:24:55 2022] DELETE /identity/v3/users/dbc62ce3380448f3b5155e6b26a6dd43 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:24:55.658014 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfc369b-4c35-4e18-b5c5-7f4782d7270e None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:55.658652 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfc369b-4c35-4e18-b5c5-7f4782d7270e None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:55.658652 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfc369b-4c35-4e18-b5c5-7f4782d7270e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:55.690722 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-5cfc369b-4c35-4e18-b5c5-7f4782d7270e None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:24:55.693175 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-5cfc369b-4c35-4e18-b5c5-7f4782d7270e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:55.777556 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1041/2077] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:24:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:24:55.788942 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09d6fc1-54a0-4572-b756-c6265cdb6f47 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:55.790589 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-e09d6fc1-54a0-4572-b756-c6265cdb6f47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:55.886909 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09d6fc1-54a0-4572-b756-c6265cdb6f47 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:55.891857 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4ddc47-5707-4c4d-927a-894f1d20124c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b0b3ca4ecd41aaba9cf8e0f91fbf54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:55.893381 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4ddc47-5707-4c4d-927a-894f1d20124c service neutron] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:55.893821 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4ddc47-5707-4c4d-927a-894f1d20124c service neutron] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:55.894469 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4ddc47-5707-4c4d-927a-894f1d20124c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:55.918584 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4ddc47-5707-4c4d-927a-894f1d20124c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:55.923410 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4ddc47-5707-4c4d-927a-894f1d20124c service neutron] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:55.937849 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1037/2078] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:24:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:24:56.012151 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfc369b-4c35-4e18-b5c5-7f4782d7270e None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:56.014059 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-5cfc369b-4c35-4e18-b5c5-7f4782d7270e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:56.031826 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfc369b-4c35-4e18-b5c5-7f4782d7270e None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:56.044032 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092e65f1-59a9-4309-befd-73dc22bd71c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:56.044700 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092e65f1-59a9-4309-befd-73dc22bd71c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:56.045233 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092e65f1-59a9-4309-befd-73dc22bd71c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:56.045994 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092e65f1-59a9-4309-befd-73dc22bd71c5 admin admin] PATH_INFO: `/v3/projects/2a8f6033330744b6a8f62c37a1e2ed58` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:56.049573 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092e65f1-59a9-4309-befd-73dc22bd71c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a8f6033330744b6a8f62c37a1e2ed58)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:56.052643 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092e65f1-59a9-4309-befd-73dc22bd71c5 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:56.179913 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-092e65f1-59a9-4309-befd-73dc22bd71c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a8f6033330744b6a8f62c37a1e2ed58', 'request_id': 'req-092e65f1-59a9-4309-befd-73dc22bd71c5'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:56.190244 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-092e65f1-59a9-4309-befd-73dc22bd71c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a8f6033330744b6a8f62c37a1e2ed58', 'request_id': 'req-092e65f1-59a9-4309-befd-73dc22bd71c5'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:56.205677 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-092e65f1-59a9-4309-befd-73dc22bd71c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a8f6033330744b6a8f62c37a1e2ed58', 'request_id': 'req-092e65f1-59a9-4309-befd-73dc22bd71c5'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:56.231526 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-092e65f1-59a9-4309-befd-73dc22bd71c5 admin admin] The token cache is being invalidate because project 2a8f6033330744b6a8f62c37a1e2ed58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81306) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 22:24:56.232177 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-092e65f1-59a9-4309-befd-73dc22bd71c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:56.233806 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-092e65f1-59a9-4309-befd-73dc22bd71c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:56.236774 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1042/2079] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 20 22:24:56 2022] DELETE /identity/v3/projects/2a8f6033330744b6a8f62c37a1e2ed58 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:24:56.242688 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c98297-4c99-4fd0-943b-13f92160ff8e None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:56.242978 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c98297-4c99-4fd0-943b-13f92160ff8e None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:56.243253 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c98297-4c99-4fd0-943b-13f92160ff8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:56.260440 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092e65f1-59a9-4309-befd-73dc22bd71c5 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:56.261849 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-092e65f1-59a9-4309-befd-73dc22bd71c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:56.282941 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-b7c98297-4c99-4fd0-943b-13f92160ff8e None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:24:56.284161 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-b7c98297-4c99-4fd0-943b-13f92160ff8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:56.326613 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:56.447127 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092e65f1-59a9-4309-befd-73dc22bd71c5 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:56.457478 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:56.461063 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f1889f-1a82-44f7-b7f8-d1eb1d9bd806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:56.461820 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f1889f-1a82-44f7-b7f8-d1eb1d9bd806 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:56.462142 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f1889f-1a82-44f7-b7f8-d1eb1d9bd806 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:56.462547 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f1889f-1a82-44f7-b7f8-d1eb1d9bd806 admin admin] PATH_INFO: `/v3/users/1656c253f74c4c598b23a0fdb826b27b` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:56.468843 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f1889f-1a82-44f7-b7f8-d1eb1d9bd806 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1656c253f74c4c598b23a0fdb826b27b)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:56.471252 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f1889f-1a82-44f7-b7f8-d1eb1d9bd806 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:56.474555 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1038/2080] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:24:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:24:56.484112 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811725e8-0968-427b-b21a-6be19768b762 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:56.485809 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811725e8-0968-427b-b21a-6be19768b762 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:56.486092 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811725e8-0968-427b-b21a-6be19768b762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:56.510167 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-811725e8-0968-427b-b21a-6be19768b762 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:24:56.511447 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-811725e8-0968-427b-b21a-6be19768b762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:56.521765 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1039/2081] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:24:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:24:56.529379 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811725e8-0968-427b-b21a-6be19768b762 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:56.542385 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811725e8-0968-427b-b21a-6be19768b762 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:56.548748 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3530fd-8d5f-4c3e-a64a-cb05661a13f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:56.549758 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3530fd-8d5f-4c3e-a64a-cb05661a13f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:56.550227 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3530fd-8d5f-4c3e-a64a-cb05661a13f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:56.550904 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3530fd-8d5f-4c3e-a64a-cb05661a13f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:56.551847 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3530fd-8d5f-4c3e-a64a-cb05661a13f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:24:56.552299 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3530fd-8d5f-4c3e-a64a-cb05661a13f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:56.553697 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-31f1889f-1a82-44f7-b7f8-d1eb1d9bd806 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1656c253f74c4c598b23a0fdb826b27b'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:56.554540 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3530fd-8d5f-4c3e-a64a-cb05661a13f8 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:56.566604 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-31f1889f-1a82-44f7-b7f8-d1eb1d9bd806 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1656c253f74c4c598b23a0fdb826b27b'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:56.567839 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-31f1889f-1a82-44f7-b7f8-d1eb1d9bd806 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1656c253f74c4c598b23a0fdb826b27b'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:56.568184 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-31f1889f-1a82-44f7-b7f8-d1eb1d9bd806 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1656c253f74c4c598b23a0fdb826b27b'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:56.580510 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-31f1889f-1a82-44f7-b7f8-d1eb1d9bd806 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1656c253f74c4c598b23a0fdb826b27b'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:56.581547 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1040/2082] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 20 22:24:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:24:56.582964 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3530fd-8d5f-4c3e-a64a-cb05661a13f8 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:56.603696 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-9f3530fd-8d5f-4c3e-a64a-cb05661a13f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:56.613539 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1043/2083] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 20 22:24:56 2022] DELETE /identity/v3/users/1656c253f74c4c598b23a0fdb826b27b => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 22:24:56.615250 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c3ee06-66a0-410b-b73a-196abd27cb52 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:56.615612 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c3ee06-66a0-410b-b73a-196abd27cb52 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:56.616494 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c3ee06-66a0-410b-b73a-196abd27cb52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:56.649674 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-74c3ee06-66a0-410b-b73a-196abd27cb52 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:24:56.651659 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-74c3ee06-66a0-410b-b73a-196abd27cb52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:56.657854 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3530fd-8d5f-4c3e-a64a-cb05661a13f8 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:56.737956 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1044/2084] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:24:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 22:24:56.745505 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c3ee06-66a0-410b-b73a-196abd27cb52 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:56.747077 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-74c3ee06-66a0-410b-b73a-196abd27cb52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:56.810926 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd914e6-5a94-4d4b-a372-d65f765b00f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:56.811731 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd914e6-5a94-4d4b-a372-d65f765b00f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:56.813916 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd914e6-5a94-4d4b-a372-d65f765b00f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:56.814300 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd914e6-5a94-4d4b-a372-d65f765b00f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:56.815326 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd914e6-5a94-4d4b-a372-d65f765b00f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:56.820840 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd914e6-5a94-4d4b-a372-d65f765b00f6 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:56.874983 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1041/2085] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 20 22:24:56 2022] POST /identity/v3/projects => generated 385 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:24:56.877556 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd914e6-5a94-4d4b-a372-d65f765b00f6 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:56.913581 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c3ee06-66a0-410b-b73a-196abd27cb52 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:56.918816 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:56.981291 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd914e6-5a94-4d4b-a372-d65f765b00f6 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:56.989910 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eda8ae-aecc-40b1-88c2-38b465bed092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:56.990820 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eda8ae-aecc-40b1-88c2-38b465bed092 admin admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:56.991496 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eda8ae-aecc-40b1-88c2-38b465bed092 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:56.992763 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eda8ae-aecc-40b1-88c2-38b465bed092 admin admin] PATH_INFO: `/v3/users` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:56.993880 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5eda8ae-aecc-40b1-88c2-38b465bed092 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:56.997331 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5eda8ae-aecc-40b1-88c2-38b465bed092 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:57.023581 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9eb2ef-cc22-41e3-b595-ed3eaf998f0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b0b3ca4ecd41aaba9cf8e0f91fbf54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:57.025933 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9eb2ef-cc22-41e3-b595-ed3eaf998f0a service neutron] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:57.026060 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9eb2ef-cc22-41e3-b595-ed3eaf998f0a service neutron] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:57.030455 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9eb2ef-cc22-41e3-b595-ed3eaf998f0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:57.052890 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9eb2ef-cc22-41e3-b595-ed3eaf998f0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:57.057501 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1042/2086] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 20 22:24:56 2022] POST /identity/v3/users => generated 293 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:24:57.061440 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9eb2ef-cc22-41e3-b595-ed3eaf998f0a service neutron] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:57.062252 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eda8ae-aecc-40b1-88c2-38b465bed092 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:57.080704 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1045/2087] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:24:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:24:57.102133 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eda8ae-aecc-40b1-88c2-38b465bed092 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:57.108869 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774f4eee-720d-4c8f-b90a-2b35edf45033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:57.109727 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774f4eee-720d-4c8f-b90a-2b35edf45033 admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:57.110134 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774f4eee-720d-4c8f-b90a-2b35edf45033 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:57.110492 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774f4eee-720d-4c8f-b90a-2b35edf45033 admin admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:57.111499 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774f4eee-720d-4c8f-b90a-2b35edf45033 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:57.113777 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774f4eee-720d-4c8f-b90a-2b35edf45033 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:57.143088 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1043/2088] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:24:57 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:24:57.148068 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9eb2ef-cc22-41e3-b595-ed3eaf998f0a service neutron] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:57.168338 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9eb2ef-cc22-41e3-b595-ed3eaf998f0a service neutron] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:57.185078 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68132cdd-3210-4fba-bda2-4701d0fe5cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:57.189710 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68132cdd-3210-4fba-bda2-4701d0fe5cb5 admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:57.190042 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68132cdd-3210-4fba-bda2-4701d0fe5cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:57.190567 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68132cdd-3210-4fba-bda2-4701d0fe5cb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:57.194795 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68132cdd-3210-4fba-bda2-4701d0fe5cb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:57.201978 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68132cdd-3210-4fba-bda2-4701d0fe5cb5 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:57.240123 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1046/2089] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:24:57 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:24:57.243283 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774f4eee-720d-4c8f-b90a-2b35edf45033 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:57.262413 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774f4eee-720d-4c8f-b90a-2b35edf45033 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:57.308851 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f442fe73-73c8-4801-b24e-dcb4fdaf1409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:57.310912 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f442fe73-73c8-4801-b24e-dcb4fdaf1409 admin admin] REQUEST_METHOD: `PUT` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:57.313339 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f442fe73-73c8-4801-b24e-dcb4fdaf1409 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:57.315164 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f442fe73-73c8-4801-b24e-dcb4fdaf1409 admin admin] PATH_INFO: `/v3/projects/3e5e118aef2849169e40a89692818216/users/5009c18a63724d33b7bcac04a1534b2e/roles/604444e7ad0d437dbd1f5a6e02b761f5` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:57.373517 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f442fe73-73c8-4801-b24e-dcb4fdaf1409 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e5e118aef2849169e40a89692818216, user_id=5009c18a63724d33b7bcac04a1534b2e, role_id=604444e7ad0d437dbd1f5a6e02b761f5)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:57.379705 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f442fe73-73c8-4801-b24e-dcb4fdaf1409 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:57.455596 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1044/2090] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:24:57 2022] PUT /identity/v3/projects/3e5e118aef2849169e40a89692818216/users/5009c18a63724d33b7bcac04a1534b2e/roles/604444e7ad0d437dbd1f5a6e02b761f5 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:24:57.458870 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc960d2-dccb-4277-b4ee-67d931b6d6be None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:57.459527 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc960d2-dccb-4277-b4ee-67d931b6d6be None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:57.459527 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc960d2-dccb-4277-b4ee-67d931b6d6be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:57.529178 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f442fe73-73c8-4801-b24e-dcb4fdaf1409 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:57.531731 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-f442fe73-73c8-4801-b24e-dcb4fdaf1409 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:57.540931 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-8fc960d2-dccb-4277-b4ee-67d931b6d6be None None] MFA Rules not processed for user `5009c18a63724d33b7bcac04a1534b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:24:57.545560 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-8fc960d2-dccb-4277-b4ee-67d931b6d6be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:57.568601 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:57.624712 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f442fe73-73c8-4801-b24e-dcb4fdaf1409 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:57.634821 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da44f19-e391-4629-8c9d-149f1c224f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:57.635501 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da44f19-e391-4629-8c9d-149f1c224f7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:57.635908 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da44f19-e391-4629-8c9d-149f1c224f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:57.636230 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da44f19-e391-4629-8c9d-149f1c224f7d admin admin] PATH_INFO: `/v3/projects/d15db981cc674e74a19c63b4506b66c8` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:57.637607 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da44f19-e391-4629-8c9d-149f1c224f7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d15db981cc674e74a19c63b4506b66c8)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:57.639586 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da44f19-e391-4629-8c9d-149f1c224f7d admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:57.647510 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1047/2091] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:24:57 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:24:57.671701 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc960d2-dccb-4277-b4ee-67d931b6d6be None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:57.671701 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-8fc960d2-dccb-4277-b4ee-67d931b6d6be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:57.775743 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc960d2-dccb-4277-b4ee-67d931b6d6be None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:57.777572 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-9da44f19-e391-4629-8c9d-149f1c224f7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd15db981cc674e74a19c63b4506b66c8', 'request_id': 'req-9da44f19-e391-4629-8c9d-149f1c224f7d'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:57.784474 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-9da44f19-e391-4629-8c9d-149f1c224f7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd15db981cc674e74a19c63b4506b66c8', 'request_id': 'req-9da44f19-e391-4629-8c9d-149f1c224f7d'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:57.793802 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-9da44f19-e391-4629-8c9d-149f1c224f7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd15db981cc674e74a19c63b4506b66c8', 'request_id': 'req-9da44f19-e391-4629-8c9d-149f1c224f7d'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:57.807256 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-9da44f19-e391-4629-8c9d-149f1c224f7d admin admin] The token cache is being invalidate because project d15db981cc674e74a19c63b4506b66c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81307) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 22:24:57.807547 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-9da44f19-e391-4629-8c9d-149f1c224f7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:57.808215 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-9da44f19-e391-4629-8c9d-149f1c224f7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:57.809904 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1045/2092] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 20 22:24:57 2022] DELETE /identity/v3/projects/d15db981cc674e74a19c63b4506b66c8 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:24:57.810487 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da44f19-e391-4629-8c9d-149f1c224f7d admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:57.811789 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-9da44f19-e391-4629-8c9d-149f1c224f7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:57.850791 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:57.859933 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc4f722-3185-43ad-80b2-e75a16aed58a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577c8b14c1f4279beac13b9ba11aba1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:57.860647 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc4f722-3185-43ad-80b2-e75a16aed58a service cinder] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:57.860989 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc4f722-3185-43ad-80b2-e75a16aed58a service cinder] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:57.861357 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc4f722-3185-43ad-80b2-e75a16aed58a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:57.863249 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-1dc4f722-3185-43ad-80b2-e75a16aed58a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:57.911542 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da44f19-e391-4629-8c9d-149f1c224f7d admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:57.917598 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bc6772-2d8b-42a8-8e80-b57bd26a7e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:57.918466 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bc6772-2d8b-42a8-8e80-b57bd26a7e30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:57.918781 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bc6772-2d8b-42a8-8e80-b57bd26a7e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:57.919056 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bc6772-2d8b-42a8-8e80-b57bd26a7e30 admin admin] PATH_INFO: `/v3/projects/e96ba247ae904dfe942586e4b25fbbc9` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:57.920714 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bc6772-2d8b-42a8-8e80-b57bd26a7e30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e96ba247ae904dfe942586e4b25fbbc9)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:57.922834 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bc6772-2d8b-42a8-8e80-b57bd26a7e30 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:57.950637 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc4f722-3185-43ad-80b2-e75a16aed58a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:57.952302 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc4f722-3185-43ad-80b2-e75a16aed58a service cinder] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:57.964673 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1048/2093] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:24:57 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 20 22:24:57.980805 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-c1bc6772-2d8b-42a8-8e80-b57bd26a7e30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e96ba247ae904dfe942586e4b25fbbc9', 'request_id': 'req-c1bc6772-2d8b-42a8-8e80-b57bd26a7e30'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:57.984218 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:57.990495 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-c1bc6772-2d8b-42a8-8e80-b57bd26a7e30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e96ba247ae904dfe942586e4b25fbbc9', 'request_id': 'req-c1bc6772-2d8b-42a8-8e80-b57bd26a7e30'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:58.002848 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-c1bc6772-2d8b-42a8-8e80-b57bd26a7e30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e96ba247ae904dfe942586e4b25fbbc9', 'request_id': 'req-c1bc6772-2d8b-42a8-8e80-b57bd26a7e30'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:58.022647 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-c1bc6772-2d8b-42a8-8e80-b57bd26a7e30 admin admin] The token cache is being invalidate because project e96ba247ae904dfe942586e4b25fbbc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81307) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 22:24:58.023056 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-c1bc6772-2d8b-42a8-8e80-b57bd26a7e30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:58.024467 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-c1bc6772-2d8b-42a8-8e80-b57bd26a7e30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:58.027088 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1046/2094] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 20 22:24:57 2022] DELETE /identity/v3/projects/e96ba247ae904dfe942586e4b25fbbc9 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:24:58.030390 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc4f722-3185-43ad-80b2-e75a16aed58a service cinder] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:58.042683 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc4f722-3185-43ad-80b2-e75a16aed58a service cinder] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:58.118014 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514916a0-703f-40fa-a7fd-6182c6b9dbda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:58.120906 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514916a0-703f-40fa-a7fd-6182c6b9dbda admin admin] REQUEST_METHOD: `DELETE` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:58.122565 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514916a0-703f-40fa-a7fd-6182c6b9dbda admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:58.122565 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514916a0-703f-40fa-a7fd-6182c6b9dbda admin admin] PATH_INFO: `/v3/users/00cd3b8d33e7428d98f1acd259f10a2b` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:58.127471 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514916a0-703f-40fa-a7fd-6182c6b9dbda admin admin] RBAC: Authorizing `identity:delete_user(user_id=00cd3b8d33e7428d98f1acd259f10a2b)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:58.128745 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bc6772-2d8b-42a8-8e80-b57bd26a7e30 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:58.129478 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514916a0-703f-40fa-a7fd-6182c6b9dbda admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:58.130168 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-c1bc6772-2d8b-42a8-8e80-b57bd26a7e30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:58.150121 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bc6772-2d8b-42a8-8e80-b57bd26a7e30 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:58.156729 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f70a626-c9f7-4fc3-ada5-20cc57b9e1ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:58.156729 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f70a626-c9f7-4fc3-ada5-20cc57b9e1ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:58.156729 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f70a626-c9f7-4fc3-ada5-20cc57b9e1ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:58.157057 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f70a626-c9f7-4fc3-ada5-20cc57b9e1ac admin admin] PATH_INFO: `/v3/users/e518a43f6cef42199b096d056325fec4` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:58.158141 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f70a626-c9f7-4fc3-ada5-20cc57b9e1ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=e518a43f6cef42199b096d056325fec4)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:58.160415 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f70a626-c9f7-4fc3-ada5-20cc57b9e1ac admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:58.196599 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-514916a0-703f-40fa-a7fd-6182c6b9dbda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00cd3b8d33e7428d98f1acd259f10a2b'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:58.204813 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-514916a0-703f-40fa-a7fd-6182c6b9dbda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00cd3b8d33e7428d98f1acd259f10a2b'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:58.205621 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-514916a0-703f-40fa-a7fd-6182c6b9dbda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00cd3b8d33e7428d98f1acd259f10a2b'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:58.206258 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-514916a0-703f-40fa-a7fd-6182c6b9dbda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00cd3b8d33e7428d98f1acd259f10a2b'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:58.233137 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-514916a0-703f-40fa-a7fd-6182c6b9dbda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00cd3b8d33e7428d98f1acd259f10a2b'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:58.256381 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-2f70a626-c9f7-4fc3-ada5-20cc57b9e1ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e518a43f6cef42199b096d056325fec4'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:58.264429 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1049/2095] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 20 22:24:58 2022] DELETE /identity/v3/users/00cd3b8d33e7428d98f1acd259f10a2b => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:24:58.268991 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-2f70a626-c9f7-4fc3-ada5-20cc57b9e1ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e518a43f6cef42199b096d056325fec4'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:58.269822 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-2f70a626-c9f7-4fc3-ada5-20cc57b9e1ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e518a43f6cef42199b096d056325fec4'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:58.270451 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-2f70a626-c9f7-4fc3-ada5-20cc57b9e1ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e518a43f6cef42199b096d056325fec4'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:58.279032 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-2f70a626-c9f7-4fc3-ada5-20cc57b9e1ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e518a43f6cef42199b096d056325fec4'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:58.313493 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519146d0-4ec7-430a-bc30-86dd59dcff28 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:58.313776 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519146d0-4ec7-430a-bc30-86dd59dcff28 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:58.314058 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519146d0-4ec7-430a-bc30-86dd59dcff28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:58.317259 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1047/2096] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 20 22:24:58 2022] DELETE /identity/v3/users/e518a43f6cef42199b096d056325fec4 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 22:24:58.335442 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-519146d0-4ec7-430a-bc30-86dd59dcff28 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:24:58.336656 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-519146d0-4ec7-430a-bc30-86dd59dcff28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:58.355839 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:58.462704 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1050/2097] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:24:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:24:58.476219 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f70a626-c9f7-4fc3-ada5-20cc57b9e1ac admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:58.479008 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-2f70a626-c9f7-4fc3-ada5-20cc57b9e1ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:58.550237 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f70a626-c9f7-4fc3-ada5-20cc57b9e1ac admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:58.554941 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c402650-2cfd-478e-855e-f764b2b5bdfa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b0b3ca4ecd41aaba9cf8e0f91fbf54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:58.555661 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c402650-2cfd-478e-855e-f764b2b5bdfa service neutron] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:58.556207 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c402650-2cfd-478e-855e-f764b2b5bdfa service neutron] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:58.556593 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c402650-2cfd-478e-855e-f764b2b5bdfa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:58.568189 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c402650-2cfd-478e-855e-f764b2b5bdfa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:58.569732 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c402650-2cfd-478e-855e-f764b2b5bdfa service neutron] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:58.580512 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1048/2098] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:24:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:24:58.797853 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519146d0-4ec7-430a-bc30-86dd59dcff28 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:58.799326 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-519146d0-4ec7-430a-bc30-86dd59dcff28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:58.812480 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519146d0-4ec7-430a-bc30-86dd59dcff28 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:58.821260 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249fb051-71cb-4c26-96da-e8ebee0f26da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:58.822455 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249fb051-71cb-4c26-96da-e8ebee0f26da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:58.822763 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249fb051-71cb-4c26-96da-e8ebee0f26da admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:58.823037 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249fb051-71cb-4c26-96da-e8ebee0f26da admin admin] PATH_INFO: `/v3/projects/29773d7f9614414a8a31a44a46079c9d` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:58.826756 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249fb051-71cb-4c26-96da-e8ebee0f26da admin admin] RBAC: Authorizing `identity:delete_project(project_id=29773d7f9614414a8a31a44a46079c9d)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:58.829118 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249fb051-71cb-4c26-96da-e8ebee0f26da admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:58.899139 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-249fb051-71cb-4c26-96da-e8ebee0f26da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29773d7f9614414a8a31a44a46079c9d', 'request_id': 'req-249fb051-71cb-4c26-96da-e8ebee0f26da'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:58.907696 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-249fb051-71cb-4c26-96da-e8ebee0f26da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29773d7f9614414a8a31a44a46079c9d', 'request_id': 'req-249fb051-71cb-4c26-96da-e8ebee0f26da'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:58.917433 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-249fb051-71cb-4c26-96da-e8ebee0f26da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29773d7f9614414a8a31a44a46079c9d', 'request_id': 'req-249fb051-71cb-4c26-96da-e8ebee0f26da'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:58.942060 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-249fb051-71cb-4c26-96da-e8ebee0f26da admin admin] The token cache is being invalidate because project 29773d7f9614414a8a31a44a46079c9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81306) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 22:24:58.942266 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-249fb051-71cb-4c26-96da-e8ebee0f26da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:58.942965 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-249fb051-71cb-4c26-96da-e8ebee0f26da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:58.947153 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1051/2099] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 20 22:24:58 2022] DELETE /identity/v3/projects/29773d7f9614414a8a31a44a46079c9d => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:24:58.950800 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9531482e-0c0d-4302-8dd1-a9dcc91a84ef None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:58.951407 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9531482e-0c0d-4302-8dd1-a9dcc91a84ef None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:58.951849 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9531482e-0c0d-4302-8dd1-a9dcc91a84ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:58.975366 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-9531482e-0c0d-4302-8dd1-a9dcc91a84ef None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:24:58.977081 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-9531482e-0c0d-4302-8dd1-a9dcc91a84ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:59.049771 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:59.064953 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1049/2100] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:24:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 22:24:59.075933 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a0da6-196f-4331-b925-46869f936823 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:59.076240 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a0da6-196f-4331-b925-46869f936823 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:59.076629 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a0da6-196f-4331-b925-46869f936823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:59.098451 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9531482e-0c0d-4302-8dd1-a9dcc91a84ef None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:59.100154 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-9531482e-0c0d-4302-8dd1-a9dcc91a84ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:59.120369 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9531482e-0c0d-4302-8dd1-a9dcc91a84ef None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:59.133087 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-7d5a0da6-196f-4331-b925-46869f936823 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:24:59.136376 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-7d5a0da6-196f-4331-b925-46869f936823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:59.146370 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1052/2101] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:24:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:24:59.150427 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceb89cd-7283-472a-b9d5-0f6a272966a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:59.150618 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5a0da6-196f-4331-b925-46869f936823 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:59.151170 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceb89cd-7283-472a-b9d5-0f6a272966a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:59.151456 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceb89cd-7283-472a-b9d5-0f6a272966a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:59.151732 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceb89cd-7283-472a-b9d5-0f6a272966a6 admin admin] PATH_INFO: `/v3/projects/98e090a884914d20ad36f3b3c946db9e` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:59.154987 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceb89cd-7283-472a-b9d5-0f6a272966a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98e090a884914d20ad36f3b3c946db9e)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:59.156982 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceb89cd-7283-472a-b9d5-0f6a272966a6 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:59.164307 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5a0da6-196f-4331-b925-46869f936823 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:59.170584 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fefb72e-4f60-49ed-a71e-523ffe9394ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:59.171654 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fefb72e-4f60-49ed-a71e-523ffe9394ee admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:59.172325 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fefb72e-4f60-49ed-a71e-523ffe9394ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:59.172792 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fefb72e-4f60-49ed-a71e-523ffe9394ee admin admin] PATH_INFO: `/v3/domains` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:59.174205 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fefb72e-4f60-49ed-a71e-523ffe9394ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:24:59.174744 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fefb72e-4f60-49ed-a71e-523ffe9394ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:59.176556 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fefb72e-4f60-49ed-a71e-523ffe9394ee admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:59.195269 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1053/2102] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 20 22:24:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 22:24:59.201009 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fefb72e-4f60-49ed-a71e-523ffe9394ee admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:59.224569 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fefb72e-4f60-49ed-a71e-523ffe9394ee admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:59.230400 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e133a203-58a1-47c6-a9bc-dc0e600170c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:59.231070 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e133a203-58a1-47c6-a9bc-dc0e600170c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:59.231345 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e133a203-58a1-47c6-a9bc-dc0e600170c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:59.231614 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e133a203-58a1-47c6-a9bc-dc0e600170c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:59.232247 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e133a203-58a1-47c6-a9bc-dc0e600170c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:59.234146 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e133a203-58a1-47c6-a9bc-dc0e600170c3 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:59.254877 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-aceb89cd-7283-472a-b9d5-0f6a272966a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98e090a884914d20ad36f3b3c946db9e', 'request_id': 'req-aceb89cd-7283-472a-b9d5-0f6a272966a6'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:59.263417 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-aceb89cd-7283-472a-b9d5-0f6a272966a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98e090a884914d20ad36f3b3c946db9e', 'request_id': 'req-aceb89cd-7283-472a-b9d5-0f6a272966a6'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:59.265937 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1054/2103] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 20 22:24:59 2022] POST /identity/v3/projects => generated 381 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:24:59.269967 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e133a203-58a1-47c6-a9bc-dc0e600170c3 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:59.273431 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-aceb89cd-7283-472a-b9d5-0f6a272966a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98e090a884914d20ad36f3b3c946db9e', 'request_id': 'req-aceb89cd-7283-472a-b9d5-0f6a272966a6'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:59.286084 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-aceb89cd-7283-472a-b9d5-0f6a272966a6 admin admin] The token cache is being invalidate because project 98e090a884914d20ad36f3b3c946db9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81307) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 22:24:59.286383 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-aceb89cd-7283-472a-b9d5-0f6a272966a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:59.287138 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-aceb89cd-7283-472a-b9d5-0f6a272966a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:24:59.289271 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1050/2104] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 20 22:24:59 2022] DELETE /identity/v3/projects/98e090a884914d20ad36f3b3c946db9e => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 22:24:59.293627 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2ac135-4569-4c8a-93da-1663f9996c65 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:59.293901 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2ac135-4569-4c8a-93da-1663f9996c65 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:59.294175 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2ac135-4569-4c8a-93da-1663f9996c65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:59.327722 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-df2ac135-4569-4c8a-93da-1663f9996c65 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:24:59.329333 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-df2ac135-4569-4c8a-93da-1663f9996c65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:59.351494 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e133a203-58a1-47c6-a9bc-dc0e600170c3 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:59.356480 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86095873-d495-4baf-8cf5-8ed62a08a2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:59.357084 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86095873-d495-4baf-8cf5-8ed62a08a2b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:59.357370 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86095873-d495-4baf-8cf5-8ed62a08a2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:59.357638 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86095873-d495-4baf-8cf5-8ed62a08a2b6 admin admin] PATH_INFO: `/v3/users` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:59.358273 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86095873-d495-4baf-8cf5-8ed62a08a2b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:59.360225 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86095873-d495-4baf-8cf5-8ed62a08a2b6 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:59.369236 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:59.388054 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1055/2105] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 20 22:24:59 2022] POST /identity/v3/users => generated 291 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:24:59.392284 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86095873-d495-4baf-8cf5-8ed62a08a2b6 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:59.394120 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-86095873-d495-4baf-8cf5-8ed62a08a2b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:59.398462 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1051/2106] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:24:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 22:24:59.406265 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9972b0dd-1ed6-4fec-9557-902404d02c02 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:59.406586 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9972b0dd-1ed6-4fec-9557-902404d02c02 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:59.406883 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9972b0dd-1ed6-4fec-9557-902404d02c02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:59.407763 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86095873-d495-4baf-8cf5-8ed62a08a2b6 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:59.412444 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3b6cee-28fa-4581-92f0-5d6601395bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:59.413053 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b6cee-28fa-4581-92f0-5d6601395bd3 admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:59.413331 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b6cee-28fa-4581-92f0-5d6601395bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:59.413632 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b6cee-28fa-4581-92f0-5d6601395bd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:59.414556 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3b6cee-28fa-4581-92f0-5d6601395bd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:59.417793 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3b6cee-28fa-4581-92f0-5d6601395bd3 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:59.427500 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-9972b0dd-1ed6-4fec-9557-902404d02c02 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:24:59.428728 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-9972b0dd-1ed6-4fec-9557-902404d02c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:59.430683 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1056/2107] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:24:59 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 20 22:24:59.434294 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3b6cee-28fa-4581-92f0-5d6601395bd3 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:59.439220 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1052/2108] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:24:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 22:24:59.443324 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9972b0dd-1ed6-4fec-9557-902404d02c02 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:59.447005 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3b6cee-28fa-4581-92f0-5d6601395bd3 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:59.456355 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9972b0dd-1ed6-4fec-9557-902404d02c02 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:59.462039 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166eeb0e-98d6-4af9-abfa-460bc9115f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:59.462691 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166eeb0e-98d6-4af9-abfa-460bc9115f80 admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:59.463014 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166eeb0e-98d6-4af9-abfa-460bc9115f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:59.463290 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166eeb0e-98d6-4af9-abfa-460bc9115f80 admin admin] PATH_INFO: `/v3/domains` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:59.463954 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166eeb0e-98d6-4af9-abfa-460bc9115f80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:24:59.464256 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166eeb0e-98d6-4af9-abfa-460bc9115f80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:59.466082 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166eeb0e-98d6-4af9-abfa-460bc9115f80 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:59.469480 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6291923d-603c-44d5-9789-952c1a75a1af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:59.469480 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6291923d-603c-44d5-9789-952c1a75a1af admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:59.471645 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6291923d-603c-44d5-9789-952c1a75a1af admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:59.472013 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6291923d-603c-44d5-9789-952c1a75a1af admin admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:59.472762 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6291923d-603c-44d5-9789-952c1a75a1af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:59.476878 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6291923d-603c-44d5-9789-952c1a75a1af admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:59.479917 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1053/2109] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 20 22:24:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 22:24:59.489538 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166eeb0e-98d6-4af9-abfa-460bc9115f80 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:59.495568 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1057/2110] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:24:59 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 20 22:24:59.499791 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6291923d-603c-44d5-9789-952c1a75a1af admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:59.503011 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166eeb0e-98d6-4af9-abfa-460bc9115f80 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:59.510062 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2e6b60-5b6f-4f22-b8bb-12331a296a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:59.510755 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2e6b60-5b6f-4f22-b8bb-12331a296a99 admin admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:59.511108 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2e6b60-5b6f-4f22-b8bb-12331a296a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:59.511490 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2e6b60-5b6f-4f22-b8bb-12331a296a99 admin admin] PATH_INFO: `/v3/projects` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:59.512152 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2e6b60-5b6f-4f22-b8bb-12331a296a99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:59.514126 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2e6b60-5b6f-4f22-b8bb-12331a296a99 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:59.524930 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6291923d-603c-44d5-9789-952c1a75a1af admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:59.548482 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d1656c-51e6-490e-b609-7aec94c4663a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:59.550325 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d1656c-51e6-490e-b609-7aec94c4663a admin admin] REQUEST_METHOD: `PUT` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:59.550325 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d1656c-51e6-490e-b609-7aec94c4663a admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:59.550325 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d1656c-51e6-490e-b609-7aec94c4663a admin admin] PATH_INFO: `/v3/projects/c6a6d404f3604f7dbedfd18d2d1879c9/users/e13ee13e81ef4b718e0900afc2e4ebf2/roles/604444e7ad0d437dbd1f5a6e02b761f5` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:59.569301 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1054/2111] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 20 22:24:59 2022] POST /identity/v3/projects => generated 379 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:24:59.573051 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2e6b60-5b6f-4f22-b8bb-12331a296a99 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:59.589506 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d1656c-51e6-490e-b609-7aec94c4663a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6a6d404f3604f7dbedfd18d2d1879c9, user_id=e13ee13e81ef4b718e0900afc2e4ebf2, role_id=604444e7ad0d437dbd1f5a6e02b761f5)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:59.592502 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d1656c-51e6-490e-b609-7aec94c4663a admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:59.621500 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1058/2112] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:24:59 2022] PUT /identity/v3/projects/c6a6d404f3604f7dbedfd18d2d1879c9/users/e13ee13e81ef4b718e0900afc2e4ebf2/roles/604444e7ad0d437dbd1f5a6e02b761f5 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:24:59.629479 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:24:59.632063 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4643b73a-0fb8-4c05-85e9-6baef3463e64 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:59.632580 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4643b73a-0fb8-4c05-85e9-6baef3463e64 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:59.633185 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4643b73a-0fb8-4c05-85e9-6baef3463e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:59.663678 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2e6b60-5b6f-4f22-b8bb-12331a296a99 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:59.695998 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-4643b73a-0fb8-4c05-85e9-6baef3463e64 None None] MFA Rules not processed for user `e13ee13e81ef4b718e0900afc2e4ebf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:24:59.698894 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-4643b73a-0fb8-4c05-85e9-6baef3463e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:59.787733 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb3d2c9-3eea-45f5-85e7-46570f94d8ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:59.788677 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb3d2c9-3eea-45f5-85e7-46570f94d8ae admin admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:59.789503 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb3d2c9-3eea-45f5-85e7-46570f94d8ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:59.790695 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb3d2c9-3eea-45f5-85e7-46570f94d8ae admin admin] PATH_INFO: `/v3/users` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:59.791509 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb3d2c9-3eea-45f5-85e7-46570f94d8ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:59.796954 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb3d2c9-3eea-45f5-85e7-46570f94d8ae admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:59.841498 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1059/2113] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:24:59 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:24:59.852052 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1055/2114] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 20 22:24:59 2022] POST /identity/v3/users => generated 290 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 20 22:24:59.857880 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4643b73a-0fb8-4c05-85e9-6baef3463e64 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:59.859344 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb3d2c9-3eea-45f5-85e7-46570f94d8ae admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:59.864406 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-4fb3d2c9-3eea-45f5-85e7-46570f94d8ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:24:59.873459 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4643b73a-0fb8-4c05-85e9-6baef3463e64 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:59.879184 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e41d705-9a0b-458e-9083-6a4dcb467029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:59.879786 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e41d705-9a0b-458e-9083-6a4dcb467029 admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:59.880071 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e41d705-9a0b-458e-9083-6a4dcb467029 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:59.880346 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e41d705-9a0b-458e-9083-6a4dcb467029 admin admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:59.880993 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e41d705-9a0b-458e-9083-6a4dcb467029 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:59.882613 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e41d705-9a0b-458e-9083-6a4dcb467029 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:59.895209 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1060/2115] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:24:59 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:24:59.899375 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e41d705-9a0b-458e-9083-6a4dcb467029 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:59.913059 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e41d705-9a0b-458e-9083-6a4dcb467029 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:59.933068 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cbb1af-9d6d-4275-9fb0-7297dd93ec72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:59.934041 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cbb1af-9d6d-4275-9fb0-7297dd93ec72 admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:59.935929 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cbb1af-9d6d-4275-9fb0-7297dd93ec72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:59.936376 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cbb1af-9d6d-4275-9fb0-7297dd93ec72 admin admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:59.937095 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cbb1af-9d6d-4275-9fb0-7297dd93ec72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:59.943753 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cbb1af-9d6d-4275-9fb0-7297dd93ec72 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:59.952389 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb3d2c9-3eea-45f5-85e7-46570f94d8ae admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:59.956648 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f74ca87-833e-49c1-a82f-b62a867034ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577c8b14c1f4279beac13b9ba11aba1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:59.956969 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f74ca87-833e-49c1-a82f-b62a867034ef service cinder] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:59.957249 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f74ca87-833e-49c1-a82f-b62a867034ef service cinder] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:59.957519 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f74ca87-833e-49c1-a82f-b62a867034ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:24:59.969674 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1061/2116] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:24:59 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 20 22:24:59.970586 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cbb1af-9d6d-4275-9fb0-7297dd93ec72 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:24:59.972352 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f74ca87-833e-49c1-a82f-b62a867034ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:24:59.973816 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f74ca87-833e-49c1-a82f-b62a867034ef service cinder] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:24:59.983996 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cbb1af-9d6d-4275-9fb0-7297dd93ec72 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:24:59.989897 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164310d4-ba1b-4c43-8e60-860554b3da7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:24:59.990899 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164310d4-ba1b-4c43-8e60-860554b3da7d admin admin] REQUEST_METHOD: `PUT` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:24:59.991252 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164310d4-ba1b-4c43-8e60-860554b3da7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:24:59.991605 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164310d4-ba1b-4c43-8e60-860554b3da7d admin admin] PATH_INFO: `/v3/projects/75dcd7bec6784c58b4b4cc19e9554947/users/ca00195a004e446db16f3ecb2dfe9282/roles/604444e7ad0d437dbd1f5a6e02b761f5` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:00.002549 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1056/2117] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:24:59 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:25:00.011226 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164310d4-ba1b-4c43-8e60-860554b3da7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=75dcd7bec6784c58b4b4cc19e9554947, user_id=ca00195a004e446db16f3ecb2dfe9282, role_id=604444e7ad0d437dbd1f5a6e02b761f5)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:00.013911 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164310d4-ba1b-4c43-8e60-860554b3da7d admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:00.020974 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f74ca87-833e-49c1-a82f-b62a867034ef service cinder] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:00.038302 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1062/2118] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:24:59 2022] PUT /identity/v3/projects/75dcd7bec6784c58b4b4cc19e9554947/users/ca00195a004e446db16f3ecb2dfe9282/roles/604444e7ad0d437dbd1f5a6e02b761f5 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:25:00.038926 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f74ca87-833e-49c1-a82f-b62a867034ef service cinder] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:00.043984 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fdabc2-aeea-4143-b4f0-867b3e890686 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:00.044356 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fdabc2-aeea-4143-b4f0-867b3e890686 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:00.044709 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fdabc2-aeea-4143-b4f0-867b3e890686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:00.071680 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-55fdabc2-aeea-4143-b4f0-867b3e890686 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:25:00.073146 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-55fdabc2-aeea-4143-b4f0-867b3e890686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:25:00.134974 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5775c15e-5e01-4d58-9fec-a46aa9cef915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:00.136485 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5775c15e-5e01-4d58-9fec-a46aa9cef915 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:00.136997 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5775c15e-5e01-4d58-9fec-a46aa9cef915 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:00.137462 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5775c15e-5e01-4d58-9fec-a46aa9cef915 admin admin] PATH_INFO: `/v3/users/e13ee13e81ef4b718e0900afc2e4ebf2` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:00.138879 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5775c15e-5e01-4d58-9fec-a46aa9cef915 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e13ee13e81ef4b718e0900afc2e4ebf2)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:00.141112 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5775c15e-5e01-4d58-9fec-a46aa9cef915 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:00.145783 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:25:00.178931 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:25:00.184212 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1063/2119] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:25:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:25:00.213128 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fdabc2-aeea-4143-b4f0-867b3e890686 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:00.214066 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-55fdabc2-aeea-4143-b4f0-867b3e890686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:25:00.225218 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-5775c15e-5e01-4d58-9fec-a46aa9cef915 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e13ee13e81ef4b718e0900afc2e4ebf2'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:00.240278 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-5775c15e-5e01-4d58-9fec-a46aa9cef915 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e13ee13e81ef4b718e0900afc2e4ebf2'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:00.241448 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-5775c15e-5e01-4d58-9fec-a46aa9cef915 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e13ee13e81ef4b718e0900afc2e4ebf2'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:00.242354 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-5775c15e-5e01-4d58-9fec-a46aa9cef915 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e13ee13e81ef4b718e0900afc2e4ebf2'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:00.260329 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-5775c15e-5e01-4d58-9fec-a46aa9cef915 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e13ee13e81ef4b718e0900afc2e4ebf2'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:00.304308 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1057/2120] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 20 22:25:00 2022] DELETE /identity/v3/users/e13ee13e81ef4b718e0900afc2e4ebf2 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 22:25:00.309067 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a55554-8311-402d-a41e-8510f9ffd8aa None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:00.311270 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a55554-8311-402d-a41e-8510f9ffd8aa None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:00.311925 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a55554-8311-402d-a41e-8510f9ffd8aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:00.356651 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-d8a55554-8311-402d-a41e-8510f9ffd8aa None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:25:00.357871 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-d8a55554-8311-402d-a41e-8510f9ffd8aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:25:00.361224 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fdabc2-aeea-4143-b4f0-867b3e890686 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:00.432069 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1058/2121] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:25:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:25:00.440049 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf7937a-c8fa-4810-a7a3-12ae50afba1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b0b3ca4ecd41aaba9cf8e0f91fbf54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:00.440753 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf7937a-c8fa-4810-a7a3-12ae50afba1b service neutron] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:00.441302 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf7937a-c8fa-4810-a7a3-12ae50afba1b service neutron] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:00.441588 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf7937a-c8fa-4810-a7a3-12ae50afba1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:00.442220 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a55554-8311-402d-a41e-8510f9ffd8aa None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:00.443379 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-6cf7937a-c8fa-4810-a7a3-12ae50afba1b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:25:00.443876 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-d8a55554-8311-402d-a41e-8510f9ffd8aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:25:00.458923 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a55554-8311-402d-a41e-8510f9ffd8aa None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:00.464745 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf7937a-c8fa-4810-a7a3-12ae50afba1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:00.465338 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d45cf5f-ab01-41ea-bee5-052ff690751e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b0b3ca4ecd41aaba9cf8e0f91fbf54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:00.466322 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d45cf5f-ab01-41ea-bee5-052ff690751e service neutron] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:00.466933 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf7937a-c8fa-4810-a7a3-12ae50afba1b service neutron] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:00.467233 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d45cf5f-ab01-41ea-bee5-052ff690751e service neutron] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:00.468360 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d45cf5f-ab01-41ea-bee5-052ff690751e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:00.481609 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1064/2122] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:25:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:25:00.483672 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d45cf5f-ab01-41ea-bee5-052ff690751e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:00.485195 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d45cf5f-ab01-41ea-bee5-052ff690751e service neutron] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:00.501942 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1059/2123] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:25:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 20 22:25:00.840928 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf7937a-c8fa-4810-a7a3-12ae50afba1b service neutron] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:00.842537 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-6cf7937a-c8fa-4810-a7a3-12ae50afba1b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:25:00.876076 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf7937a-c8fa-4810-a7a3-12ae50afba1b service neutron] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:00.882433 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed648ee-a8c7-43b2-9a13-3277b888b36d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:00.883189 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed648ee-a8c7-43b2-9a13-3277b888b36d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:00.883571 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed648ee-a8c7-43b2-9a13-3277b888b36d admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:00.884608 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed648ee-a8c7-43b2-9a13-3277b888b36d admin admin] PATH_INFO: `/v3/projects/c6a6d404f3604f7dbedfd18d2d1879c9` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:00.885943 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed648ee-a8c7-43b2-9a13-3277b888b36d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6a6d404f3604f7dbedfd18d2d1879c9)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:00.888194 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed648ee-a8c7-43b2-9a13-3277b888b36d admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:00.984130 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-6ed648ee-a8c7-43b2-9a13-3277b888b36d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6a6d404f3604f7dbedfd18d2d1879c9', 'request_id': 'req-6ed648ee-a8c7-43b2-9a13-3277b888b36d'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:00.996076 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-6ed648ee-a8c7-43b2-9a13-3277b888b36d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6a6d404f3604f7dbedfd18d2d1879c9', 'request_id': 'req-6ed648ee-a8c7-43b2-9a13-3277b888b36d'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:01.015163 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-6ed648ee-a8c7-43b2-9a13-3277b888b36d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6a6d404f3604f7dbedfd18d2d1879c9', 'request_id': 'req-6ed648ee-a8c7-43b2-9a13-3277b888b36d'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:01.036977 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-6ed648ee-a8c7-43b2-9a13-3277b888b36d admin admin] The token cache is being invalidate because project c6a6d404f3604f7dbedfd18d2d1879c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81306) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 22:25:01.037632 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-6ed648ee-a8c7-43b2-9a13-3277b888b36d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:01.039686 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-6ed648ee-a8c7-43b2-9a13-3277b888b36d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:01.045987 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1065/2124] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 20 22:25:00 2022] DELETE /identity/v3/projects/c6a6d404f3604f7dbedfd18d2d1879c9 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:25:01.046883 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb48f2fb-fcf5-4c51-aaa5-7d331542ec52 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:01.047201 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb48f2fb-fcf5-4c51-aaa5-7d331542ec52 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:01.047477 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb48f2fb-fcf5-4c51-aaa5-7d331542ec52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:01.074019 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-fb48f2fb-fcf5-4c51-aaa5-7d331542ec52 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:25:01.083526 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-fb48f2fb-fcf5-4c51-aaa5-7d331542ec52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:25:01.179713 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1060/2125] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:25:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 22:25:01.188665 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7e821a-0763-41af-95d1-1871fc1bbb67 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:01.189196 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7e821a-0763-41af-95d1-1871fc1bbb67 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:01.189480 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7e821a-0763-41af-95d1-1871fc1bbb67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:01.210361 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-6f7e821a-0763-41af-95d1-1871fc1bbb67 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:25:01.211619 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-6f7e821a-0763-41af-95d1-1871fc1bbb67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:25:01.222145 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1066/2126] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:25:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 22:25:01.226821 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb48f2fb-fcf5-4c51-aaa5-7d331542ec52 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:01.250066 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb48f2fb-fcf5-4c51-aaa5-7d331542ec52 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:01.255079 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c984e9-fb84-4457-b982-7142e67b7222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:01.255772 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c984e9-fb84-4457-b982-7142e67b7222 admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:01.256151 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c984e9-fb84-4457-b982-7142e67b7222 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:01.256494 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c984e9-fb84-4457-b982-7142e67b7222 admin admin] PATH_INFO: `/v3/domains` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:01.257636 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c984e9-fb84-4457-b982-7142e67b7222 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:25:01.258252 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c984e9-fb84-4457-b982-7142e67b7222 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:01.260182 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c984e9-fb84-4457-b982-7142e67b7222 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:01.272814 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1061/2127] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 20 22:25:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:25:01.280645 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7e821a-0763-41af-95d1-1871fc1bbb67 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:01.306414 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7e821a-0763-41af-95d1-1871fc1bbb67 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:01.308188 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5905265-f9cd-42c7-be5d-a48641ef0357 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:01.308528 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5905265-f9cd-42c7-be5d-a48641ef0357 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:01.308806 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5905265-f9cd-42c7-be5d-a48641ef0357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:01.323267 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6f6ec4-0dc2-4aea-a08e-998ce52672a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:01.324201 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6f6ec4-0dc2-4aea-a08e-998ce52672a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:01.324201 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6f6ec4-0dc2-4aea-a08e-998ce52672a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:01.324447 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6f6ec4-0dc2-4aea-a08e-998ce52672a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:01.325098 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6f6ec4-0dc2-4aea-a08e-998ce52672a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:01.328105 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6f6ec4-0dc2-4aea-a08e-998ce52672a9 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:01.343708 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:25:01.363116 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-e5905265-f9cd-42c7-be5d-a48641ef0357 None None] MFA Rules not processed for user `ca00195a004e446db16f3ecb2dfe9282`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:25:01.364931 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-e5905265-f9cd-42c7-be5d-a48641ef0357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:25:01.380691 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:25:01.393010 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1067/2128] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 20 22:25:01 2022] POST /identity/v3/projects => generated 365 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:25:01.398736 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6f6ec4-0dc2-4aea-a08e-998ce52672a9 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:01.542885 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6f6ec4-0dc2-4aea-a08e-998ce52672a9 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:01.554127 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1062/2129] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:25:01 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:25:01.558268 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16b4ad0-0f58-4dce-baca-d561b941be7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:01.558930 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16b4ad0-0f58-4dce-baca-d561b941be7a admin admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:01.559239 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16b4ad0-0f58-4dce-baca-d561b941be7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:01.559513 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16b4ad0-0f58-4dce-baca-d561b941be7a admin admin] PATH_INFO: `/v3/users` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:01.560783 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16b4ad0-0f58-4dce-baca-d561b941be7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:01.563402 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16b4ad0-0f58-4dce-baca-d561b941be7a admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:01.586140 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5905265-f9cd-42c7-be5d-a48641ef0357 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:01.589082 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-e5905265-f9cd-42c7-be5d-a48641ef0357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:25:01.640744 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1068/2130] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 20 22:25:01 2022] POST /identity/v3/users => generated 283 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:25:01.644261 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16b4ad0-0f58-4dce-baca-d561b941be7a admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:01.662557 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16b4ad0-0f58-4dce-baca-d561b941be7a admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:01.676148 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a837c940-8ede-4673-bd46-eae72aa123df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:01.676770 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a837c940-8ede-4673-bd46-eae72aa123df admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:01.677048 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a837c940-8ede-4673-bd46-eae72aa123df admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:01.677319 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a837c940-8ede-4673-bd46-eae72aa123df admin admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:01.678021 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a837c940-8ede-4673-bd46-eae72aa123df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:01.680027 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a837c940-8ede-4673-bd46-eae72aa123df admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:01.704256 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1069/2131] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:25:01 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:25:01.705176 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a837c940-8ede-4673-bd46-eae72aa123df admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:01.721793 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a837c940-8ede-4673-bd46-eae72aa123df admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:01.730415 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179a9349-803f-4f0e-b7da-e37edaf7d1e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:01.731113 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179a9349-803f-4f0e-b7da-e37edaf7d1e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:01.731691 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179a9349-803f-4f0e-b7da-e37edaf7d1e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:01.731691 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179a9349-803f-4f0e-b7da-e37edaf7d1e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:01.732426 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179a9349-803f-4f0e-b7da-e37edaf7d1e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:01.734239 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179a9349-803f-4f0e-b7da-e37edaf7d1e8 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:01.743349 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5905265-f9cd-42c7-be5d-a48641ef0357 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:01.751876 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1070/2132] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:25:01 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:25:01.752944 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179a9349-803f-4f0e-b7da-e37edaf7d1e8 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:01.764536 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179a9349-803f-4f0e-b7da-e37edaf7d1e8 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:01.773652 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f273560-6683-4d89-9079-0d6608a12bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:01.775228 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f273560-6683-4d89-9079-0d6608a12bde admin admin] REQUEST_METHOD: `PUT` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:01.775640 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f273560-6683-4d89-9079-0d6608a12bde admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:01.775919 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f273560-6683-4d89-9079-0d6608a12bde admin admin] PATH_INFO: `/v3/projects/1e43c9ec13704a37937f62398caa1865/users/30291153e5b1484fb19595a8824d8ad2/roles/604444e7ad0d437dbd1f5a6e02b761f5` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:01.796045 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f273560-6683-4d89-9079-0d6608a12bde admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e43c9ec13704a37937f62398caa1865, user_id=30291153e5b1484fb19595a8824d8ad2, role_id=604444e7ad0d437dbd1f5a6e02b761f5)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:01.798466 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f273560-6683-4d89-9079-0d6608a12bde admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:01.812404 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8793ea4b-91e7-4177-af52-3266fee4c9d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577c8b14c1f4279beac13b9ba11aba1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:01.812895 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1071/2133] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:25:01 2022] PUT /identity/v3/projects/1e43c9ec13704a37937f62398caa1865/users/30291153e5b1484fb19595a8824d8ad2/roles/604444e7ad0d437dbd1f5a6e02b761f5 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:25:01.822390 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8793ea4b-91e7-4177-af52-3266fee4c9d4 service cinder] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:01.822390 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8793ea4b-91e7-4177-af52-3266fee4c9d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:01.822390 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8793ea4b-91e7-4177-af52-3266fee4c9d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:01.825559 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f60e7b8-2de4-4492-8923-a7146839aa07 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:01.825957 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f60e7b8-2de4-4492-8923-a7146839aa07 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:01.826325 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f60e7b8-2de4-4492-8923-a7146839aa07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:01.858281 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-3f60e7b8-2de4-4492-8923-a7146839aa07 None None] MFA Rules not processed for user `30291153e5b1484fb19595a8824d8ad2`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:25:01.859662 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-3f60e7b8-2de4-4492-8923-a7146839aa07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:25:01.890037 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8793ea4b-91e7-4177-af52-3266fee4c9d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:01.891552 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8793ea4b-91e7-4177-af52-3266fee4c9d4 service cinder] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:01.903409 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1063/2134] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:25:01 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:25:01.939981 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1072/2135] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:25:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 22:25:01.954234 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8793ea4b-91e7-4177-af52-3266fee4c9d4 service cinder] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:01.955924 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-8793ea4b-91e7-4177-af52-3266fee4c9d4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:25:01.973098 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:25:02.047352 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8793ea4b-91e7-4177-af52-3266fee4c9d4 service cinder] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:02.103261 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6717726-d6d0-44df-9e1d-8bead7058426 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbecfbbf24fd425ca99499fd44d8c7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:02.103868 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6717726-d6d0-44df-9e1d-8bead7058426 service glance] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:02.104143 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6717726-d6d0-44df-9e1d-8bead7058426 service glance] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:02.104407 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6717726-d6d0-44df-9e1d-8bead7058426 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:02.114325 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6717726-d6d0-44df-9e1d-8bead7058426 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:02.115444 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6717726-d6d0-44df-9e1d-8bead7058426 service glance] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:02.125929 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1064/2136] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:25:01 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:25:03.300553 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49a3234-05d3-454a-9d79-8852def0eaea None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:03.300996 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49a3234-05d3-454a-9d79-8852def0eaea None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:03.301142 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49a3234-05d3-454a-9d79-8852def0eaea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:03.321966 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-f49a3234-05d3-454a-9d79-8852def0eaea None None] MFA Rules not processed for user `ca00195a004e446db16f3ecb2dfe9282`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:25:03.323136 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-f49a3234-05d3-454a-9d79-8852def0eaea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:25:03.365812 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:25:03.394849 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1073/2137] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:25:03 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:25:04.165785 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6717726-d6d0-44df-9e1d-8bead7058426 service glance] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:04.167612 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-e6717726-d6d0-44df-9e1d-8bead7058426 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:25:04.244774 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6717726-d6d0-44df-9e1d-8bead7058426 service glance] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:04.250802 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d553e56-ede4-42ef-ad21-052dea57197c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:04.252946 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d553e56-ede4-42ef-ad21-052dea57197c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:04.253231 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d553e56-ede4-42ef-ad21-052dea57197c admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:04.253536 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d553e56-ede4-42ef-ad21-052dea57197c admin admin] PATH_INFO: `/v3/users/5009c18a63724d33b7bcac04a1534b2e` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:04.254950 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d553e56-ede4-42ef-ad21-052dea57197c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5009c18a63724d33b7bcac04a1534b2e)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:04.257025 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d553e56-ede4-42ef-ad21-052dea57197c admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:04.337417 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-0d553e56-ede4-42ef-ad21-052dea57197c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5009c18a63724d33b7bcac04a1534b2e'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:04.343062 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:25:04.348161 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-0d553e56-ede4-42ef-ad21-052dea57197c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5009c18a63724d33b7bcac04a1534b2e'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:04.349010 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-0d553e56-ede4-42ef-ad21-052dea57197c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5009c18a63724d33b7bcac04a1534b2e'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:04.349775 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-0d553e56-ede4-42ef-ad21-052dea57197c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5009c18a63724d33b7bcac04a1534b2e'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:04.359336 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-0d553e56-ede4-42ef-ad21-052dea57197c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5009c18a63724d33b7bcac04a1534b2e'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:04.387100 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1065/2138] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 20 22:25:04 2022] DELETE /identity/v3/users/5009c18a63724d33b7bcac04a1534b2e => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 22:25:04.389114 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0271763-39af-487a-b7e1-ef9c482a8fa5 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:04.389784 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0271763-39af-487a-b7e1-ef9c482a8fa5 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:04.390148 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0271763-39af-487a-b7e1-ef9c482a8fa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:04.409978 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-f0271763-39af-487a-b7e1-ef9c482a8fa5 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:25:04.411247 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-f0271763-39af-487a-b7e1-ef9c482a8fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:25:04.487839 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1074/2139] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:25:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:25:04.498005 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d553e56-ede4-42ef-ad21-052dea57197c admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:04.499839 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-0d553e56-ede4-42ef-ad21-052dea57197c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:25:04.568875 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d553e56-ede4-42ef-ad21-052dea57197c admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:04.573199 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7147c5a4-a728-4cd7-92fd-9781266da7f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b0b3ca4ecd41aaba9cf8e0f91fbf54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:04.573963 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7147c5a4-a728-4cd7-92fd-9781266da7f3 service neutron] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:04.574249 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7147c5a4-a728-4cd7-92fd-9781266da7f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:04.574545 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7147c5a4-a728-4cd7-92fd-9781266da7f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:04.585200 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7147c5a4-a728-4cd7-92fd-9781266da7f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:04.586792 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7147c5a4-a728-4cd7-92fd-9781266da7f3 service neutron] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:04.598491 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1066/2140] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:25:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:25:04.981688 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0271763-39af-487a-b7e1-ef9c482a8fa5 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:04.983406 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-f0271763-39af-487a-b7e1-ef9c482a8fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:25:05.006500 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0271763-39af-487a-b7e1-ef9c482a8fa5 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:05.015734 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ef7818-60a7-4bf3-8c5e-5c1688b1f396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:05.016681 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ef7818-60a7-4bf3-8c5e-5c1688b1f396 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:05.017011 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ef7818-60a7-4bf3-8c5e-5c1688b1f396 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:05.017339 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ef7818-60a7-4bf3-8c5e-5c1688b1f396 admin admin] PATH_INFO: `/v3/projects/3e5e118aef2849169e40a89692818216` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:05.018679 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ef7818-60a7-4bf3-8c5e-5c1688b1f396 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e5e118aef2849169e40a89692818216)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:05.021096 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ef7818-60a7-4bf3-8c5e-5c1688b1f396 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:05.090609 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-a7ef7818-60a7-4bf3-8c5e-5c1688b1f396 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e5e118aef2849169e40a89692818216', 'request_id': 'req-a7ef7818-60a7-4bf3-8c5e-5c1688b1f396'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:05.097975 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-a7ef7818-60a7-4bf3-8c5e-5c1688b1f396 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e5e118aef2849169e40a89692818216', 'request_id': 'req-a7ef7818-60a7-4bf3-8c5e-5c1688b1f396'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:05.106977 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-a7ef7818-60a7-4bf3-8c5e-5c1688b1f396 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e5e118aef2849169e40a89692818216', 'request_id': 'req-a7ef7818-60a7-4bf3-8c5e-5c1688b1f396'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:05.125212 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-a7ef7818-60a7-4bf3-8c5e-5c1688b1f396 admin admin] The token cache is being invalidate because project 3e5e118aef2849169e40a89692818216 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81306) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 22:25:05.138535 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-a7ef7818-60a7-4bf3-8c5e-5c1688b1f396 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:05.138535 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-a7ef7818-60a7-4bf3-8c5e-5c1688b1f396 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:05.138535 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1075/2141] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 20 22:25:04 2022] DELETE /identity/v3/projects/3e5e118aef2849169e40a89692818216 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 22:25:05.138965 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d5da7e-d081-4786-8d61-99d05322caa3 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:05.138965 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d5da7e-d081-4786-8d61-99d05322caa3 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:05.138965 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d5da7e-d081-4786-8d61-99d05322caa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:05.156260 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-23d5da7e-d081-4786-8d61-99d05322caa3 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:25:05.157564 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-23d5da7e-d081-4786-8d61-99d05322caa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:25:05.221940 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1067/2142] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:25:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:25:05.231332 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d1dbb9-fe3b-4a28-b106-596bfd9859e5 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:05.231762 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d1dbb9-fe3b-4a28-b106-596bfd9859e5 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:05.232154 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d1dbb9-fe3b-4a28-b106-596bfd9859e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:05.252779 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-06d1dbb9-fe3b-4a28-b106-596bfd9859e5 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:25:05.253988 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-06d1dbb9-fe3b-4a28-b106-596bfd9859e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:25:05.262468 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1076/2143] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:25:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:25:05.266721 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d5da7e-d081-4786-8d61-99d05322caa3 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:05.276817 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d5da7e-d081-4786-8d61-99d05322caa3 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:05.282064 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de083250-4eb7-4fe1-a52f-a0430118dfca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:05.282709 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de083250-4eb7-4fe1-a52f-a0430118dfca admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:05.282987 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de083250-4eb7-4fe1-a52f-a0430118dfca admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:05.283256 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de083250-4eb7-4fe1-a52f-a0430118dfca admin admin] PATH_INFO: `/v3/domains` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:05.283906 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de083250-4eb7-4fe1-a52f-a0430118dfca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:25:05.284210 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de083250-4eb7-4fe1-a52f-a0430118dfca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:05.285801 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de083250-4eb7-4fe1-a52f-a0430118dfca admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:05.302029 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1068/2144] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 20 22:25:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:25:05.303519 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d1dbb9-fe3b-4a28-b106-596bfd9859e5 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:05.316065 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d1dbb9-fe3b-4a28-b106-596bfd9859e5 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:05.320926 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad51ceaf-5631-4d87-8a64-c1e8b24a662e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:05.321709 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad51ceaf-5631-4d87-8a64-c1e8b24a662e admin admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:05.322081 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad51ceaf-5631-4d87-8a64-c1e8b24a662e admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:05.322465 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad51ceaf-5631-4d87-8a64-c1e8b24a662e admin admin] PATH_INFO: `/v3/projects` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:05.323314 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad51ceaf-5631-4d87-8a64-c1e8b24a662e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:05.325295 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad51ceaf-5631-4d87-8a64-c1e8b24a662e admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:05.354126 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1077/2145] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 20 22:25:05 2022] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:25:05.358658 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de083250-4eb7-4fe1-a52f-a0430118dfca admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:05.371226 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de083250-4eb7-4fe1-a52f-a0430118dfca admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:05.438117 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c93f66-8165-4121-b939-f3eb39a326c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:05.438755 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c93f66-8165-4121-b939-f3eb39a326c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:05.439066 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c93f66-8165-4121-b939-f3eb39a326c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:05.439341 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c93f66-8165-4121-b939-f3eb39a326c4 admin admin] PATH_INFO: `/v3/users` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:05.439983 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c93f66-8165-4121-b939-f3eb39a326c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:05.441898 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c93f66-8165-4121-b939-f3eb39a326c4 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:05.451202 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:25:05.469484 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1069/2146] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 20 22:25:05 2022] POST /identity/v3/users => generated 292 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:25:05.473318 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad51ceaf-5631-4d87-8a64-c1e8b24a662e admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:05.489203 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad51ceaf-5631-4d87-8a64-c1e8b24a662e admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:05.495463 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e3e483-6cf1-45ec-b81e-75d54acfc941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:05.496641 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e3e483-6cf1-45ec-b81e-75d54acfc941 admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:05.497016 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e3e483-6cf1-45ec-b81e-75d54acfc941 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:05.497492 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e3e483-6cf1-45ec-b81e-75d54acfc941 admin admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:05.498398 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e3e483-6cf1-45ec-b81e-75d54acfc941 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:05.500368 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e3e483-6cf1-45ec-b81e-75d54acfc941 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:05.514750 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1078/2147] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:25:05 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:25:05.518670 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c93f66-8165-4121-b939-f3eb39a326c4 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:05.535022 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c93f66-8165-4121-b939-f3eb39a326c4 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:05.540030 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf6972d-3a5f-4f41-95af-6a2148b48caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:05.540714 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf6972d-3a5f-4f41-95af-6a2148b48caa admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:05.541065 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf6972d-3a5f-4f41-95af-6a2148b48caa admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:05.541401 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf6972d-3a5f-4f41-95af-6a2148b48caa admin admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:05.542115 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf6972d-3a5f-4f41-95af-6a2148b48caa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:05.543869 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf6972d-3a5f-4f41-95af-6a2148b48caa admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:05.555566 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1070/2148] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:25:05 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 20 22:25:05.561343 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e3e483-6cf1-45ec-b81e-75d54acfc941 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:05.575460 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e3e483-6cf1-45ec-b81e-75d54acfc941 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:05.581909 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f612a0e1-b8d3-4755-8b22-2c32179d8ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:05.582897 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f612a0e1-b8d3-4755-8b22-2c32179d8ba9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:05.583366 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f612a0e1-b8d3-4755-8b22-2c32179d8ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:05.583646 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f612a0e1-b8d3-4755-8b22-2c32179d8ba9 admin admin] PATH_INFO: `/v3/projects/af87c66406b9497f8db6eea6216de9ef/users/4bb4cafda9114c8db55b1a1b544fa0d4/roles/604444e7ad0d437dbd1f5a6e02b761f5` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:05.605381 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f612a0e1-b8d3-4755-8b22-2c32179d8ba9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af87c66406b9497f8db6eea6216de9ef, user_id=4bb4cafda9114c8db55b1a1b544fa0d4, role_id=604444e7ad0d437dbd1f5a6e02b761f5)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:05.617806 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f612a0e1-b8d3-4755-8b22-2c32179d8ba9 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:05.624252 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:25:05.634409 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1079/2149] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:25:05 2022] PUT /identity/v3/projects/af87c66406b9497f8db6eea6216de9ef/users/4bb4cafda9114c8db55b1a1b544fa0d4/roles/604444e7ad0d437dbd1f5a6e02b761f5 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:25:05.645364 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c947a-8f32-44d1-a3c7-7c51849bec0f None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:05.645670 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c947a-8f32-44d1-a3c7-7c51849bec0f None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:05.645941 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c947a-8f32-44d1-a3c7-7c51849bec0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:05.677358 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-8a7c947a-8f32-44d1-a3c7-7c51849bec0f None None] MFA Rules not processed for user `4bb4cafda9114c8db55b1a1b544fa0d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:25:05.678953 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-8a7c947a-8f32-44d1-a3c7-7c51849bec0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:25:05.757741 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1071/2150] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:25:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:25:05.763856 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f612a0e1-b8d3-4755-8b22-2c32179d8ba9 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:05.872955 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f612a0e1-b8d3-4755-8b22-2c32179d8ba9 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:05.878116 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d668a1-8f56-491b-9800-b9fc59da66eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:05.878694 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d668a1-8f56-491b-9800-b9fc59da66eb admin admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:05.878975 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d668a1-8f56-491b-9800-b9fc59da66eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:05.879247 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d668a1-8f56-491b-9800-b9fc59da66eb admin admin] PATH_INFO: `/v3/projects` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:05.879902 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d668a1-8f56-491b-9800-b9fc59da66eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:05.881805 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d668a1-8f56-491b-9800-b9fc59da66eb admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:05.910164 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1080/2151] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 20 22:25:05 2022] POST /identity/v3/projects => generated 385 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:25:05.914431 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7c947a-8f32-44d1-a3c7-7c51849bec0f None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:05.925507 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7c947a-8f32-44d1-a3c7-7c51849bec0f None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:05.983397 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01fdd92-2ba8-4a33-a33d-a7bd2ebbaee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:05.984003 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01fdd92-2ba8-4a33-a33d-a7bd2ebbaee8 admin admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:05.984281 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01fdd92-2ba8-4a33-a33d-a7bd2ebbaee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:05.984552 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01fdd92-2ba8-4a33-a33d-a7bd2ebbaee8 admin admin] PATH_INFO: `/v3/users` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:05.985180 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01fdd92-2ba8-4a33-a33d-a7bd2ebbaee8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:05.987142 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01fdd92-2ba8-4a33-a33d-a7bd2ebbaee8 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:06.009500 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1072/2152] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 20 22:25:05 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:25:06.013507 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d668a1-8f56-491b-9800-b9fc59da66eb admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:06.024483 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d668a1-8f56-491b-9800-b9fc59da66eb admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:06.029316 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31c4ae5-19b0-456c-aff5-2a7959b51095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:06.029922 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c4ae5-19b0-456c-aff5-2a7959b51095 admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:06.030345 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c4ae5-19b0-456c-aff5-2a7959b51095 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:06.030758 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c4ae5-19b0-456c-aff5-2a7959b51095 admin admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:06.036484 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31c4ae5-19b0-456c-aff5-2a7959b51095 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:06.036484 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31c4ae5-19b0-456c-aff5-2a7959b51095 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:06.046551 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1081/2153] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:25:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:25:06.050026 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01fdd92-2ba8-4a33-a33d-a7bd2ebbaee8 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:06.061279 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01fdd92-2ba8-4a33-a33d-a7bd2ebbaee8 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:06.067882 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b9e445-8eb1-4ac9-b715-b21f606aeb90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:06.068094 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b9e445-8eb1-4ac9-b715-b21f606aeb90 admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:06.068268 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b9e445-8eb1-4ac9-b715-b21f606aeb90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:06.068602 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b9e445-8eb1-4ac9-b715-b21f606aeb90 admin admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:06.069261 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b9e445-8eb1-4ac9-b715-b21f606aeb90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:06.071145 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b9e445-8eb1-4ac9-b715-b21f606aeb90 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:06.083038 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1073/2154] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:25:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 20 22:25:06.087598 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31c4ae5-19b0-456c-aff5-2a7959b51095 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:06.097643 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31c4ae5-19b0-456c-aff5-2a7959b51095 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:06.102140 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3630b70-e9ef-490a-898b-b7d2620981b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:06.102871 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3630b70-e9ef-490a-898b-b7d2620981b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:06.103144 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3630b70-e9ef-490a-898b-b7d2620981b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:06.103411 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3630b70-e9ef-490a-898b-b7d2620981b5 admin admin] PATH_INFO: `/v3/projects/354dd95ad3554fdab00a2fbdc3fe8a52/users/c83d3334f21d4151b0b50405abfae16a/roles/604444e7ad0d437dbd1f5a6e02b761f5` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:06.121806 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3630b70-e9ef-490a-898b-b7d2620981b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=354dd95ad3554fdab00a2fbdc3fe8a52, user_id=c83d3334f21d4151b0b50405abfae16a, role_id=604444e7ad0d437dbd1f5a6e02b761f5)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:06.124441 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3630b70-e9ef-490a-898b-b7d2620981b5 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:06.139072 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1082/2155] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:25:06 2022] PUT /identity/v3/projects/354dd95ad3554fdab00a2fbdc3fe8a52/users/c83d3334f21d4151b0b50405abfae16a/roles/604444e7ad0d437dbd1f5a6e02b761f5 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 22:25:06.151298 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7537d5-f08e-43c6-92f4-085d98f0c10b None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:06.151298 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7537d5-f08e-43c6-92f4-085d98f0c10b None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:06.151298 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7537d5-f08e-43c6-92f4-085d98f0c10b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:06.182015 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-bb7537d5-f08e-43c6-92f4-085d98f0c10b None None] MFA Rules not processed for user `c83d3334f21d4151b0b50405abfae16a`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:25:06.184250 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-bb7537d5-f08e-43c6-92f4-085d98f0c10b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:25:06.225385 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:25:06.275960 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1074/2156] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:25:06 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:25:06.280490 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3630b70-e9ef-490a-898b-b7d2620981b5 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:06.347361 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3630b70-e9ef-490a-898b-b7d2620981b5 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:06.356122 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a30d03-8879-4dea-a77a-6347d8ad452a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:06.356969 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a30d03-8879-4dea-a77a-6347d8ad452a admin admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:06.357246 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a30d03-8879-4dea-a77a-6347d8ad452a admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:06.357511 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a30d03-8879-4dea-a77a-6347d8ad452a admin admin] PATH_INFO: `/v3/projects` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:06.358151 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a30d03-8879-4dea-a77a-6347d8ad452a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:06.360089 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a30d03-8879-4dea-a77a-6347d8ad452a admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:06.389739 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1083/2157] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 20 22:25:06 2022] POST /identity/v3/projects => generated 383 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:25:06.393720 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7537d5-f08e-43c6-92f4-085d98f0c10b None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:06.404731 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7537d5-f08e-43c6-92f4-085d98f0c10b None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:06.468166 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce481d47-8e41-4161-8f48-aa365ae2bbfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:06.469132 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce481d47-8e41-4161-8f48-aa365ae2bbfd admin admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:06.469569 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce481d47-8e41-4161-8f48-aa365ae2bbfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:06.469842 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce481d47-8e41-4161-8f48-aa365ae2bbfd admin admin] PATH_INFO: `/v3/users` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:06.470533 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce481d47-8e41-4161-8f48-aa365ae2bbfd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:06.472551 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce481d47-8e41-4161-8f48-aa365ae2bbfd admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:06.500352 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1075/2158] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 20 22:25:06 2022] POST /identity/v3/users => generated 298 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:25:06.501646 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a30d03-8879-4dea-a77a-6347d8ad452a admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:06.513215 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a30d03-8879-4dea-a77a-6347d8ad452a admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:06.518461 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5685b792-1ac8-47e3-90da-e74dfed82e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:06.519381 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5685b792-1ac8-47e3-90da-e74dfed82e46 admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:06.519721 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5685b792-1ac8-47e3-90da-e74dfed82e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:06.520062 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5685b792-1ac8-47e3-90da-e74dfed82e46 admin admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:06.520809 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5685b792-1ac8-47e3-90da-e74dfed82e46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:06.523395 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5685b792-1ac8-47e3-90da-e74dfed82e46 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:06.538583 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1084/2159] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:25:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:25:06.540375 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce481d47-8e41-4161-8f48-aa365ae2bbfd admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:06.551233 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce481d47-8e41-4161-8f48-aa365ae2bbfd admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:06.556480 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e0be90-5d51-46de-ab57-83c5002a5289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:06.557151 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e0be90-5d51-46de-ab57-83c5002a5289 admin admin] REQUEST_METHOD: `PUT` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:06.557462 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e0be90-5d51-46de-ab57-83c5002a5289 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:06.557735 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e0be90-5d51-46de-ab57-83c5002a5289 admin admin] PATH_INFO: `/v3/projects/2d681e2ee4ae4c1697ee86e27aac3ef4/users/6bbf342ab47a464db851a12ae71e734b/roles/8a829170b29d42d6af589399e51edb0f` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:06.574301 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e0be90-5d51-46de-ab57-83c5002a5289 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d681e2ee4ae4c1697ee86e27aac3ef4, user_id=6bbf342ab47a464db851a12ae71e734b, role_id=8a829170b29d42d6af589399e51edb0f)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:06.577008 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e0be90-5d51-46de-ab57-83c5002a5289 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:06.591404 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1076/2160] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:25:06 2022] PUT /identity/v3/projects/2d681e2ee4ae4c1697ee86e27aac3ef4/users/6bbf342ab47a464db851a12ae71e734b/roles/8a829170b29d42d6af589399e51edb0f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:25:06.595854 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5685b792-1ac8-47e3-90da-e74dfed82e46 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:06.606858 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5685b792-1ac8-47e3-90da-e74dfed82e46 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:06.626258 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:25:06.667970 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ec47a8-ed2e-4944-b600-b8ca86edac86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:06.668483 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ec47a8-ed2e-4944-b600-b8ca86edac86 admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:06.668761 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ec47a8-ed2e-4944-b600-b8ca86edac86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:06.669039 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ec47a8-ed2e-4944-b600-b8ca86edac86 admin admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:06.669670 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ec47a8-ed2e-4944-b600-b8ca86edac86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:06.671573 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ec47a8-ed2e-4944-b600-b8ca86edac86 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:06.685357 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1085/2161] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:25:06 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:25:06.692070 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e0be90-5d51-46de-ab57-83c5002a5289 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:06.719598 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e0be90-5d51-46de-ab57-83c5002a5289 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:06.733052 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25ba432-8161-4905-9a77-ef2f679d5c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:06.733745 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25ba432-8161-4905-9a77-ef2f679d5c78 admin admin] REQUEST_METHOD: `PUT` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:06.734023 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25ba432-8161-4905-9a77-ef2f679d5c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:06.734293 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25ba432-8161-4905-9a77-ef2f679d5c78 admin admin] PATH_INFO: `/v3/projects/2d681e2ee4ae4c1697ee86e27aac3ef4/users/6bbf342ab47a464db851a12ae71e734b/roles/8a829170b29d42d6af589399e51edb0f` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:06.739875 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25ba432-8161-4905-9a77-ef2f679d5c78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d681e2ee4ae4c1697ee86e27aac3ef4, user_id=6bbf342ab47a464db851a12ae71e734b, role_id=8a829170b29d42d6af589399e51edb0f)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:06.742623 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25ba432-8161-4905-9a77-ef2f679d5c78 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:06.762563 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1077/2162] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:25:06 2022] PUT /identity/v3/projects/2d681e2ee4ae4c1697ee86e27aac3ef4/users/6bbf342ab47a464db851a12ae71e734b/roles/8a829170b29d42d6af589399e51edb0f => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:25:06.766227 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da7ed2-37f3-41b5-86f2-37a75d7cf5cc None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:06.766624 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da7ed2-37f3-41b5-86f2-37a75d7cf5cc None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:06.767320 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da7ed2-37f3-41b5-86f2-37a75d7cf5cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:06.831330 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-73da7ed2-37f3-41b5-86f2-37a75d7cf5cc None None] MFA Rules not processed for user `6bbf342ab47a464db851a12ae71e734b`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:25:06.837305 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-73da7ed2-37f3-41b5-86f2-37a75d7cf5cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:25:06.986929 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1086/2163] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:25:06 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:25:06.999390 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25ba432-8161-4905-9a77-ef2f679d5c78 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:07.002010 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-f25ba432-8161-4905-9a77-ef2f679d5c78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:25:07.085615 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25ba432-8161-4905-9a77-ef2f679d5c78 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:07.089931 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435b61aa-a1ba-4a23-8fb6-18278c61062e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577c8b14c1f4279beac13b9ba11aba1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:07.090569 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b61aa-a1ba-4a23-8fb6-18278c61062e service cinder] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:07.090851 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b61aa-a1ba-4a23-8fb6-18278c61062e service cinder] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:07.091120 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b61aa-a1ba-4a23-8fb6-18278c61062e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:07.142372 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:25:07.172241 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435b61aa-a1ba-4a23-8fb6-18278c61062e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:07.173621 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435b61aa-a1ba-4a23-8fb6-18278c61062e service cinder] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:07.184874 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1078/2164] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:25:06 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:25:09.128112 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73da7ed2-37f3-41b5-86f2-37a75d7cf5cc None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:09.129801 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-73da7ed2-37f3-41b5-86f2-37a75d7cf5cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:25:09.148027 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73da7ed2-37f3-41b5-86f2-37a75d7cf5cc None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:09.155018 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e42ca1-cab0-4324-acfa-acf87472eae3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577c8b14c1f4279beac13b9ba11aba1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:09.155939 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e42ca1-cab0-4324-acfa-acf87472eae3 service cinder] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:09.156211 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e42ca1-cab0-4324-acfa-acf87472eae3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:09.156483 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e42ca1-cab0-4324-acfa-acf87472eae3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:09.236546 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e42ca1-cab0-4324-acfa-acf87472eae3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:09.238088 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e42ca1-cab0-4324-acfa-acf87472eae3 service cinder] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:09.250839 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1087/2165] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:25:09 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:25:09.265990 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435b61aa-a1ba-4a23-8fb6-18278c61062e service cinder] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:09.267667 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-435b61aa-a1ba-4a23-8fb6-18278c61062e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:25:09.363722 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435b61aa-a1ba-4a23-8fb6-18278c61062e service cinder] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:09.369358 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4cb969-a92d-4c1b-a705-7782e9dfd8b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:09.370000 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4cb969-a92d-4c1b-a705-7782e9dfd8b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:09.370281 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4cb969-a92d-4c1b-a705-7782e9dfd8b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:09.370585 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4cb969-a92d-4c1b-a705-7782e9dfd8b3 admin admin] PATH_INFO: `/v3/users/738e985e59b54da6b729bc8007eb7f3d` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:09.371717 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4cb969-a92d-4c1b-a705-7782e9dfd8b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=738e985e59b54da6b729bc8007eb7f3d)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:09.374099 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4cb969-a92d-4c1b-a705-7782e9dfd8b3 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:09.432119 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-fd4cb969-a92d-4c1b-a705-7782e9dfd8b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '738e985e59b54da6b729bc8007eb7f3d'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:09.444930 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-fd4cb969-a92d-4c1b-a705-7782e9dfd8b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '738e985e59b54da6b729bc8007eb7f3d'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:09.454597 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-fd4cb969-a92d-4c1b-a705-7782e9dfd8b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '738e985e59b54da6b729bc8007eb7f3d'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:09.455548 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-fd4cb969-a92d-4c1b-a705-7782e9dfd8b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '738e985e59b54da6b729bc8007eb7f3d'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:09.471242 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-fd4cb969-a92d-4c1b-a705-7782e9dfd8b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '738e985e59b54da6b729bc8007eb7f3d'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:09.491496 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1079/2166] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 20 22:25:09 2022] DELETE /identity/v3/users/738e985e59b54da6b729bc8007eb7f3d => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:25:09.677898 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e42ca1-cab0-4324-acfa-acf87472eae3 service cinder] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:09.692192 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e42ca1-cab0-4324-acfa-acf87472eae3 service cinder] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:09.742068 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:25:09.760930 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6878bb-d5f4-436f-8dd4-aaab24fe47a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:09.761510 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6878bb-d5f4-436f-8dd4-aaab24fe47a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:09.761784 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6878bb-d5f4-436f-8dd4-aaab24fe47a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:09.762053 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6878bb-d5f4-436f-8dd4-aaab24fe47a8 admin admin] PATH_INFO: `/v3/projects/29c58350c4b045148c31235e6dddc47b` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:09.763218 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6878bb-d5f4-436f-8dd4-aaab24fe47a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29c58350c4b045148c31235e6dddc47b)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:09.765143 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6878bb-d5f4-436f-8dd4-aaab24fe47a8 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:09.811553 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-5a6878bb-d5f4-436f-8dd4-aaab24fe47a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29c58350c4b045148c31235e6dddc47b', 'request_id': 'req-5a6878bb-d5f4-436f-8dd4-aaab24fe47a8'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:09.817996 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-5a6878bb-d5f4-436f-8dd4-aaab24fe47a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29c58350c4b045148c31235e6dddc47b', 'request_id': 'req-5a6878bb-d5f4-436f-8dd4-aaab24fe47a8'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:09.826420 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-5a6878bb-d5f4-436f-8dd4-aaab24fe47a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29c58350c4b045148c31235e6dddc47b', 'request_id': 'req-5a6878bb-d5f4-436f-8dd4-aaab24fe47a8'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:09.837875 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-5a6878bb-d5f4-436f-8dd4-aaab24fe47a8 admin admin] The token cache is being invalidate because project 29c58350c4b045148c31235e6dddc47b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81306) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 22:25:09.838164 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-5a6878bb-d5f4-436f-8dd4-aaab24fe47a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:09.838820 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-5a6878bb-d5f4-436f-8dd4-aaab24fe47a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:09.840309 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1088/2167] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 20 22:25:09 2022] DELETE /identity/v3/projects/29c58350c4b045148c31235e6dddc47b => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 22:25:09.845184 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf5ed8-8e91-496f-a53a-035f3dab9236 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:09.845464 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf5ed8-8e91-496f-a53a-035f3dab9236 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:09.845752 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf5ed8-8e91-496f-a53a-035f3dab9236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:09.865428 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-97cf5ed8-8e91-496f-a53a-035f3dab9236 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:25:09.866651 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-97cf5ed8-8e91-496f-a53a-035f3dab9236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:25:09.894722 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6878bb-d5f4-436f-8dd4-aaab24fe47a8 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:09.896126 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-5a6878bb-d5f4-436f-8dd4-aaab24fe47a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:25:09.932057 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1080/2168] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:25:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:25:09.939806 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7be09-9335-44c2-8ae2-c597578653c8 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:09.940163 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7be09-9335-44c2-8ae2-c597578653c8 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:09.940646 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7be09-9335-44c2-8ae2-c597578653c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:09.950342 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:25:09.966199 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-ddc7be09-9335-44c2-8ae2-c597578653c8 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:25:09.966415 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6878bb-d5f4-436f-8dd4-aaab24fe47a8 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:09.967438 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-ddc7be09-9335-44c2-8ae2-c597578653c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:25:09.970787 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c20e83b-f449-4961-a903-5db5e9b4e64f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577c8b14c1f4279beac13b9ba11aba1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:09.971472 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c20e83b-f449-4961-a903-5db5e9b4e64f service cinder] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:09.971825 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c20e83b-f449-4961-a903-5db5e9b4e64f service cinder] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:09.972171 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c20e83b-f449-4961-a903-5db5e9b4e64f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:09.973904 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-1c20e83b-f449-4961-a903-5db5e9b4e64f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:25:09.976133 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1081/2169] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:25:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 22:25:09.980646 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc7be09-9335-44c2-8ae2-c597578653c8 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:09.991317 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc7be09-9335-44c2-8ae2-c597578653c8 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:09.996704 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c2f036-4b76-4804-85d2-0ad16115b0b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:09.997310 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c2f036-4b76-4804-85d2-0ad16115b0b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:09.997588 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c2f036-4b76-4804-85d2-0ad16115b0b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:09.997854 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c2f036-4b76-4804-85d2-0ad16115b0b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:09.998500 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c2f036-4b76-4804-85d2-0ad16115b0b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:25:09.998834 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c2f036-4b76-4804-85d2-0ad16115b0b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:10.000425 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c2f036-4b76-4804-85d2-0ad16115b0b7 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:10.016902 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1082/2170] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 20 22:25:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:25:10.021098 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c2f036-4b76-4804-85d2-0ad16115b0b7 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:10.036348 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c2f036-4b76-4804-85d2-0ad16115b0b7 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:10.042293 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0274793-60c2-4a22-ac11-0ff4790b2200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:10.043010 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0274793-60c2-4a22-ac11-0ff4790b2200 admin admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:10.043198 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0274793-60c2-4a22-ac11-0ff4790b2200 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:10.043467 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0274793-60c2-4a22-ac11-0ff4790b2200 admin admin] PATH_INFO: `/v3/projects` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:10.044096 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0274793-60c2-4a22-ac11-0ff4790b2200 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:10.046228 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0274793-60c2-4a22-ac11-0ff4790b2200 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:10.071342 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c20e83b-f449-4961-a903-5db5e9b4e64f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:10.072798 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c20e83b-f449-4961-a903-5db5e9b4e64f service cinder] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:10.076303 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1083/2171] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 20 22:25:10 2022] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:25:10.080321 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0274793-60c2-4a22-ac11-0ff4790b2200 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:10.086756 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1089/2172] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:25:09 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 20 22:25:10.149386 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0274793-60c2-4a22-ac11-0ff4790b2200 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:10.154627 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707555af-d1ca-4be0-9c49-0de1ec250489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:10.155353 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707555af-d1ca-4be0-9c49-0de1ec250489 admin admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:10.155653 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707555af-d1ca-4be0-9c49-0de1ec250489 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:10.155933 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707555af-d1ca-4be0-9c49-0de1ec250489 admin admin] PATH_INFO: `/v3/users` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:10.156571 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707555af-d1ca-4be0-9c49-0de1ec250489 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:10.161231 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707555af-d1ca-4be0-9c49-0de1ec250489 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:10.183354 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1084/2173] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 20 22:25:10 2022] POST /identity/v3/users => generated 287 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 20 22:25:10.187635 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c20e83b-f449-4961-a903-5db5e9b4e64f service cinder] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:10.199801 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c20e83b-f449-4961-a903-5db5e9b4e64f service cinder] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:10.206345 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edad7a6-c450-42d5-b941-f792cf6e5e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:10.207022 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edad7a6-c450-42d5-b941-f792cf6e5e5b admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:10.207270 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edad7a6-c450-42d5-b941-f792cf6e5e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:10.207537 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edad7a6-c450-42d5-b941-f792cf6e5e5b admin admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:10.208174 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edad7a6-c450-42d5-b941-f792cf6e5e5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:10.209922 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edad7a6-c450-42d5-b941-f792cf6e5e5b admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:10.220582 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1090/2174] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:25:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:25:10.224611 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707555af-d1ca-4be0-9c49-0de1ec250489 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:10.235355 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707555af-d1ca-4be0-9c49-0de1ec250489 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:10.239976 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4838f530-d273-4bde-b156-a22ed99f93c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:10.240570 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4838f530-d273-4bde-b156-a22ed99f93c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:10.240848 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4838f530-d273-4bde-b156-a22ed99f93c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:10.241120 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4838f530-d273-4bde-b156-a22ed99f93c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:10.241758 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4838f530-d273-4bde-b156-a22ed99f93c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:10.244013 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4838f530-d273-4bde-b156-a22ed99f93c7 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:10.253858 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1085/2175] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:25:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 20 22:25:10.257930 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edad7a6-c450-42d5-b941-f792cf6e5e5b admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:10.268059 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edad7a6-c450-42d5-b941-f792cf6e5e5b admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:10.272615 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11de4396-dbe2-4c94-86ab-9439fa2a2b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:10.273287 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11de4396-dbe2-4c94-86ab-9439fa2a2b53 admin admin] REQUEST_METHOD: `PUT` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:10.273572 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11de4396-dbe2-4c94-86ab-9439fa2a2b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:10.273849 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11de4396-dbe2-4c94-86ab-9439fa2a2b53 admin admin] PATH_INFO: `/v3/projects/759d13a799994bb69de0aa3c460ae982/users/121e2b36406449ba98dfdc565dd8c516/roles/604444e7ad0d437dbd1f5a6e02b761f5` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:10.282350 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:25:10.291261 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11de4396-dbe2-4c94-86ab-9439fa2a2b53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=759d13a799994bb69de0aa3c460ae982, user_id=121e2b36406449ba98dfdc565dd8c516, role_id=604444e7ad0d437dbd1f5a6e02b761f5)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:10.294649 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11de4396-dbe2-4c94-86ab-9439fa2a2b53 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:10.310262 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1091/2176] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:25:10 2022] PUT /identity/v3/projects/759d13a799994bb69de0aa3c460ae982/users/121e2b36406449ba98dfdc565dd8c516/roles/604444e7ad0d437dbd1f5a6e02b761f5 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 22:25:10.320374 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c42cd5-cd60-4b5d-abbc-99d0f4f4cd3e None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:10.320891 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c42cd5-cd60-4b5d-abbc-99d0f4f4cd3e None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:10.321113 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c42cd5-cd60-4b5d-abbc-99d0f4f4cd3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:10.350782 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-93c42cd5-cd60-4b5d-abbc-99d0f4f4cd3e None None] MFA Rules not processed for user `121e2b36406449ba98dfdc565dd8c516`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:25:10.351993 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-93c42cd5-cd60-4b5d-abbc-99d0f4f4cd3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:25:10.420224 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1086/2177] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:25:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:25:10.431252 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11de4396-dbe2-4c94-86ab-9439fa2a2b53 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:10.432949 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-11de4396-dbe2-4c94-86ab-9439fa2a2b53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:25:10.513300 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11de4396-dbe2-4c94-86ab-9439fa2a2b53 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:10.519062 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71345780-14bc-49eb-88de-e8e6a94003ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db7eed561e99452289a662ad326cf919', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:10.519667 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71345780-14bc-49eb-88de-e8e6a94003ea service nova] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:10.519948 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71345780-14bc-49eb-88de-e8e6a94003ea service nova] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:10.520224 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71345780-14bc-49eb-88de-e8e6a94003ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:10.528674 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71345780-14bc-49eb-88de-e8e6a94003ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:10.530256 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71345780-14bc-49eb-88de-e8e6a94003ea service nova] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:10.539271 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1092/2178] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:25:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:25:13.211272 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c42cd5-cd60-4b5d-abbc-99d0f4f4cd3e None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:13.241403 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:25:13.275087 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c42cd5-cd60-4b5d-abbc-99d0f4f4cd3e None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:13.280883 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b741d6d2-8dd6-4187-b923-54349452b604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:13.281608 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b741d6d2-8dd6-4187-b923-54349452b604 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:13.282003 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b741d6d2-8dd6-4187-b923-54349452b604 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:13.282282 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b741d6d2-8dd6-4187-b923-54349452b604 admin admin] PATH_INFO: `/v3/users/121e2b36406449ba98dfdc565dd8c516` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:13.283751 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b741d6d2-8dd6-4187-b923-54349452b604 admin admin] RBAC: Authorizing `identity:delete_user(user_id=121e2b36406449ba98dfdc565dd8c516)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:13.286017 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b741d6d2-8dd6-4187-b923-54349452b604 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:13.342157 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-b741d6d2-8dd6-4187-b923-54349452b604 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '121e2b36406449ba98dfdc565dd8c516'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:13.349542 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-b741d6d2-8dd6-4187-b923-54349452b604 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '121e2b36406449ba98dfdc565dd8c516'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:13.350177 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-b741d6d2-8dd6-4187-b923-54349452b604 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '121e2b36406449ba98dfdc565dd8c516'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:13.350812 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-b741d6d2-8dd6-4187-b923-54349452b604 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '121e2b36406449ba98dfdc565dd8c516'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:13.358489 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-b741d6d2-8dd6-4187-b923-54349452b604 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '121e2b36406449ba98dfdc565dd8c516'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:13.376987 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1087/2179] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 20 22:25:13 2022] DELETE /identity/v3/users/121e2b36406449ba98dfdc565dd8c516 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:25:13.381392 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07006971-03f8-482c-ac90-59214f02aa6d None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:13.381847 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07006971-03f8-482c-ac90-59214f02aa6d None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:13.382034 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07006971-03f8-482c-ac90-59214f02aa6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:13.404614 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-07006971-03f8-482c-ac90-59214f02aa6d None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:25:13.405826 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-07006971-03f8-482c-ac90-59214f02aa6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:25:13.468700 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1093/2180] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:25:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:25:13.475272 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b741d6d2-8dd6-4187-b923-54349452b604 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:13.476900 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-b741d6d2-8dd6-4187-b923-54349452b604 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:25:13.535612 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b741d6d2-8dd6-4187-b923-54349452b604 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:13.542542 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00977d33-2cd5-4476-a79f-45e7157389cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b0b3ca4ecd41aaba9cf8e0f91fbf54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:13.543173 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00977d33-2cd5-4476-a79f-45e7157389cd service neutron] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:13.543457 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00977d33-2cd5-4476-a79f-45e7157389cd service neutron] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:13.543734 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00977d33-2cd5-4476-a79f-45e7157389cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:13.559396 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00977d33-2cd5-4476-a79f-45e7157389cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:13.561092 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00977d33-2cd5-4476-a79f-45e7157389cd service neutron] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:13.572626 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1088/2181] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:25:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:25:13.844697 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07006971-03f8-482c-ac90-59214f02aa6d None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:13.846129 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-07006971-03f8-482c-ac90-59214f02aa6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:25:13.858133 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07006971-03f8-482c-ac90-59214f02aa6d None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:13.862913 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42367bb9-a8b5-4521-8771-ca5853a7ffd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:13.863544 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42367bb9-a8b5-4521-8771-ca5853a7ffd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:13.863831 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42367bb9-a8b5-4521-8771-ca5853a7ffd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:13.864106 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42367bb9-a8b5-4521-8771-ca5853a7ffd8 admin admin] PATH_INFO: `/v3/projects/759d13a799994bb69de0aa3c460ae982` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:13.865234 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42367bb9-a8b5-4521-8771-ca5853a7ffd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=759d13a799994bb69de0aa3c460ae982)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:13.867216 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42367bb9-a8b5-4521-8771-ca5853a7ffd8 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:13.913355 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-42367bb9-a8b5-4521-8771-ca5853a7ffd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '759d13a799994bb69de0aa3c460ae982', 'request_id': 'req-42367bb9-a8b5-4521-8771-ca5853a7ffd8'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:13.919275 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-42367bb9-a8b5-4521-8771-ca5853a7ffd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '759d13a799994bb69de0aa3c460ae982', 'request_id': 'req-42367bb9-a8b5-4521-8771-ca5853a7ffd8'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:13.926421 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-42367bb9-a8b5-4521-8771-ca5853a7ffd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '759d13a799994bb69de0aa3c460ae982', 'request_id': 'req-42367bb9-a8b5-4521-8771-ca5853a7ffd8'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:13.931286 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:25:13.938430 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-42367bb9-a8b5-4521-8771-ca5853a7ffd8 admin admin] The token cache is being invalidate because project 759d13a799994bb69de0aa3c460ae982 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81306) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 22:25:13.938982 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-42367bb9-a8b5-4521-8771-ca5853a7ffd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:13.939895 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-42367bb9-a8b5-4521-8771-ca5853a7ffd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:13.941404 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1094/2182] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 20 22:25:13 2022] DELETE /identity/v3/projects/759d13a799994bb69de0aa3c460ae982 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:25:13.946767 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7831fb3d-1349-405d-96ca-327002823bcb None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:13.947123 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7831fb3d-1349-405d-96ca-327002823bcb None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:13.947465 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7831fb3d-1349-405d-96ca-327002823bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:13.968806 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-7831fb3d-1349-405d-96ca-327002823bcb None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:25:13.970012 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-7831fb3d-1349-405d-96ca-327002823bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:25:14.025937 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42367bb9-a8b5-4521-8771-ca5853a7ffd8 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:14.027641 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-42367bb9-a8b5-4521-8771-ca5853a7ffd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:25:14.032663 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:25:14.049927 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1089/2183] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:25:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:25:14.061136 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8741b761-9ba2-49f0-8562-322ed06ade3a None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:14.061420 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8741b761-9ba2-49f0-8562-322ed06ade3a None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:14.061696 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8741b761-9ba2-49f0-8562-322ed06ade3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:14.085995 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-8741b761-9ba2-49f0-8562-322ed06ade3a None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:25:14.087833 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-8741b761-9ba2-49f0-8562-322ed06ade3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:25:14.096567 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1090/2184] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:25:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:25:14.100654 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8741b761-9ba2-49f0-8562-322ed06ade3a None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:14.110115 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42367bb9-a8b5-4521-8771-ca5853a7ffd8 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:14.111455 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8741b761-9ba2-49f0-8562-322ed06ade3a None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:14.115891 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795c49fd-f62a-4ed9-b26a-e766f8db6d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:14.116600 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795c49fd-f62a-4ed9-b26a-e766f8db6d50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:14.116908 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994b88df-bc72-42a0-be42-1880fb1441ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:14.117056 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795c49fd-f62a-4ed9-b26a-e766f8db6d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:14.117399 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795c49fd-f62a-4ed9-b26a-e766f8db6d50 admin admin] PATH_INFO: `/v3/users/4bb4cafda9114c8db55b1a1b544fa0d4` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:14.117703 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994b88df-bc72-42a0-be42-1880fb1441ea admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:14.117994 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994b88df-bc72-42a0-be42-1880fb1441ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:14.118267 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994b88df-bc72-42a0-be42-1880fb1441ea admin admin] PATH_INFO: `/v3/domains` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:14.120226 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795c49fd-f62a-4ed9-b26a-e766f8db6d50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bb4cafda9114c8db55b1a1b544fa0d4)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:14.120362 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994b88df-bc72-42a0-be42-1880fb1441ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:25:14.120362 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994b88df-bc72-42a0-be42-1880fb1441ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:14.120844 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795c49fd-f62a-4ed9-b26a-e766f8db6d50 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:14.120953 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994b88df-bc72-42a0-be42-1880fb1441ea admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:14.134138 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1091/2185] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 20 22:25:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:25:14.138996 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994b88df-bc72-42a0-be42-1880fb1441ea admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:14.153290 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994b88df-bc72-42a0-be42-1880fb1441ea admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:14.162591 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa67d52-1942-4c6c-883e-c79fe3ee1ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:14.162591 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa67d52-1942-4c6c-883e-c79fe3ee1ac1 admin admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:14.162591 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa67d52-1942-4c6c-883e-c79fe3ee1ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:14.162591 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa67d52-1942-4c6c-883e-c79fe3ee1ac1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:14.163107 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa67d52-1942-4c6c-883e-c79fe3ee1ac1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:14.165121 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa67d52-1942-4c6c-883e-c79fe3ee1ac1 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:14.189753 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-795c49fd-f62a-4ed9-b26a-e766f8db6d50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bb4cafda9114c8db55b1a1b544fa0d4'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:14.203029 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1092/2186] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 20 22:25:14 2022] POST /identity/v3/projects => generated 365 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 20 22:25:14.203201 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-795c49fd-f62a-4ed9-b26a-e766f8db6d50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bb4cafda9114c8db55b1a1b544fa0d4'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:14.203201 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-795c49fd-f62a-4ed9-b26a-e766f8db6d50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bb4cafda9114c8db55b1a1b544fa0d4'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:14.203201 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-795c49fd-f62a-4ed9-b26a-e766f8db6d50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bb4cafda9114c8db55b1a1b544fa0d4'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:14.205579 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa67d52-1942-4c6c-883e-c79fe3ee1ac1 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:14.207940 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-bfa67d52-1942-4c6c-883e-c79fe3ee1ac1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:25:14.213711 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-795c49fd-f62a-4ed9-b26a-e766f8db6d50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bb4cafda9114c8db55b1a1b544fa0d4'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:14.254625 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1095/2187] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 20 22:25:14 2022] DELETE /identity/v3/users/4bb4cafda9114c8db55b1a1b544fa0d4 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:25:14.259489 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2696bc55-a568-4b5a-8ef1-3c349ae3c9a6 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:14.259860 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2696bc55-a568-4b5a-8ef1-3c349ae3c9a6 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:14.260202 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2696bc55-a568-4b5a-8ef1-3c349ae3c9a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:14.285058 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-2696bc55-a568-4b5a-8ef1-3c349ae3c9a6 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:25:14.286534 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-2696bc55-a568-4b5a-8ef1-3c349ae3c9a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:25:14.328098 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa67d52-1942-4c6c-883e-c79fe3ee1ac1 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:14.414132 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1096/2188] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:25:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 22:25:14.425143 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2696bc55-a568-4b5a-8ef1-3c349ae3c9a6 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:14.427369 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-2696bc55-a568-4b5a-8ef1-3c349ae3c9a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:25:14.446761 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18266215-edac-4d08-83f7-5253257597ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:14.447577 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18266215-edac-4d08-83f7-5253257597ba admin admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:14.447952 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18266215-edac-4d08-83f7-5253257597ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:14.448318 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18266215-edac-4d08-83f7-5253257597ba admin admin] PATH_INFO: `/v3/users` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:14.449097 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18266215-edac-4d08-83f7-5253257597ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:14.450785 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:25:14.451870 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18266215-edac-4d08-83f7-5253257597ba admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:14.480437 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1093/2189] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 20 22:25:14 2022] POST /identity/v3/users => generated 283 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 20 22:25:14.484173 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18266215-edac-4d08-83f7-5253257597ba admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:14.494920 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18266215-edac-4d08-83f7-5253257597ba admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:14.499676 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0257e1cd-dd5d-418e-a4b4-8c1dc60f29b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:14.500283 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0257e1cd-dd5d-418e-a4b4-8c1dc60f29b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:14.500562 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0257e1cd-dd5d-418e-a4b4-8c1dc60f29b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:14.501363 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0257e1cd-dd5d-418e-a4b4-8c1dc60f29b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:14.501522 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0257e1cd-dd5d-418e-a4b4-8c1dc60f29b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:14.503087 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0257e1cd-dd5d-418e-a4b4-8c1dc60f29b4 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:14.505952 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2696bc55-a568-4b5a-8ef1-3c349ae3c9a6 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:14.510392 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82063ec6-066d-4523-8277-21d839a4c30f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b0b3ca4ecd41aaba9cf8e0f91fbf54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:14.511036 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82063ec6-066d-4523-8277-21d839a4c30f service neutron] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:14.511436 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82063ec6-066d-4523-8277-21d839a4c30f service neutron] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:14.511715 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82063ec6-066d-4523-8277-21d839a4c30f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:14.518472 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1094/2190] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:25:14 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:25:14.519500 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0257e1cd-dd5d-418e-a4b4-8c1dc60f29b4 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:14.524720 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82063ec6-066d-4523-8277-21d839a4c30f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:14.526729 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82063ec6-066d-4523-8277-21d839a4c30f service neutron] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:14.531286 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0257e1cd-dd5d-418e-a4b4-8c1dc60f29b4 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:14.536823 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44b4eb8-4f1e-4359-8800-01ea4d76b466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:14.537743 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44b4eb8-4f1e-4359-8800-01ea4d76b466 admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:14.538111 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44b4eb8-4f1e-4359-8800-01ea4d76b466 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:14.538374 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44b4eb8-4f1e-4359-8800-01ea4d76b466 admin admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:14.539198 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44b4eb8-4f1e-4359-8800-01ea4d76b466 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:14.541033 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44b4eb8-4f1e-4359-8800-01ea4d76b466 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:14.546917 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1097/2191] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:25:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 20 22:25:14.555094 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1095/2192] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:25:14 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:25:14.560054 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82063ec6-066d-4523-8277-21d839a4c30f service neutron] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:14.570380 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82063ec6-066d-4523-8277-21d839a4c30f service neutron] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:14.575835 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d51567-949b-488c-9463-87be0dfd91bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:14.576583 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d51567-949b-488c-9463-87be0dfd91bd admin admin] REQUEST_METHOD: `PUT` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:14.576977 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d51567-949b-488c-9463-87be0dfd91bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:14.577257 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d51567-949b-488c-9463-87be0dfd91bd admin admin] PATH_INFO: `/v3/projects/64fa7a9df4574b20971daf3de15931c9/users/279d5ee032354a11b2a1e7da91013276/roles/604444e7ad0d437dbd1f5a6e02b761f5` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:14.592750 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d51567-949b-488c-9463-87be0dfd91bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=64fa7a9df4574b20971daf3de15931c9, user_id=279d5ee032354a11b2a1e7da91013276, role_id=604444e7ad0d437dbd1f5a6e02b761f5)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:14.595492 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d51567-949b-488c-9463-87be0dfd91bd admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:14.610708 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1098/2193] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:25:14 2022] PUT /identity/v3/projects/64fa7a9df4574b20971daf3de15931c9/users/279d5ee032354a11b2a1e7da91013276/roles/604444e7ad0d437dbd1f5a6e02b761f5 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 22:25:14.621082 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a7597-7fc5-4c83-9f99-7d01abfeec01 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:14.621769 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a7597-7fc5-4c83-9f99-7d01abfeec01 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:14.621769 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a7597-7fc5-4c83-9f99-7d01abfeec01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:14.653991 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-682a7597-7fc5-4c83-9f99-7d01abfeec01 None None] MFA Rules not processed for user `279d5ee032354a11b2a1e7da91013276`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:25:14.655174 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-682a7597-7fc5-4c83-9f99-7d01abfeec01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:25:14.668998 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:25:14.742018 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1096/2194] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:25:14 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:25:14.754333 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d51567-949b-488c-9463-87be0dfd91bd admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:14.756600 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-91d51567-949b-488c-9463-87be0dfd91bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:25:14.844069 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d51567-949b-488c-9463-87be0dfd91bd admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:14.847896 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b608b757-9a1a-4433-b6bf-4e155a163f21 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577c8b14c1f4279beac13b9ba11aba1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:14.848505 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b608b757-9a1a-4433-b6bf-4e155a163f21 service cinder] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:14.848782 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b608b757-9a1a-4433-b6bf-4e155a163f21 service cinder] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:14.849154 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b608b757-9a1a-4433-b6bf-4e155a163f21 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:14.859079 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b608b757-9a1a-4433-b6bf-4e155a163f21 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:14.860664 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b608b757-9a1a-4433-b6bf-4e155a163f21 service cinder] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:14.871042 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1099/2195] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:25:14 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:25:14.938133 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682a7597-7fc5-4c83-9f99-7d01abfeec01 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:14.939604 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-682a7597-7fc5-4c83-9f99-7d01abfeec01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:25:15.014914 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682a7597-7fc5-4c83-9f99-7d01abfeec01 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:15.020355 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b53172a-c54a-4295-99e8-e059e58bf461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:15.020985 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b53172a-c54a-4295-99e8-e059e58bf461 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:15.021267 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b53172a-c54a-4295-99e8-e059e58bf461 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:15.021532 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b53172a-c54a-4295-99e8-e059e58bf461 admin admin] PATH_INFO: `/v3/projects/af87c66406b9497f8db6eea6216de9ef` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:15.023085 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b53172a-c54a-4295-99e8-e059e58bf461 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af87c66406b9497f8db6eea6216de9ef)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:15.027563 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b53172a-c54a-4295-99e8-e059e58bf461 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:15.083064 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-6b53172a-c54a-4295-99e8-e059e58bf461 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af87c66406b9497f8db6eea6216de9ef', 'request_id': 'req-6b53172a-c54a-4295-99e8-e059e58bf461'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:15.089994 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-6b53172a-c54a-4295-99e8-e059e58bf461 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af87c66406b9497f8db6eea6216de9ef', 'request_id': 'req-6b53172a-c54a-4295-99e8-e059e58bf461'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:15.097495 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-6b53172a-c54a-4295-99e8-e059e58bf461 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af87c66406b9497f8db6eea6216de9ef', 'request_id': 'req-6b53172a-c54a-4295-99e8-e059e58bf461'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:15.109339 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-6b53172a-c54a-4295-99e8-e059e58bf461 admin admin] The token cache is being invalidate because project af87c66406b9497f8db6eea6216de9ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81307) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 22:25:15.109634 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-6b53172a-c54a-4295-99e8-e059e58bf461 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:15.110290 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-6b53172a-c54a-4295-99e8-e059e58bf461 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:15.111998 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1097/2196] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 20 22:25:14 2022] DELETE /identity/v3/projects/af87c66406b9497f8db6eea6216de9ef => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:25:15.116328 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b608b757-9a1a-4433-b6bf-4e155a163f21 service cinder] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:15.129846 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b608b757-9a1a-4433-b6bf-4e155a163f21 service cinder] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:15.195012 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc70914-201d-4b18-8801-79276714ba53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:15.196204 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc70914-201d-4b18-8801-79276714ba53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:15.196479 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc70914-201d-4b18-8801-79276714ba53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:15.196751 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc70914-201d-4b18-8801-79276714ba53 admin admin] PATH_INFO: `/v3/users/c83d3334f21d4151b0b50405abfae16a` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:15.197910 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc70914-201d-4b18-8801-79276714ba53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c83d3334f21d4151b0b50405abfae16a)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:15.200020 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc70914-201d-4b18-8801-79276714ba53 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:15.251893 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:25:15.259467 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-dfc70914-201d-4b18-8801-79276714ba53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c83d3334f21d4151b0b50405abfae16a'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:15.266518 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-dfc70914-201d-4b18-8801-79276714ba53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c83d3334f21d4151b0b50405abfae16a'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:15.267183 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-dfc70914-201d-4b18-8801-79276714ba53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c83d3334f21d4151b0b50405abfae16a'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:15.267809 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-dfc70914-201d-4b18-8801-79276714ba53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c83d3334f21d4151b0b50405abfae16a'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:15.275982 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-dfc70914-201d-4b18-8801-79276714ba53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c83d3334f21d4151b0b50405abfae16a'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:15.293703 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1100/2197] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 20 22:25:15 2022] DELETE /identity/v3/users/c83d3334f21d4151b0b50405abfae16a => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 22:25:15.645331 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b53172a-c54a-4295-99e8-e059e58bf461 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:15.646865 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-6b53172a-c54a-4295-99e8-e059e58bf461 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:25:15.668187 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b53172a-c54a-4295-99e8-e059e58bf461 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:15.717808 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:25:15.738206 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f884506-f810-4d1d-aa7b-9f660e47d5d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:15.738909 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f884506-f810-4d1d-aa7b-9f660e47d5d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:15.739194 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f884506-f810-4d1d-aa7b-9f660e47d5d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:15.739471 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f884506-f810-4d1d-aa7b-9f660e47d5d0 admin admin] PATH_INFO: `/v3/projects/354dd95ad3554fdab00a2fbdc3fe8a52` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:15.740597 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f884506-f810-4d1d-aa7b-9f660e47d5d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=354dd95ad3554fdab00a2fbdc3fe8a52)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:15.743086 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f884506-f810-4d1d-aa7b-9f660e47d5d0 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:15.788598 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-8f884506-f810-4d1d-aa7b-9f660e47d5d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '354dd95ad3554fdab00a2fbdc3fe8a52', 'request_id': 'req-8f884506-f810-4d1d-aa7b-9f660e47d5d0'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:15.795134 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-8f884506-f810-4d1d-aa7b-9f660e47d5d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '354dd95ad3554fdab00a2fbdc3fe8a52', 'request_id': 'req-8f884506-f810-4d1d-aa7b-9f660e47d5d0'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:15.802786 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-8f884506-f810-4d1d-aa7b-9f660e47d5d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '354dd95ad3554fdab00a2fbdc3fe8a52', 'request_id': 'req-8f884506-f810-4d1d-aa7b-9f660e47d5d0'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:15.814365 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-8f884506-f810-4d1d-aa7b-9f660e47d5d0 admin admin] The token cache is being invalidate because project 354dd95ad3554fdab00a2fbdc3fe8a52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81307) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 22:25:15.814704 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-8f884506-f810-4d1d-aa7b-9f660e47d5d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:15.815347 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-8f884506-f810-4d1d-aa7b-9f660e47d5d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:15.816987 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1098/2198] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 20 22:25:15 2022] DELETE /identity/v3/projects/354dd95ad3554fdab00a2fbdc3fe8a52 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:25:15.821554 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc70914-201d-4b18-8801-79276714ba53 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:15.823076 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-dfc70914-201d-4b18-8801-79276714ba53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:25:15.836017 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc70914-201d-4b18-8801-79276714ba53 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:15.895660 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681cc493-512f-45e7-af26-750c7b3ca019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:15.896399 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681cc493-512f-45e7-af26-750c7b3ca019 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:15.896686 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681cc493-512f-45e7-af26-750c7b3ca019 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:15.896969 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681cc493-512f-45e7-af26-750c7b3ca019 admin admin] PATH_INFO: `/v3/users/6bbf342ab47a464db851a12ae71e734b` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:15.898124 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681cc493-512f-45e7-af26-750c7b3ca019 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bbf342ab47a464db851a12ae71e734b)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:15.901165 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681cc493-512f-45e7-af26-750c7b3ca019 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:15.962067 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-681cc493-512f-45e7-af26-750c7b3ca019 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bbf342ab47a464db851a12ae71e734b'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:15.971116 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-681cc493-512f-45e7-af26-750c7b3ca019 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bbf342ab47a464db851a12ae71e734b'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:15.971749 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-681cc493-512f-45e7-af26-750c7b3ca019 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bbf342ab47a464db851a12ae71e734b'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:15.972430 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-681cc493-512f-45e7-af26-750c7b3ca019 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bbf342ab47a464db851a12ae71e734b'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:15.980131 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-681cc493-512f-45e7-af26-750c7b3ca019 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bbf342ab47a464db851a12ae71e734b'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:15.997035 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1101/2199] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 20 22:25:15 2022] DELETE /identity/v3/users/6bbf342ab47a464db851a12ae71e734b => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 22:25:16.280515 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f884506-f810-4d1d-aa7b-9f660e47d5d0 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:16.282025 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-8f884506-f810-4d1d-aa7b-9f660e47d5d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:25:16.326950 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f884506-f810-4d1d-aa7b-9f660e47d5d0 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:16.399948 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87538ff1-1f72-4d03-a7c5-add763fc9d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:16.400517 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87538ff1-1f72-4d03-a7c5-add763fc9d89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:16.400796 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87538ff1-1f72-4d03-a7c5-add763fc9d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:16.401068 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87538ff1-1f72-4d03-a7c5-add763fc9d89 admin admin] PATH_INFO: `/v3/projects/2d681e2ee4ae4c1697ee86e27aac3ef4` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:16.402181 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87538ff1-1f72-4d03-a7c5-add763fc9d89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d681e2ee4ae4c1697ee86e27aac3ef4)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:16.404116 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87538ff1-1f72-4d03-a7c5-add763fc9d89 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:16.457461 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-87538ff1-1f72-4d03-a7c5-add763fc9d89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d681e2ee4ae4c1697ee86e27aac3ef4', 'request_id': 'req-87538ff1-1f72-4d03-a7c5-add763fc9d89'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:16.464157 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-87538ff1-1f72-4d03-a7c5-add763fc9d89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d681e2ee4ae4c1697ee86e27aac3ef4', 'request_id': 'req-87538ff1-1f72-4d03-a7c5-add763fc9d89'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:16.472101 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-87538ff1-1f72-4d03-a7c5-add763fc9d89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d681e2ee4ae4c1697ee86e27aac3ef4', 'request_id': 'req-87538ff1-1f72-4d03-a7c5-add763fc9d89'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:16.485284 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-87538ff1-1f72-4d03-a7c5-add763fc9d89 admin admin] The token cache is being invalidate because project 2d681e2ee4ae4c1697ee86e27aac3ef4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81307) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 22:25:16.485578 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-87538ff1-1f72-4d03-a7c5-add763fc9d89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:16.486352 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-87538ff1-1f72-4d03-a7c5-add763fc9d89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:16.487869 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1099/2200] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 20 22:25:16 2022] DELETE /identity/v3/projects/2d681e2ee4ae4c1697ee86e27aac3ef4 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:25:16.499345 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd1601-eab7-41d3-9b7d-56f055193db9 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:16.499870 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd1601-eab7-41d3-9b7d-56f055193db9 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:16.500217 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd1601-eab7-41d3-9b7d-56f055193db9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:16.521249 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-90fd1601-eab7-41d3-9b7d-56f055193db9 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:25:16.522579 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-90fd1601-eab7-41d3-9b7d-56f055193db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:25:16.554026 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:25:16.595646 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1102/2201] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:25:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:25:16.603400 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c023cd2-e618-4fca-9fdc-56b1002ae7f1 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:16.603887 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c023cd2-e618-4fca-9fdc-56b1002ae7f1 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:16.604404 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c023cd2-e618-4fca-9fdc-56b1002ae7f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:16.615329 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:25:16.638718 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-7c023cd2-e618-4fca-9fdc-56b1002ae7f1 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:25:16.640836 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-7c023cd2-e618-4fca-9fdc-56b1002ae7f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:25:16.659194 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1100/2202] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:25:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 22:25:16.663406 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fd1601-eab7-41d3-9b7d-56f055193db9 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:16.675337 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fd1601-eab7-41d3-9b7d-56f055193db9 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:16.682337 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e36c84-a9ef-4528-ad35-c1349e8392f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:16.683021 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e36c84-a9ef-4528-ad35-c1349e8392f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:16.683302 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e36c84-a9ef-4528-ad35-c1349e8392f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:16.683573 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e36c84-a9ef-4528-ad35-c1349e8392f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:16.684452 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e36c84-a9ef-4528-ad35-c1349e8392f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:25:16.685270 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e36c84-a9ef-4528-ad35-c1349e8392f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:16.686400 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e36c84-a9ef-4528-ad35-c1349e8392f6 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:16.700971 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1103/2203] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 20 22:25:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:25:16.703347 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c023cd2-e618-4fca-9fdc-56b1002ae7f1 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:16.712917 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c023cd2-e618-4fca-9fdc-56b1002ae7f1 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:16.717823 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b6e8a1-140a-43e5-b7cf-ea9d5fc91e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:16.718428 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b6e8a1-140a-43e5-b7cf-ea9d5fc91e51 admin admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:16.718726 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b6e8a1-140a-43e5-b7cf-ea9d5fc91e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:16.718995 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b6e8a1-140a-43e5-b7cf-ea9d5fc91e51 admin admin] PATH_INFO: `/v3/projects` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:16.719906 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b6e8a1-140a-43e5-b7cf-ea9d5fc91e51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:16.721865 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b6e8a1-140a-43e5-b7cf-ea9d5fc91e51 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:16.753687 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1101/2204] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 20 22:25:16 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:25:16.757685 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e36c84-a9ef-4528-ad35-c1349e8392f6 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:16.768772 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e36c84-a9ef-4528-ad35-c1349e8392f6 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:16.826725 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5492554-9f7e-4642-b7bc-02778dbddd84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:16.827466 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5492554-9f7e-4642-b7bc-02778dbddd84 admin admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:16.828164 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5492554-9f7e-4642-b7bc-02778dbddd84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:16.828164 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5492554-9f7e-4642-b7bc-02778dbddd84 admin admin] PATH_INFO: `/v3/users` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:16.828735 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5492554-9f7e-4642-b7bc-02778dbddd84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:16.830765 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5492554-9f7e-4642-b7bc-02778dbddd84 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:16.854580 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1104/2205] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 20 22:25:16 2022] POST /identity/v3/users => generated 287 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 20 22:25:16.859048 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b6e8a1-140a-43e5-b7cf-ea9d5fc91e51 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:16.869935 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b6e8a1-140a-43e5-b7cf-ea9d5fc91e51 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:16.874462 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75b067c-4aa1-41e3-bf22-fb048c837483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:16.875079 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75b067c-4aa1-41e3-bf22-fb048c837483 admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:16.875356 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75b067c-4aa1-41e3-bf22-fb048c837483 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:16.875625 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75b067c-4aa1-41e3-bf22-fb048c837483 admin admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:16.876267 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75b067c-4aa1-41e3-bf22-fb048c837483 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:16.877853 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75b067c-4aa1-41e3-bf22-fb048c837483 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:16.888021 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1102/2206] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:25:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:25:16.892037 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5492554-9f7e-4642-b7bc-02778dbddd84 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:16.901978 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5492554-9f7e-4642-b7bc-02778dbddd84 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:16.906602 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2b6651-70fb-43b7-b9aa-684effc4e79f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:16.907189 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2b6651-70fb-43b7-b9aa-684effc4e79f admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:16.907463 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2b6651-70fb-43b7-b9aa-684effc4e79f admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:16.907732 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2b6651-70fb-43b7-b9aa-684effc4e79f admin admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:16.908362 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2b6651-70fb-43b7-b9aa-684effc4e79f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:16.910021 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2b6651-70fb-43b7-b9aa-684effc4e79f admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:16.921156 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1105/2207] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:25:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 20 22:25:16.925043 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75b067c-4aa1-41e3-bf22-fb048c837483 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:16.935319 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75b067c-4aa1-41e3-bf22-fb048c837483 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:16.940510 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c5faf9-486e-48ef-9fce-fab6af272e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:16.941162 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c5faf9-486e-48ef-9fce-fab6af272e84 admin admin] REQUEST_METHOD: `PUT` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:16.941444 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c5faf9-486e-48ef-9fce-fab6af272e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:16.941719 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c5faf9-486e-48ef-9fce-fab6af272e84 admin admin] PATH_INFO: `/v3/projects/0ab78459b0ca489799e2fd5f187533b3/users/276d1a5055364733aebc64b38bdabc32/roles/604444e7ad0d437dbd1f5a6e02b761f5` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:16.956347 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c5faf9-486e-48ef-9fce-fab6af272e84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ab78459b0ca489799e2fd5f187533b3, user_id=276d1a5055364733aebc64b38bdabc32, role_id=604444e7ad0d437dbd1f5a6e02b761f5)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:16.959054 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c5faf9-486e-48ef-9fce-fab6af272e84 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:16.973070 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1103/2208] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:25:16 2022] PUT /identity/v3/projects/0ab78459b0ca489799e2fd5f187533b3/users/276d1a5055364733aebc64b38bdabc32/roles/604444e7ad0d437dbd1f5a6e02b761f5 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:25:16.978664 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b8d4d0-183e-4f84-a934-bc563bd46ce8 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:16.978952 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b8d4d0-183e-4f84-a934-bc563bd46ce8 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:16.979232 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b8d4d0-183e-4f84-a934-bc563bd46ce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:17.000844 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-85b8d4d0-183e-4f84-a934-bc563bd46ce8 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:25:17.002106 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-85b8d4d0-183e-4f84-a934-bc563bd46ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:25:17.066031 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1106/2209] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:25:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:25:17.075725 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c5faf9-486e-48ef-9fce-fab6af272e84 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:17.077805 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-63c5faf9-486e-48ef-9fce-fab6af272e84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:25:17.142239 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c5faf9-486e-48ef-9fce-fab6af272e84 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:17.145778 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bb46cb-2b98-4e1e-91c1-577ac7f4569b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b0b3ca4ecd41aaba9cf8e0f91fbf54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:17.146420 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bb46cb-2b98-4e1e-91c1-577ac7f4569b service neutron] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:17.146747 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bb46cb-2b98-4e1e-91c1-577ac7f4569b service neutron] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:17.147018 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bb46cb-2b98-4e1e-91c1-577ac7f4569b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:17.156840 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bb46cb-2b98-4e1e-91c1-577ac7f4569b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:17.158264 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bb46cb-2b98-4e1e-91c1-577ac7f4569b service neutron] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:17.168679 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1104/2210] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:25:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:25:17.953710 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b640917-d686-4776-9fb6-747fa161111e None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:17.954270 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b640917-d686-4776-9fb6-747fa161111e None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:17.954421 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b640917-d686-4776-9fb6-747fa161111e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:17.990920 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-2b640917-d686-4776-9fb6-747fa161111e None None] MFA Rules not processed for user `276d1a5055364733aebc64b38bdabc32`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:25:17.992028 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-2b640917-d686-4776-9fb6-747fa161111e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:25:18.048517 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:25:18.111877 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1107/2211] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:25:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:25:18.124033 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bb46cb-2b98-4e1e-91c1-577ac7f4569b service neutron] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:18.127653 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-b0bb46cb-2b98-4e1e-91c1-577ac7f4569b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:25:18.199899 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bb46cb-2b98-4e1e-91c1-577ac7f4569b service neutron] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:18.203478 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456f89f4-e332-479a-acba-443d36c19e2b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577c8b14c1f4279beac13b9ba11aba1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:18.204087 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f89f4-e332-479a-acba-443d36c19e2b service cinder] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:18.204365 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f89f4-e332-479a-acba-443d36c19e2b service cinder] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:18.204633 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f89f4-e332-479a-acba-443d36c19e2b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:18.213946 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456f89f4-e332-479a-acba-443d36c19e2b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:18.215511 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456f89f4-e332-479a-acba-443d36c19e2b service cinder] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:18.224589 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1105/2212] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:25:18 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:25:19.593344 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf6e4eb-98d6-4784-9c8c-fc6187823de2 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:19.593785 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf6e4eb-98d6-4784-9c8c-fc6187823de2 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:19.593999 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf6e4eb-98d6-4784-9c8c-fc6187823de2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:19.614344 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-cbf6e4eb-98d6-4784-9c8c-fc6187823de2 None None] MFA Rules not processed for user `276d1a5055364733aebc64b38bdabc32`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:25:19.615588 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-cbf6e4eb-98d6-4784-9c8c-fc6187823de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:25:19.623160 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1108/2213] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:25:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:25:23.450591 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456f89f4-e332-479a-acba-443d36c19e2b service cinder] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:23.458484 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-456f89f4-e332-479a-acba-443d36c19e2b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:25:23.467847 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456f89f4-e332-479a-acba-443d36c19e2b service cinder] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:23.472383 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7481f2-4a09-468a-9b98-72eeae32ee85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:23.473013 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7481f2-4a09-468a-9b98-72eeae32ee85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:23.473294 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7481f2-4a09-468a-9b98-72eeae32ee85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:23.473566 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7481f2-4a09-468a-9b98-72eeae32ee85 admin admin] PATH_INFO: `/v3/users/279d5ee032354a11b2a1e7da91013276` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:23.474820 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7481f2-4a09-468a-9b98-72eeae32ee85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=279d5ee032354a11b2a1e7da91013276)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:23.477208 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7481f2-4a09-468a-9b98-72eeae32ee85 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:23.522848 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:25:23.530126 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-8e7481f2-4a09-468a-9b98-72eeae32ee85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '279d5ee032354a11b2a1e7da91013276'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:23.540374 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-8e7481f2-4a09-468a-9b98-72eeae32ee85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '279d5ee032354a11b2a1e7da91013276'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:23.541114 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-8e7481f2-4a09-468a-9b98-72eeae32ee85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '279d5ee032354a11b2a1e7da91013276'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:23.541753 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-8e7481f2-4a09-468a-9b98-72eeae32ee85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '279d5ee032354a11b2a1e7da91013276'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:23.549151 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-8e7481f2-4a09-468a-9b98-72eeae32ee85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '279d5ee032354a11b2a1e7da91013276'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:23.567499 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1106/2214] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 20 22:25:23 2022] DELETE /identity/v3/users/279d5ee032354a11b2a1e7da91013276 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:25:23.571967 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397b9fc1-aedb-4d1c-a9df-872e87281073 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:23.572467 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397b9fc1-aedb-4d1c-a9df-872e87281073 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:23.572623 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397b9fc1-aedb-4d1c-a9df-872e87281073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:23.594427 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-397b9fc1-aedb-4d1c-a9df-872e87281073 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:25:23.595977 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-397b9fc1-aedb-4d1c-a9df-872e87281073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:25:23.657233 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1109/2215] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:25:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 22:25:23.672124 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7481f2-4a09-468a-9b98-72eeae32ee85 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:23.673774 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-8e7481f2-4a09-468a-9b98-72eeae32ee85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:25:23.773809 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7481f2-4a09-468a-9b98-72eeae32ee85 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:23.779776 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c00958b-d448-481a-a7fd-60301af9b66a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b0b3ca4ecd41aaba9cf8e0f91fbf54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:23.780404 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c00958b-d448-481a-a7fd-60301af9b66a service neutron] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:23.780684 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c00958b-d448-481a-a7fd-60301af9b66a service neutron] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:23.781049 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c00958b-d448-481a-a7fd-60301af9b66a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:23.791451 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c00958b-d448-481a-a7fd-60301af9b66a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:23.793159 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c00958b-d448-481a-a7fd-60301af9b66a service neutron] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:23.805577 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1107/2216] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:25:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:25:24.271572 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397b9fc1-aedb-4d1c-a9df-872e87281073 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:24.274537 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-397b9fc1-aedb-4d1c-a9df-872e87281073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:25:24.296085 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397b9fc1-aedb-4d1c-a9df-872e87281073 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:24.299613 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb437bf-8eb7-47a3-aeba-51a3a846cb73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:24.300262 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb437bf-8eb7-47a3-aeba-51a3a846cb73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:24.300541 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb437bf-8eb7-47a3-aeba-51a3a846cb73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:24.300819 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb437bf-8eb7-47a3-aeba-51a3a846cb73 admin admin] PATH_INFO: `/v3/projects/64fa7a9df4574b20971daf3de15931c9` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:24.301954 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb437bf-8eb7-47a3-aeba-51a3a846cb73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64fa7a9df4574b20971daf3de15931c9)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:24.304054 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb437bf-8eb7-47a3-aeba-51a3a846cb73 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:24.364071 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-1cb437bf-8eb7-47a3-aeba-51a3a846cb73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64fa7a9df4574b20971daf3de15931c9', 'request_id': 'req-1cb437bf-8eb7-47a3-aeba-51a3a846cb73'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:24.370160 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-1cb437bf-8eb7-47a3-aeba-51a3a846cb73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64fa7a9df4574b20971daf3de15931c9', 'request_id': 'req-1cb437bf-8eb7-47a3-aeba-51a3a846cb73'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:24.378446 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-1cb437bf-8eb7-47a3-aeba-51a3a846cb73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64fa7a9df4574b20971daf3de15931c9', 'request_id': 'req-1cb437bf-8eb7-47a3-aeba-51a3a846cb73'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:24.391459 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-1cb437bf-8eb7-47a3-aeba-51a3a846cb73 admin admin] The token cache is being invalidate because project 64fa7a9df4574b20971daf3de15931c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81306) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 22:25:24.391900 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-1cb437bf-8eb7-47a3-aeba-51a3a846cb73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:24.392438 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-1cb437bf-8eb7-47a3-aeba-51a3a846cb73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:24.394139 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1110/2217] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 20 22:25:24 2022] DELETE /identity/v3/projects/64fa7a9df4574b20971daf3de15931c9 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:25:24.400454 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5445bab2-724c-462d-b30b-33916d3421e4 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:24.400741 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5445bab2-724c-462d-b30b-33916d3421e4 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:24.401016 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5445bab2-724c-462d-b30b-33916d3421e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:24.420648 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-5445bab2-724c-462d-b30b-33916d3421e4 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:25:24.421872 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-5445bab2-724c-462d-b30b-33916d3421e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:25:24.480429 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1108/2218] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:25:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 22:25:24.488307 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721bef08-09e2-4636-b6ac-9bed0110f6b2 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:24.488595 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721bef08-09e2-4636-b6ac-9bed0110f6b2 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:24.488875 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721bef08-09e2-4636-b6ac-9bed0110f6b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:24.509033 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-721bef08-09e2-4636-b6ac-9bed0110f6b2 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:25:24.510238 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-721bef08-09e2-4636-b6ac-9bed0110f6b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:25:24.518150 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1111/2219] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:25:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:25:24.522279 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5445bab2-724c-462d-b30b-33916d3421e4 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:24.532497 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5445bab2-724c-462d-b30b-33916d3421e4 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:24.537077 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24925f3-d611-47fb-8101-82fa93e0aa59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:24.537674 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24925f3-d611-47fb-8101-82fa93e0aa59 admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:24.537955 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24925f3-d611-47fb-8101-82fa93e0aa59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:24.538224 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24925f3-d611-47fb-8101-82fa93e0aa59 admin admin] PATH_INFO: `/v3/domains` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:24.538903 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24925f3-d611-47fb-8101-82fa93e0aa59 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:25:24.539203 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24925f3-d611-47fb-8101-82fa93e0aa59 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:24.540784 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24925f3-d611-47fb-8101-82fa93e0aa59 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:24.554439 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1109/2220] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 20 22:25:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 22:25:24.560314 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721bef08-09e2-4636-b6ac-9bed0110f6b2 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:24.569803 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721bef08-09e2-4636-b6ac-9bed0110f6b2 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:24.575024 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2aa81e-6b9d-42d4-8044-0f7efb2b4d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:24.575621 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2aa81e-6b9d-42d4-8044-0f7efb2b4d6a admin admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:24.575896 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2aa81e-6b9d-42d4-8044-0f7efb2b4d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:24.576168 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2aa81e-6b9d-42d4-8044-0f7efb2b4d6a admin admin] PATH_INFO: `/v3/projects` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:24.576792 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2aa81e-6b9d-42d4-8044-0f7efb2b4d6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:24.578702 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2aa81e-6b9d-42d4-8044-0f7efb2b4d6a admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:24.604981 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1112/2221] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 20 22:25:24 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:25:24.609085 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24925f3-d611-47fb-8101-82fa93e0aa59 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:24.619699 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24925f3-d611-47fb-8101-82fa93e0aa59 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:24.664492 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:25:24.677759 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32ad698-c3b1-4d7f-a376-217e4bd7cc98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:24.678365 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32ad698-c3b1-4d7f-a376-217e4bd7cc98 admin admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:24.678689 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32ad698-c3b1-4d7f-a376-217e4bd7cc98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:24.678961 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32ad698-c3b1-4d7f-a376-217e4bd7cc98 admin admin] PATH_INFO: `/v3/users` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:24.680122 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32ad698-c3b1-4d7f-a376-217e4bd7cc98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:24.682059 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32ad698-c3b1-4d7f-a376-217e4bd7cc98 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:24.703652 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1110/2222] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 20 22:25:24 2022] POST /identity/v3/users => generated 287 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:25:24.707760 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2aa81e-6b9d-42d4-8044-0f7efb2b4d6a admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:24.719093 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2aa81e-6b9d-42d4-8044-0f7efb2b4d6a admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:24.723720 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dfd855-55fc-4b9a-bc3d-9ddef21bdfed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:24.724323 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dfd855-55fc-4b9a-bc3d-9ddef21bdfed admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:24.724600 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dfd855-55fc-4b9a-bc3d-9ddef21bdfed admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:24.724874 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dfd855-55fc-4b9a-bc3d-9ddef21bdfed admin admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:24.725536 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dfd855-55fc-4b9a-bc3d-9ddef21bdfed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:24.727144 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dfd855-55fc-4b9a-bc3d-9ddef21bdfed admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:24.738148 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1113/2223] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:25:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:25:24.742932 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32ad698-c3b1-4d7f-a376-217e4bd7cc98 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:24.753197 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32ad698-c3b1-4d7f-a376-217e4bd7cc98 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:24.758439 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dade7df-fa73-421b-b9f6-6760333654c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:24.759069 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dade7df-fa73-421b-b9f6-6760333654c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:24.759353 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dade7df-fa73-421b-b9f6-6760333654c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:24.759627 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dade7df-fa73-421b-b9f6-6760333654c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:24.760272 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dade7df-fa73-421b-b9f6-6760333654c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:24.761871 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dade7df-fa73-421b-b9f6-6760333654c1 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:24.772372 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1111/2224] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:25:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:25:24.776939 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dfd855-55fc-4b9a-bc3d-9ddef21bdfed admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:24.787270 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dfd855-55fc-4b9a-bc3d-9ddef21bdfed admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:24.792116 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a772f9d0-93ea-4aa4-878e-4e80c5dab494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:24.792752 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a772f9d0-93ea-4aa4-878e-4e80c5dab494 admin admin] REQUEST_METHOD: `PUT` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:24.793034 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a772f9d0-93ea-4aa4-878e-4e80c5dab494 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:24.793302 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a772f9d0-93ea-4aa4-878e-4e80c5dab494 admin admin] PATH_INFO: `/v3/projects/43e783b792794302bfc88addbe2687be/users/5348be1906bd491791a572f674b036c5/roles/604444e7ad0d437dbd1f5a6e02b761f5` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:24.796542 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:25:24.811231 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a772f9d0-93ea-4aa4-878e-4e80c5dab494 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43e783b792794302bfc88addbe2687be, user_id=5348be1906bd491791a572f674b036c5, role_id=604444e7ad0d437dbd1f5a6e02b761f5)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:24.813867 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a772f9d0-93ea-4aa4-878e-4e80c5dab494 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:24.827110 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1114/2225] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:25:24 2022] PUT /identity/v3/projects/43e783b792794302bfc88addbe2687be/users/5348be1906bd491791a572f674b036c5/roles/604444e7ad0d437dbd1f5a6e02b761f5 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:25:24.838457 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d2e8b-3e7d-4e09-b04b-c9ba76279061 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:24.838777 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d2e8b-3e7d-4e09-b04b-c9ba76279061 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:24.839056 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d2e8b-3e7d-4e09-b04b-c9ba76279061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:24.871293 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-399d2e8b-3e7d-4e09-b04b-c9ba76279061 None None] MFA Rules not processed for user `5348be1906bd491791a572f674b036c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:25:24.872556 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-399d2e8b-3e7d-4e09-b04b-c9ba76279061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:25:24.940740 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1112/2226] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:25:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:25:24.945396 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a772f9d0-93ea-4aa4-878e-4e80c5dab494 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:25.029876 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a772f9d0-93ea-4aa4-878e-4e80c5dab494 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:25.041136 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac4fd89-97e7-46f7-8095-9d4888651a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:25.041848 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac4fd89-97e7-46f7-8095-9d4888651a47 admin admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:25.042192 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac4fd89-97e7-46f7-8095-9d4888651a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:25.042976 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac4fd89-97e7-46f7-8095-9d4888651a47 admin admin] PATH_INFO: `/v3/projects` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:25.046711 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac4fd89-97e7-46f7-8095-9d4888651a47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:25.048735 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac4fd89-97e7-46f7-8095-9d4888651a47 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:25.089116 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399d2e8b-3e7d-4e09-b04b-c9ba76279061 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:25.089333 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1115/2227] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 20 22:25:24 2022] POST /identity/v3/projects => generated 371 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:25:25.103555 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399d2e8b-3e7d-4e09-b04b-c9ba76279061 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:25.165645 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8adfc8b-67c9-4fca-96a7-5d6dd0c5441e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:25.166452 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8adfc8b-67c9-4fca-96a7-5d6dd0c5441e admin admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:25.166902 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8adfc8b-67c9-4fca-96a7-5d6dd0c5441e admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:25.167298 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8adfc8b-67c9-4fca-96a7-5d6dd0c5441e admin admin] PATH_INFO: `/v3/users` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:25.168134 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8adfc8b-67c9-4fca-96a7-5d6dd0c5441e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:25.170978 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8adfc8b-67c9-4fca-96a7-5d6dd0c5441e admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:25.198546 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1113/2228] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 20 22:25:25 2022] POST /identity/v3/users => generated 292 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 20 22:25:25.200876 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac4fd89-97e7-46f7-8095-9d4888651a47 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:25.211822 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac4fd89-97e7-46f7-8095-9d4888651a47 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:25.216375 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e035019a-9409-4daa-a25d-356fbd9f7846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:25.216974 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e035019a-9409-4daa-a25d-356fbd9f7846 admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:25.217249 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e035019a-9409-4daa-a25d-356fbd9f7846 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:25.217519 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e035019a-9409-4daa-a25d-356fbd9f7846 admin admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:25.218155 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e035019a-9409-4daa-a25d-356fbd9f7846 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:25.219752 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e035019a-9409-4daa-a25d-356fbd9f7846 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:25.230898 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1116/2229] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:25:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 20 22:25:25.234898 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8adfc8b-67c9-4fca-96a7-5d6dd0c5441e admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:25.245289 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8adfc8b-67c9-4fca-96a7-5d6dd0c5441e admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:25.249828 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3076507-893b-4f4f-a6b1-0d8f5bf6821d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:25.250472 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3076507-893b-4f4f-a6b1-0d8f5bf6821d admin admin] REQUEST_METHOD: `PUT` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:25.250785 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3076507-893b-4f4f-a6b1-0d8f5bf6821d admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:25.251057 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3076507-893b-4f4f-a6b1-0d8f5bf6821d admin admin] PATH_INFO: `/v3/projects/f537998bda504b9ba05354d82d0e36b4/users/0da3231008734d8b8a919f7042297ece/roles/8a829170b29d42d6af589399e51edb0f` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:25.265578 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3076507-893b-4f4f-a6b1-0d8f5bf6821d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f537998bda504b9ba05354d82d0e36b4, user_id=0da3231008734d8b8a919f7042297ece, role_id=8a829170b29d42d6af589399e51edb0f)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:25.268262 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3076507-893b-4f4f-a6b1-0d8f5bf6821d admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:25.280402 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1114/2230] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:25:25 2022] PUT /identity/v3/projects/f537998bda504b9ba05354d82d0e36b4/users/0da3231008734d8b8a919f7042297ece/roles/8a829170b29d42d6af589399e51edb0f => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:25:25.284232 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e035019a-9409-4daa-a25d-356fbd9f7846 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:25.294929 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e035019a-9409-4daa-a25d-356fbd9f7846 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:25.353602 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f42984-f5aa-4ee4-8830-e93d3af4f8d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:25.354217 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f42984-f5aa-4ee4-8830-e93d3af4f8d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:25.354500 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f42984-f5aa-4ee4-8830-e93d3af4f8d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:25.354806 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f42984-f5aa-4ee4-8830-e93d3af4f8d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:25.355485 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f42984-f5aa-4ee4-8830-e93d3af4f8d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:25.357087 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f42984-f5aa-4ee4-8830-e93d3af4f8d2 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:25.366993 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1117/2231] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:25:25 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:25:25.371112 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3076507-893b-4f4f-a6b1-0d8f5bf6821d admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:25.381199 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3076507-893b-4f4f-a6b1-0d8f5bf6821d admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:25.385774 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd4d58a-0486-44f2-aa47-3a06b127ebc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:25.386418 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd4d58a-0486-44f2-aa47-3a06b127ebc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:25.386729 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd4d58a-0486-44f2-aa47-3a06b127ebc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:25.387000 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd4d58a-0486-44f2-aa47-3a06b127ebc7 admin admin] PATH_INFO: `/v3/projects/f537998bda504b9ba05354d82d0e36b4/users/0da3231008734d8b8a919f7042297ece/roles/8a829170b29d42d6af589399e51edb0f` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:25.388893 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd4d58a-0486-44f2-aa47-3a06b127ebc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f537998bda504b9ba05354d82d0e36b4, user_id=0da3231008734d8b8a919f7042297ece, role_id=8a829170b29d42d6af589399e51edb0f)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:25.391568 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd4d58a-0486-44f2-aa47-3a06b127ebc7 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:25.402033 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1115/2232] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:25:25 2022] PUT /identity/v3/projects/f537998bda504b9ba05354d82d0e36b4/users/0da3231008734d8b8a919f7042297ece/roles/8a829170b29d42d6af589399e51edb0f => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:25:25.411852 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6629020-81fd-44da-b337-a86dcf1b127a None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:25.412222 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6629020-81fd-44da-b337-a86dcf1b127a None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:25.412562 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6629020-81fd-44da-b337-a86dcf1b127a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:25.440183 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-b6629020-81fd-44da-b337-a86dcf1b127a None None] MFA Rules not processed for user `0da3231008734d8b8a919f7042297ece`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:25:25.441305 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-b6629020-81fd-44da-b337-a86dcf1b127a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:25:25.484823 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:25:25.514877 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1118/2233] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:25:25 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:25:25.526634 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd4d58a-0486-44f2-aa47-3a06b127ebc7 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:25.528398 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-5bd4d58a-0486-44f2-aa47-3a06b127ebc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:25:25.539900 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:25:25.587122 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd4d58a-0486-44f2-aa47-3a06b127ebc7 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:25.590789 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7a0359-77d4-4071-acea-613e178ff59f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577c8b14c1f4279beac13b9ba11aba1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:25.591388 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7a0359-77d4-4071-acea-613e178ff59f service cinder] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:25.591670 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7a0359-77d4-4071-acea-613e178ff59f service cinder] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:25.591942 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7a0359-77d4-4071-acea-613e178ff59f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:25.600818 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7a0359-77d4-4071-acea-613e178ff59f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:25.602945 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7a0359-77d4-4071-acea-613e178ff59f service cinder] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:25.612290 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1116/2234] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:25:25 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:25:26.003148 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6629020-81fd-44da-b337-a86dcf1b127a None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:26.089863 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6629020-81fd-44da-b337-a86dcf1b127a None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:26.095245 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e0d086-b511-45e1-a5c6-c280f5044417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:26.096080 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e0d086-b511-45e1-a5c6-c280f5044417 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:26.097855 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e0d086-b511-45e1-a5c6-c280f5044417 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:26.097855 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e0d086-b511-45e1-a5c6-c280f5044417 admin admin] PATH_INFO: `/v3/users/5348be1906bd491791a572f674b036c5` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:26.098749 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e0d086-b511-45e1-a5c6-c280f5044417 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5348be1906bd491791a572f674b036c5)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:26.100854 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e0d086-b511-45e1-a5c6-c280f5044417 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:26.167602 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-c6e0d086-b511-45e1-a5c6-c280f5044417 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5348be1906bd491791a572f674b036c5'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:26.187335 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-c6e0d086-b511-45e1-a5c6-c280f5044417 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5348be1906bd491791a572f674b036c5'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:26.188072 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-c6e0d086-b511-45e1-a5c6-c280f5044417 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5348be1906bd491791a572f674b036c5'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:26.188732 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-c6e0d086-b511-45e1-a5c6-c280f5044417 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5348be1906bd491791a572f674b036c5'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:26.199171 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-c6e0d086-b511-45e1-a5c6-c280f5044417 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5348be1906bd491791a572f674b036c5'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:26.218061 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1119/2235] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 20 22:25:26 2022] DELETE /identity/v3/users/5348be1906bd491791a572f674b036c5 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:25:26.222471 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b2e640-ff4d-456c-936b-db95440d08a3 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:26.222791 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b2e640-ff4d-456c-936b-db95440d08a3 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:26.223066 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b2e640-ff4d-456c-936b-db95440d08a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:26.262794 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-c9b2e640-ff4d-456c-936b-db95440d08a3 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:25:26.264704 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-c9b2e640-ff4d-456c-936b-db95440d08a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:25:26.341971 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1117/2236] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:25:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:25:26.352089 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e0d086-b511-45e1-a5c6-c280f5044417 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:26.353610 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-c6e0d086-b511-45e1-a5c6-c280f5044417 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:25:26.412879 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e0d086-b511-45e1-a5c6-c280f5044417 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:26.417438 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a996273e-88ca-409e-88a6-a5990905bc6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b0b3ca4ecd41aaba9cf8e0f91fbf54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:26.418177 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a996273e-88ca-409e-88a6-a5990905bc6d service neutron] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:26.418456 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a996273e-88ca-409e-88a6-a5990905bc6d service neutron] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:26.418748 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a996273e-88ca-409e-88a6-a5990905bc6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:26.428392 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a996273e-88ca-409e-88a6-a5990905bc6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:26.430364 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a996273e-88ca-409e-88a6-a5990905bc6d service neutron] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:26.439698 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1120/2237] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:25:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:25:26.716671 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b2e640-ff4d-456c-936b-db95440d08a3 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:26.718190 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-c9b2e640-ff4d-456c-936b-db95440d08a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:25:26.730973 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b2e640-ff4d-456c-936b-db95440d08a3 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:26.735618 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21daba59-351b-4220-be54-038c1d5f3d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:26.736322 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21daba59-351b-4220-be54-038c1d5f3d78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:26.736688 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21daba59-351b-4220-be54-038c1d5f3d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:26.737010 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21daba59-351b-4220-be54-038c1d5f3d78 admin admin] PATH_INFO: `/v3/projects/43e783b792794302bfc88addbe2687be` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:26.738213 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21daba59-351b-4220-be54-038c1d5f3d78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43e783b792794302bfc88addbe2687be)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:26.740216 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21daba59-351b-4220-be54-038c1d5f3d78 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:26.788641 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-21daba59-351b-4220-be54-038c1d5f3d78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43e783b792794302bfc88addbe2687be', 'request_id': 'req-21daba59-351b-4220-be54-038c1d5f3d78'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:26.796015 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-21daba59-351b-4220-be54-038c1d5f3d78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43e783b792794302bfc88addbe2687be', 'request_id': 'req-21daba59-351b-4220-be54-038c1d5f3d78'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:26.803803 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-21daba59-351b-4220-be54-038c1d5f3d78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43e783b792794302bfc88addbe2687be', 'request_id': 'req-21daba59-351b-4220-be54-038c1d5f3d78'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:26.815164 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-21daba59-351b-4220-be54-038c1d5f3d78 admin admin] The token cache is being invalidate because project 43e783b792794302bfc88addbe2687be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81307) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 22:25:26.815456 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-21daba59-351b-4220-be54-038c1d5f3d78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:26.816236 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-21daba59-351b-4220-be54-038c1d5f3d78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:26.817757 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1118/2238] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 20 22:25:26 2022] DELETE /identity/v3/projects/43e783b792794302bfc88addbe2687be => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:25:26.822281 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a996273e-88ca-409e-88a6-a5990905bc6d service neutron] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:26.828309 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:25:26.834827 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a996273e-88ca-409e-88a6-a5990905bc6d service neutron] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:26.894604 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7179e379-f33a-45a8-a7cd-bbf67e8b1eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:26.895236 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7179e379-f33a-45a8-a7cd-bbf67e8b1eff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:26.895516 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7179e379-f33a-45a8-a7cd-bbf67e8b1eff admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:26.895788 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7179e379-f33a-45a8-a7cd-bbf67e8b1eff admin admin] PATH_INFO: `/v3/users/0da3231008734d8b8a919f7042297ece` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:26.896929 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7179e379-f33a-45a8-a7cd-bbf67e8b1eff admin admin] RBAC: Authorizing `identity:delete_user(user_id=0da3231008734d8b8a919f7042297ece)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:26.899432 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7179e379-f33a-45a8-a7cd-bbf67e8b1eff admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:26.944460 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-7179e379-f33a-45a8-a7cd-bbf67e8b1eff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0da3231008734d8b8a919f7042297ece'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:26.951345 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-7179e379-f33a-45a8-a7cd-bbf67e8b1eff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0da3231008734d8b8a919f7042297ece'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:26.951940 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-7179e379-f33a-45a8-a7cd-bbf67e8b1eff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0da3231008734d8b8a919f7042297ece'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:26.952529 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-7179e379-f33a-45a8-a7cd-bbf67e8b1eff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0da3231008734d8b8a919f7042297ece'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:26.959434 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-7179e379-f33a-45a8-a7cd-bbf67e8b1eff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0da3231008734d8b8a919f7042297ece'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:26.977147 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1121/2239] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 20 22:25:26 2022] DELETE /identity/v3/users/0da3231008734d8b8a919f7042297ece => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 22:25:27.278634 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21daba59-351b-4220-be54-038c1d5f3d78 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:27.280060 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-21daba59-351b-4220-be54-038c1d5f3d78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:25:27.322235 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21daba59-351b-4220-be54-038c1d5f3d78 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:27.363717 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:25:27.404621 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d8f642-3c96-4d9e-89ab-8b7d2c9500be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:27.405267 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d8f642-3c96-4d9e-89ab-8b7d2c9500be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:27.405656 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d8f642-3c96-4d9e-89ab-8b7d2c9500be admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:27.406055 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d8f642-3c96-4d9e-89ab-8b7d2c9500be admin admin] PATH_INFO: `/v3/projects/f537998bda504b9ba05354d82d0e36b4` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:27.407211 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d8f642-3c96-4d9e-89ab-8b7d2c9500be admin admin] RBAC: Authorizing `identity:delete_project(project_id=f537998bda504b9ba05354d82d0e36b4)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:27.409375 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d8f642-3c96-4d9e-89ab-8b7d2c9500be admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:27.467065 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-06d8f642-3c96-4d9e-89ab-8b7d2c9500be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f537998bda504b9ba05354d82d0e36b4', 'request_id': 'req-06d8f642-3c96-4d9e-89ab-8b7d2c9500be'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:27.474962 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-06d8f642-3c96-4d9e-89ab-8b7d2c9500be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f537998bda504b9ba05354d82d0e36b4', 'request_id': 'req-06d8f642-3c96-4d9e-89ab-8b7d2c9500be'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:27.499099 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-06d8f642-3c96-4d9e-89ab-8b7d2c9500be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f537998bda504b9ba05354d82d0e36b4', 'request_id': 'req-06d8f642-3c96-4d9e-89ab-8b7d2c9500be'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:27.514238 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-06d8f642-3c96-4d9e-89ab-8b7d2c9500be admin admin] The token cache is being invalidate because project f537998bda504b9ba05354d82d0e36b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81307) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 22:25:27.514558 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-06d8f642-3c96-4d9e-89ab-8b7d2c9500be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:27.515221 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-06d8f642-3c96-4d9e-89ab-8b7d2c9500be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:27.516722 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1119/2240] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 20 22:25:27 2022] DELETE /identity/v3/projects/f537998bda504b9ba05354d82d0e36b4 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:25:27.521996 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6622fe1-e4a9-4d9a-b9fd-2e67f2c89dca None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:27.522469 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6622fe1-e4a9-4d9a-b9fd-2e67f2c89dca None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:27.522611 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6622fe1-e4a9-4d9a-b9fd-2e67f2c89dca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:27.552539 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-a6622fe1-e4a9-4d9a-b9fd-2e67f2c89dca None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:25:27.553904 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-a6622fe1-e4a9-4d9a-b9fd-2e67f2c89dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:25:27.630460 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1122/2241] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:25:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:25:27.639320 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b7d55-eb27-416a-adef-4d2572685281 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:27.639851 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b7d55-eb27-416a-adef-4d2572685281 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:27.640129 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b7d55-eb27-416a-adef-4d2572685281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:27.667796 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-589b7d55-eb27-416a-adef-4d2572685281 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:25:27.668973 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-589b7d55-eb27-416a-adef-4d2572685281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:25:27.677144 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1120/2242] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:25:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:25:27.681369 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6622fe1-e4a9-4d9a-b9fd-2e67f2c89dca None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:27.690805 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6622fe1-e4a9-4d9a-b9fd-2e67f2c89dca None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:27.695283 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a41c44-d80c-4097-aee1-db2d5f38a594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:27.695941 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a41c44-d80c-4097-aee1-db2d5f38a594 admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:27.696215 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a41c44-d80c-4097-aee1-db2d5f38a594 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:27.696482 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a41c44-d80c-4097-aee1-db2d5f38a594 admin admin] PATH_INFO: `/v3/domains` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:27.697117 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a41c44-d80c-4097-aee1-db2d5f38a594 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:25:27.697419 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a41c44-d80c-4097-aee1-db2d5f38a594 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:27.699039 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a41c44-d80c-4097-aee1-db2d5f38a594 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:27.714922 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1123/2243] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 20 22:25:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:25:27.716430 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589b7d55-eb27-416a-adef-4d2572685281 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:27.727001 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589b7d55-eb27-416a-adef-4d2572685281 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:27.731673 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783ea18a-2938-4451-8e04-dd7b45d472b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:27.732286 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783ea18a-2938-4451-8e04-dd7b45d472b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:27.732565 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783ea18a-2938-4451-8e04-dd7b45d472b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:27.732841 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783ea18a-2938-4451-8e04-dd7b45d472b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:27.733482 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783ea18a-2938-4451-8e04-dd7b45d472b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:27.735430 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783ea18a-2938-4451-8e04-dd7b45d472b6 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:27.762172 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1121/2244] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 20 22:25:27 2022] POST /identity/v3/projects => generated 365 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:25:27.766384 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a41c44-d80c-4097-aee1-db2d5f38a594 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:27.777272 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a41c44-d80c-4097-aee1-db2d5f38a594 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:27.781825 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:25:27.835240 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e31f36-7587-42a8-ae4f-3321fae6ca9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:27.836288 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e31f36-7587-42a8-ae4f-3321fae6ca9b admin admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:27.836566 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e31f36-7587-42a8-ae4f-3321fae6ca9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:27.836838 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e31f36-7587-42a8-ae4f-3321fae6ca9b admin admin] PATH_INFO: `/v3/users` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:27.837471 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e31f36-7587-42a8-ae4f-3321fae6ca9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:27.839398 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e31f36-7587-42a8-ae4f-3321fae6ca9b admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:27.860416 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1124/2245] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 20 22:25:27 2022] POST /identity/v3/users => generated 283 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 20 22:25:27.864561 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783ea18a-2938-4451-8e04-dd7b45d472b6 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:27.875670 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783ea18a-2938-4451-8e04-dd7b45d472b6 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:27.880403 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa7fd5b-38c2-424b-a610-7b62745f509f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:27.881010 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa7fd5b-38c2-424b-a610-7b62745f509f admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:27.881288 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa7fd5b-38c2-424b-a610-7b62745f509f admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:27.881557 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa7fd5b-38c2-424b-a610-7b62745f509f admin admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:27.882332 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa7fd5b-38c2-424b-a610-7b62745f509f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:27.883959 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa7fd5b-38c2-424b-a610-7b62745f509f admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:27.894142 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1122/2246] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:25:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:25:27.898435 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e31f36-7587-42a8-ae4f-3321fae6ca9b admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:27.909016 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e31f36-7587-42a8-ae4f-3321fae6ca9b admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:27.913511 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0e61d2-a9c8-457d-a183-af866dd08238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:27.914099 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e61d2-a9c8-457d-a183-af866dd08238 admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:27.914372 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e61d2-a9c8-457d-a183-af866dd08238 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:27.915316 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e61d2-a9c8-457d-a183-af866dd08238 admin admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:27.915954 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0e61d2-a9c8-457d-a183-af866dd08238 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:27.917525 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0e61d2-a9c8-457d-a183-af866dd08238 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:27.928125 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1125/2247] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:25:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:25:27.932334 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa7fd5b-38c2-424b-a610-7b62745f509f admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:27.942243 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa7fd5b-38c2-424b-a610-7b62745f509f admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:27.946881 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6d47e8-4eb1-44e2-8c98-1a76eb28def8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:27.947648 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6d47e8-4eb1-44e2-8c98-1a76eb28def8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:27.947982 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6d47e8-4eb1-44e2-8c98-1a76eb28def8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:27.948258 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6d47e8-4eb1-44e2-8c98-1a76eb28def8 admin admin] PATH_INFO: `/v3/projects/43ae0ba7ee8c4fdaa0c58afd313863a9/users/d73ad2a59faf4f708f723a93c361f3f9/roles/604444e7ad0d437dbd1f5a6e02b761f5` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:27.963077 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6d47e8-4eb1-44e2-8c98-1a76eb28def8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43ae0ba7ee8c4fdaa0c58afd313863a9, user_id=d73ad2a59faf4f708f723a93c361f3f9, role_id=604444e7ad0d437dbd1f5a6e02b761f5)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:27.965709 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6d47e8-4eb1-44e2-8c98-1a76eb28def8 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:27.978819 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1123/2248] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:25:27 2022] PUT /identity/v3/projects/43ae0ba7ee8c4fdaa0c58afd313863a9/users/d73ad2a59faf4f708f723a93c361f3f9/roles/604444e7ad0d437dbd1f5a6e02b761f5 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 22:25:27.988990 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7baeccf-aeb1-4da7-a2e2-15e5c4f52a24 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:27.989279 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7baeccf-aeb1-4da7-a2e2-15e5c4f52a24 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:27.989555 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7baeccf-aeb1-4da7-a2e2-15e5c4f52a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:28.019978 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-f7baeccf-aeb1-4da7-a2e2-15e5c4f52a24 None None] MFA Rules not processed for user `d73ad2a59faf4f708f723a93c361f3f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:25:28.021537 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-f7baeccf-aeb1-4da7-a2e2-15e5c4f52a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:25:28.091410 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1126/2249] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:25:27 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:25:28.096075 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6d47e8-4eb1-44e2-8c98-1a76eb28def8 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:28.163392 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6d47e8-4eb1-44e2-8c98-1a76eb28def8 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:28.170331 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71241fc0-c3fa-40ad-ad6c-f4ace6ede23e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:28.170987 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71241fc0-c3fa-40ad-ad6c-f4ace6ede23e admin admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:28.171270 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71241fc0-c3fa-40ad-ad6c-f4ace6ede23e admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:28.171544 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71241fc0-c3fa-40ad-ad6c-f4ace6ede23e admin admin] PATH_INFO: `/v3/projects` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:28.172227 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71241fc0-c3fa-40ad-ad6c-f4ace6ede23e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:28.174226 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71241fc0-c3fa-40ad-ad6c-f4ace6ede23e admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:28.181247 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:25:28.205184 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1124/2250] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 20 22:25:28 2022] POST /identity/v3/projects => generated 363 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:25:28.209488 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7baeccf-aeb1-4da7-a2e2-15e5c4f52a24 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:28.220671 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7baeccf-aeb1-4da7-a2e2-15e5c4f52a24 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:28.288730 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4660470f-376e-4e62-b5f6-2c60f7758d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:28.293448 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4660470f-376e-4e62-b5f6-2c60f7758d3c admin admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:28.293448 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4660470f-376e-4e62-b5f6-2c60f7758d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:28.293448 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4660470f-376e-4e62-b5f6-2c60f7758d3c admin admin] PATH_INFO: `/v3/users` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:28.293448 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4660470f-376e-4e62-b5f6-2c60f7758d3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:28.293952 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4660470f-376e-4e62-b5f6-2c60f7758d3c admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:28.319907 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1127/2251] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 20 22:25:28 2022] POST /identity/v3/users => generated 288 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:25:28.324554 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71241fc0-c3fa-40ad-ad6c-f4ace6ede23e admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:28.335808 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71241fc0-c3fa-40ad-ad6c-f4ace6ede23e admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:28.341227 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b012ae-0853-4f7d-822a-98d52609441c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:28.341900 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b012ae-0853-4f7d-822a-98d52609441c admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:28.342127 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b012ae-0853-4f7d-822a-98d52609441c admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:28.342402 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b012ae-0853-4f7d-822a-98d52609441c admin admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:28.343093 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b012ae-0853-4f7d-822a-98d52609441c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:28.344699 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b012ae-0853-4f7d-822a-98d52609441c admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:28.355624 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1125/2252] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:25:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:25:28.359673 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4660470f-376e-4e62-b5f6-2c60f7758d3c admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:28.369797 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4660470f-376e-4e62-b5f6-2c60f7758d3c admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:28.374578 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ac6d45-5b10-4727-9ad3-0ddfe0113d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:28.375244 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ac6d45-5b10-4727-9ad3-0ddfe0113d11 admin admin] REQUEST_METHOD: `PUT` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:28.375525 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ac6d45-5b10-4727-9ad3-0ddfe0113d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:28.375792 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ac6d45-5b10-4727-9ad3-0ddfe0113d11 admin admin] PATH_INFO: `/v3/projects/3f2fbfd215e4452b84e7ba787a2a07d8/users/bf25f80d295248cfaeaf9c6939940da8/roles/8a829170b29d42d6af589399e51edb0f` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:28.378449 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:25:28.393563 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ac6d45-5b10-4727-9ad3-0ddfe0113d11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f2fbfd215e4452b84e7ba787a2a07d8, user_id=bf25f80d295248cfaeaf9c6939940da8, role_id=8a829170b29d42d6af589399e51edb0f)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:28.396321 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ac6d45-5b10-4727-9ad3-0ddfe0113d11 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:28.410812 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1128/2253] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:25:28 2022] PUT /identity/v3/projects/3f2fbfd215e4452b84e7ba787a2a07d8/users/bf25f80d295248cfaeaf9c6939940da8/roles/8a829170b29d42d6af589399e51edb0f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 22:25:28.415382 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b012ae-0853-4f7d-822a-98d52609441c admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:28.425812 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b012ae-0853-4f7d-822a-98d52609441c admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:28.494588 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5ea7cf-d13b-4f0d-80c8-05f97d9500c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:28.495212 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5ea7cf-d13b-4f0d-80c8-05f97d9500c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:28.495495 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5ea7cf-d13b-4f0d-80c8-05f97d9500c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:28.495766 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5ea7cf-d13b-4f0d-80c8-05f97d9500c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:28.496423 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5ea7cf-d13b-4f0d-80c8-05f97d9500c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:28.498063 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5ea7cf-d13b-4f0d-80c8-05f97d9500c4 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:28.508346 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1126/2254] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:25:28 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:25:28.512344 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ac6d45-5b10-4727-9ad3-0ddfe0113d11 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:28.523541 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ac6d45-5b10-4727-9ad3-0ddfe0113d11 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:28.528254 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaee876b-ff3b-48a5-b28c-7b0a09e684ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:28.528949 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaee876b-ff3b-48a5-b28c-7b0a09e684ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:28.529224 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaee876b-ff3b-48a5-b28c-7b0a09e684ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:28.529491 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaee876b-ff3b-48a5-b28c-7b0a09e684ed admin admin] PATH_INFO: `/v3/projects/3f2fbfd215e4452b84e7ba787a2a07d8/users/bf25f80d295248cfaeaf9c6939940da8/roles/8a829170b29d42d6af589399e51edb0f` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:28.531893 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaee876b-ff3b-48a5-b28c-7b0a09e684ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f2fbfd215e4452b84e7ba787a2a07d8, user_id=bf25f80d295248cfaeaf9c6939940da8, role_id=8a829170b29d42d6af589399e51edb0f)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:28.534562 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaee876b-ff3b-48a5-b28c-7b0a09e684ed admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:28.547724 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1129/2255] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:25:28 2022] PUT /identity/v3/projects/3f2fbfd215e4452b84e7ba787a2a07d8/users/bf25f80d295248cfaeaf9c6939940da8/roles/8a829170b29d42d6af589399e51edb0f => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:25:28.559254 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9a7ad2-a419-45c0-a49e-6f630f64e3a6 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:28.559945 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9a7ad2-a419-45c0-a49e-6f630f64e3a6 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:28.560394 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9a7ad2-a419-45c0-a49e-6f630f64e3a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:28.614582 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-1f9a7ad2-a419-45c0-a49e-6f630f64e3a6 None None] MFA Rules not processed for user `bf25f80d295248cfaeaf9c6939940da8`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:25:28.615838 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-1f9a7ad2-a419-45c0-a49e-6f630f64e3a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:25:28.695562 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1127/2256] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:25:28 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:25:28.707727 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaee876b-ff3b-48a5-b28c-7b0a09e684ed admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:28.709933 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-aaee876b-ff3b-48a5-b28c-7b0a09e684ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:25:28.790478 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaee876b-ff3b-48a5-b28c-7b0a09e684ed admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:28.794200 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5279c8f9-8236-4ec0-a057-e9dc73db57a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577c8b14c1f4279beac13b9ba11aba1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:28.795105 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5279c8f9-8236-4ec0-a057-e9dc73db57a5 service cinder] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:28.795386 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5279c8f9-8236-4ec0-a057-e9dc73db57a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:28.795659 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5279c8f9-8236-4ec0-a057-e9dc73db57a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:28.809417 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5279c8f9-8236-4ec0-a057-e9dc73db57a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:28.810914 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5279c8f9-8236-4ec0-a057-e9dc73db57a5 service cinder] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:28.820904 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1130/2257] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:25:28 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:25:28.902468 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9a7ad2-a419-45c0-a49e-6f630f64e3a6 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:28.912388 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9a7ad2-a419-45c0-a49e-6f630f64e3a6 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:28.916541 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297d97e6-a335-472a-92ad-0bf1d8d4ffd0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577c8b14c1f4279beac13b9ba11aba1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:28.917172 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297d97e6-a335-472a-92ad-0bf1d8d4ffd0 service cinder] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:28.917447 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297d97e6-a335-472a-92ad-0bf1d8d4ffd0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:28.917715 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297d97e6-a335-472a-92ad-0bf1d8d4ffd0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:28.972858 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:25:28.975586 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297d97e6-a335-472a-92ad-0bf1d8d4ffd0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:28.977091 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297d97e6-a335-472a-92ad-0bf1d8d4ffd0 service cinder] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:28.989854 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1128/2258] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:25:28 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:25:36.191977 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5279c8f9-8236-4ec0-a057-e9dc73db57a5 service cinder] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:36.252004 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5279c8f9-8236-4ec0-a057-e9dc73db57a5 service cinder] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:36.256829 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8115d44-3342-4616-8622-2ce4b5a7dfcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:36.257447 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8115d44-3342-4616-8622-2ce4b5a7dfcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:36.257751 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8115d44-3342-4616-8622-2ce4b5a7dfcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:36.258021 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8115d44-3342-4616-8622-2ce4b5a7dfcc admin admin] PATH_INFO: `/v3/users/d73ad2a59faf4f708f723a93c361f3f9` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:36.259154 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8115d44-3342-4616-8622-2ce4b5a7dfcc admin admin] RBAC: Authorizing `identity:delete_user(user_id=d73ad2a59faf4f708f723a93c361f3f9)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:36.261071 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8115d44-3342-4616-8622-2ce4b5a7dfcc admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:36.307530 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-f8115d44-3342-4616-8622-2ce4b5a7dfcc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd73ad2a59faf4f708f723a93c361f3f9'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:36.314449 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-f8115d44-3342-4616-8622-2ce4b5a7dfcc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd73ad2a59faf4f708f723a93c361f3f9'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:36.315093 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-f8115d44-3342-4616-8622-2ce4b5a7dfcc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd73ad2a59faf4f708f723a93c361f3f9'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:36.315716 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-f8115d44-3342-4616-8622-2ce4b5a7dfcc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd73ad2a59faf4f708f723a93c361f3f9'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:36.322423 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-f8115d44-3342-4616-8622-2ce4b5a7dfcc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd73ad2a59faf4f708f723a93c361f3f9'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:36.330538 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:25:36.342238 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1131/2259] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 20 22:25:36 2022] DELETE /identity/v3/users/d73ad2a59faf4f708f723a93c361f3f9 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:25:36.346641 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4791dea0-0321-47d5-bc73-927827ad855a None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:36.347090 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4791dea0-0321-47d5-bc73-927827ad855a None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:36.347181 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4791dea0-0321-47d5-bc73-927827ad855a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:36.366228 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-4791dea0-0321-47d5-bc73-927827ad855a None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:25:36.367476 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-4791dea0-0321-47d5-bc73-927827ad855a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:25:36.424326 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1129/2260] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:25:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:25:36.433877 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8115d44-3342-4616-8622-2ce4b5a7dfcc admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:36.435289 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-f8115d44-3342-4616-8622-2ce4b5a7dfcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:25:36.494296 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8115d44-3342-4616-8622-2ce4b5a7dfcc admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:36.497965 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad14101-4e9e-47fe-85f5-89d1167e12f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b0b3ca4ecd41aaba9cf8e0f91fbf54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:36.498602 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad14101-4e9e-47fe-85f5-89d1167e12f7 service neutron] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:36.498885 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad14101-4e9e-47fe-85f5-89d1167e12f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:36.499161 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad14101-4e9e-47fe-85f5-89d1167e12f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:36.508082 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad14101-4e9e-47fe-85f5-89d1167e12f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:36.509536 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad14101-4e9e-47fe-85f5-89d1167e12f7 service neutron] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:36.519365 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1132/2261] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:25:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:25:36.785610 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4791dea0-0321-47d5-bc73-927827ad855a None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:36.788829 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-4791dea0-0321-47d5-bc73-927827ad855a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:25:36.822909 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4791dea0-0321-47d5-bc73-927827ad855a None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:36.829332 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56030862-8a3b-45c7-a589-59b955f2761e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:36.830249 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56030862-8a3b-45c7-a589-59b955f2761e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:36.830249 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56030862-8a3b-45c7-a589-59b955f2761e admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:36.830719 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56030862-8a3b-45c7-a589-59b955f2761e admin admin] PATH_INFO: `/v3/projects/43ae0ba7ee8c4fdaa0c58afd313863a9` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:36.831981 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56030862-8a3b-45c7-a589-59b955f2761e admin admin] RBAC: Authorizing `identity:delete_project(project_id=43ae0ba7ee8c4fdaa0c58afd313863a9)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:36.833881 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56030862-8a3b-45c7-a589-59b955f2761e admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:36.891109 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-56030862-8a3b-45c7-a589-59b955f2761e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43ae0ba7ee8c4fdaa0c58afd313863a9', 'request_id': 'req-56030862-8a3b-45c7-a589-59b955f2761e'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:36.898149 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-56030862-8a3b-45c7-a589-59b955f2761e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43ae0ba7ee8c4fdaa0c58afd313863a9', 'request_id': 'req-56030862-8a3b-45c7-a589-59b955f2761e'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:36.906406 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-56030862-8a3b-45c7-a589-59b955f2761e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43ae0ba7ee8c4fdaa0c58afd313863a9', 'request_id': 'req-56030862-8a3b-45c7-a589-59b955f2761e'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:36.917327 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-56030862-8a3b-45c7-a589-59b955f2761e admin admin] The token cache is being invalidate because project 43ae0ba7ee8c4fdaa0c58afd313863a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81307) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 22:25:36.917677 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-56030862-8a3b-45c7-a589-59b955f2761e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:36.918432 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-56030862-8a3b-45c7-a589-59b955f2761e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:36.920452 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1130/2262] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 20 22:25:36 2022] DELETE /identity/v3/projects/43ae0ba7ee8c4fdaa0c58afd313863a9 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:25:36.924388 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad14101-4e9e-47fe-85f5-89d1167e12f7 service neutron] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:36.934631 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad14101-4e9e-47fe-85f5-89d1167e12f7 service neutron] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:36.996206 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00730fc-408c-41f8-9163-a9e05eb4dd3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:36.997094 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00730fc-408c-41f8-9163-a9e05eb4dd3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:36.997375 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00730fc-408c-41f8-9163-a9e05eb4dd3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:36.997650 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00730fc-408c-41f8-9163-a9e05eb4dd3c admin admin] PATH_INFO: `/v3/users/bf25f80d295248cfaeaf9c6939940da8` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:36.999098 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00730fc-408c-41f8-9163-a9e05eb4dd3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf25f80d295248cfaeaf9c6939940da8)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:37.001033 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00730fc-408c-41f8-9163-a9e05eb4dd3c admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:37.057692 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-a00730fc-408c-41f8-9163-a9e05eb4dd3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf25f80d295248cfaeaf9c6939940da8'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:37.068559 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-a00730fc-408c-41f8-9163-a9e05eb4dd3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf25f80d295248cfaeaf9c6939940da8'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:37.069250 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-a00730fc-408c-41f8-9163-a9e05eb4dd3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf25f80d295248cfaeaf9c6939940da8'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:37.070004 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-a00730fc-408c-41f8-9163-a9e05eb4dd3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf25f80d295248cfaeaf9c6939940da8'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:37.078986 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-a00730fc-408c-41f8-9163-a9e05eb4dd3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf25f80d295248cfaeaf9c6939940da8'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:37.098045 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1133/2263] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 20 22:25:36 2022] DELETE /identity/v3/users/bf25f80d295248cfaeaf9c6939940da8 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:25:37.381872 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56030862-8a3b-45c7-a589-59b955f2761e admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:37.383375 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-56030862-8a3b-45c7-a589-59b955f2761e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:25:37.396857 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56030862-8a3b-45c7-a589-59b955f2761e admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:37.458974 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75df5bf-24dc-444b-8e7b-25a0114a2b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:37.459599 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75df5bf-24dc-444b-8e7b-25a0114a2b95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:37.459877 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75df5bf-24dc-444b-8e7b-25a0114a2b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:37.460146 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75df5bf-24dc-444b-8e7b-25a0114a2b95 admin admin] PATH_INFO: `/v3/projects/3f2fbfd215e4452b84e7ba787a2a07d8` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:37.461281 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75df5bf-24dc-444b-8e7b-25a0114a2b95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f2fbfd215e4452b84e7ba787a2a07d8)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:37.463215 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75df5bf-24dc-444b-8e7b-25a0114a2b95 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:37.485407 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:25:37.509284 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-d75df5bf-24dc-444b-8e7b-25a0114a2b95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f2fbfd215e4452b84e7ba787a2a07d8', 'request_id': 'req-d75df5bf-24dc-444b-8e7b-25a0114a2b95'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:37.515279 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-d75df5bf-24dc-444b-8e7b-25a0114a2b95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f2fbfd215e4452b84e7ba787a2a07d8', 'request_id': 'req-d75df5bf-24dc-444b-8e7b-25a0114a2b95'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:37.522987 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-d75df5bf-24dc-444b-8e7b-25a0114a2b95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f2fbfd215e4452b84e7ba787a2a07d8', 'request_id': 'req-d75df5bf-24dc-444b-8e7b-25a0114a2b95'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:37.534416 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-d75df5bf-24dc-444b-8e7b-25a0114a2b95 admin admin] The token cache is being invalidate because project 3f2fbfd215e4452b84e7ba787a2a07d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81307) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 22:25:37.534730 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-d75df5bf-24dc-444b-8e7b-25a0114a2b95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:37.535349 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-d75df5bf-24dc-444b-8e7b-25a0114a2b95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:37.536804 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1131/2264] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 20 22:25:37 2022] DELETE /identity/v3/projects/3f2fbfd215e4452b84e7ba787a2a07d8 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:25:37.542146 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c373a3-d914-47ab-99af-2cbf52fc59e8 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:37.542677 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c373a3-d914-47ab-99af-2cbf52fc59e8 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:37.542886 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c373a3-d914-47ab-99af-2cbf52fc59e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:37.563738 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-a1c373a3-d914-47ab-99af-2cbf52fc59e8 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:25:37.564951 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-a1c373a3-d914-47ab-99af-2cbf52fc59e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:25:37.573292 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:25:37.624923 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1134/2265] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:25:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 22:25:37.633688 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e04efd-1945-4a1d-be25-187443342d74 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:37.633973 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e04efd-1945-4a1d-be25-187443342d74 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:37.634244 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e04efd-1945-4a1d-be25-187443342d74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:37.654272 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-41e04efd-1945-4a1d-be25-187443342d74 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:25:37.655491 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-41e04efd-1945-4a1d-be25-187443342d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:25:37.663352 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1132/2266] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:25:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:25:37.668048 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c373a3-d914-47ab-99af-2cbf52fc59e8 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:37.677891 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c373a3-d914-47ab-99af-2cbf52fc59e8 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:37.682729 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0975e004-ee47-4f47-aa65-7e755d0e5ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:37.683348 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0975e004-ee47-4f47-aa65-7e755d0e5ec4 admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:37.683624 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0975e004-ee47-4f47-aa65-7e755d0e5ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:37.683893 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0975e004-ee47-4f47-aa65-7e755d0e5ec4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:37.684530 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0975e004-ee47-4f47-aa65-7e755d0e5ec4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:25:37.684830 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0975e004-ee47-4f47-aa65-7e755d0e5ec4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:37.686413 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0975e004-ee47-4f47-aa65-7e755d0e5ec4 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:37.697974 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1135/2267] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 20 22:25:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:25:37.701887 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e04efd-1945-4a1d-be25-187443342d74 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:37.711452 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e04efd-1945-4a1d-be25-187443342d74 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:37.717292 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d40c00e-1262-4a30-bd3b-a345e3c54728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:37.718329 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d40c00e-1262-4a30-bd3b-a345e3c54728 admin admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:37.718329 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d40c00e-1262-4a30-bd3b-a345e3c54728 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:37.718532 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d40c00e-1262-4a30-bd3b-a345e3c54728 admin admin] PATH_INFO: `/v3/projects` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:37.719154 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d40c00e-1262-4a30-bd3b-a345e3c54728 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:37.721185 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d40c00e-1262-4a30-bd3b-a345e3c54728 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:37.749056 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1133/2268] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 20 22:25:37 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:25:37.753269 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0975e004-ee47-4f47-aa65-7e755d0e5ec4 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:37.763430 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0975e004-ee47-4f47-aa65-7e755d0e5ec4 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:37.818382 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67f2c90-9cb2-45e6-aca9-898a43348f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:37.819008 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67f2c90-9cb2-45e6-aca9-898a43348f37 admin admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:37.819286 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67f2c90-9cb2-45e6-aca9-898a43348f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:37.819555 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67f2c90-9cb2-45e6-aca9-898a43348f37 admin admin] PATH_INFO: `/v3/users` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:37.820187 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67f2c90-9cb2-45e6-aca9-898a43348f37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:37.822110 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67f2c90-9cb2-45e6-aca9-898a43348f37 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:37.843794 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1136/2269] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 20 22:25:37 2022] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:25:37.847866 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d40c00e-1262-4a30-bd3b-a345e3c54728 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:37.859642 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d40c00e-1262-4a30-bd3b-a345e3c54728 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:37.864255 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8979e7d-c903-4482-bc83-e8211cddaf2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:37.864852 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8979e7d-c903-4482-bc83-e8211cddaf2e admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:37.865131 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8979e7d-c903-4482-bc83-e8211cddaf2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:37.865400 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8979e7d-c903-4482-bc83-e8211cddaf2e admin admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:37.866153 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8979e7d-c903-4482-bc83-e8211cddaf2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:37.868066 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8979e7d-c903-4482-bc83-e8211cddaf2e admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:37.878557 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1134/2270] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:25:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 20 22:25:37.884019 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67f2c90-9cb2-45e6-aca9-898a43348f37 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:37.895239 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67f2c90-9cb2-45e6-aca9-898a43348f37 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:37.900781 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc01687d-5a8e-4471-ae1e-86ad7a6d09cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:37.901393 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc01687d-5a8e-4471-ae1e-86ad7a6d09cf admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:37.901672 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc01687d-5a8e-4471-ae1e-86ad7a6d09cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:37.901944 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc01687d-5a8e-4471-ae1e-86ad7a6d09cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:37.902623 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc01687d-5a8e-4471-ae1e-86ad7a6d09cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:37.904210 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc01687d-5a8e-4471-ae1e-86ad7a6d09cf admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:37.930531 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1137/2271] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:25:37 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 20 22:25:37.930847 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8979e7d-c903-4482-bc83-e8211cddaf2e admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:37.934801 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8979e7d-c903-4482-bc83-e8211cddaf2e admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:37.940217 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85d37a4-2f38-4776-881e-fe1ef2367f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:37.940905 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85d37a4-2f38-4776-881e-fe1ef2367f90 admin admin] REQUEST_METHOD: `PUT` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:37.941740 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85d37a4-2f38-4776-881e-fe1ef2367f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:37.941740 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85d37a4-2f38-4776-881e-fe1ef2367f90 admin admin] PATH_INFO: `/v3/projects/bf5a507bd44b41f1a0eb5616018bfa1d/users/99aaa030b3474fb4a212af5083d5e4ff/roles/604444e7ad0d437dbd1f5a6e02b761f5` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:37.957281 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85d37a4-2f38-4776-881e-fe1ef2367f90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf5a507bd44b41f1a0eb5616018bfa1d, user_id=99aaa030b3474fb4a212af5083d5e4ff, role_id=604444e7ad0d437dbd1f5a6e02b761f5)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:37.960075 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85d37a4-2f38-4776-881e-fe1ef2367f90 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:37.976061 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1135/2272] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:25:37 2022] PUT /identity/v3/projects/bf5a507bd44b41f1a0eb5616018bfa1d/users/99aaa030b3474fb4a212af5083d5e4ff/roles/604444e7ad0d437dbd1f5a6e02b761f5 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:25:37.987939 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5825bbf-9e16-4391-9336-29bedbe540b8 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:37.988210 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5825bbf-9e16-4391-9336-29bedbe540b8 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:37.988483 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5825bbf-9e16-4391-9336-29bedbe540b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:38.026083 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-d5825bbf-9e16-4391-9336-29bedbe540b8 None None] MFA Rules not processed for user `99aaa030b3474fb4a212af5083d5e4ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:25:38.027585 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-d5825bbf-9e16-4391-9336-29bedbe540b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:25:38.101799 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1138/2273] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:25:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:25:38.113020 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85d37a4-2f38-4776-881e-fe1ef2367f90 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:38.114745 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-e85d37a4-2f38-4776-881e-fe1ef2367f90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:25:38.172440 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85d37a4-2f38-4776-881e-fe1ef2367f90 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:38.176090 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2122f20-ae8b-4dec-8d0f-06e3a9d8202b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbecfbbf24fd425ca99499fd44d8c7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:38.176694 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2122f20-ae8b-4dec-8d0f-06e3a9d8202b service glance] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:38.176974 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2122f20-ae8b-4dec-8d0f-06e3a9d8202b service glance] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:38.177245 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2122f20-ae8b-4dec-8d0f-06e3a9d8202b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:38.185692 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2122f20-ae8b-4dec-8d0f-06e3a9d8202b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:38.187504 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2122f20-ae8b-4dec-8d0f-06e3a9d8202b service glance] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:38.197427 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1136/2274] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:25:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:25:40.256753 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5825bbf-9e16-4391-9336-29bedbe540b8 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:40.259249 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3091ce31-53ed-47fc-a2b6-d5edc3f0ecf3 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:40.259631 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3091ce31-53ed-47fc-a2b6-d5edc3f0ecf3 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:40.259800 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3091ce31-53ed-47fc-a2b6-d5edc3f0ecf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:40.260174 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-d5825bbf-9e16-4391-9336-29bedbe540b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:25:40.270756 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:25:40.281804 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-3091ce31-53ed-47fc-a2b6-d5edc3f0ecf3 None None] MFA Rules not processed for user `276d1a5055364733aebc64b38bdabc32`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:25:40.283317 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-3091ce31-53ed-47fc-a2b6-d5edc3f0ecf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:25:40.362938 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:25:40.377149 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5825bbf-9e16-4391-9336-29bedbe540b8 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:40.380123 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1137/2275] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:25:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:25:40.394354 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe701df-a16e-4f36-a19b-624beb57e5e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:40.395145 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe701df-a16e-4f36-a19b-624beb57e5e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:40.395746 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe701df-a16e-4f36-a19b-624beb57e5e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:40.396346 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe701df-a16e-4f36-a19b-624beb57e5e0 admin admin] PATH_INFO: `/v3/users/30291153e5b1484fb19595a8824d8ad2` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:40.397847 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe701df-a16e-4f36-a19b-624beb57e5e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30291153e5b1484fb19595a8824d8ad2)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:40.400918 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe701df-a16e-4f36-a19b-624beb57e5e0 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:40.475944 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-bfe701df-a16e-4f36-a19b-624beb57e5e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30291153e5b1484fb19595a8824d8ad2'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:40.488880 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-bfe701df-a16e-4f36-a19b-624beb57e5e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30291153e5b1484fb19595a8824d8ad2'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:40.489571 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-bfe701df-a16e-4f36-a19b-624beb57e5e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30291153e5b1484fb19595a8824d8ad2'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:40.490197 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-bfe701df-a16e-4f36-a19b-624beb57e5e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30291153e5b1484fb19595a8824d8ad2'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:40.498444 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-bfe701df-a16e-4f36-a19b-624beb57e5e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30291153e5b1484fb19595a8824d8ad2'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:40.522777 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1139/2276] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 20 22:25:40 2022] DELETE /identity/v3/users/30291153e5b1484fb19595a8824d8ad2 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 22:25:40.527111 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79dc643-a02c-41a0-8023-f295fddb2b2d None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:40.527472 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79dc643-a02c-41a0-8023-f295fddb2b2d None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:40.527929 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79dc643-a02c-41a0-8023-f295fddb2b2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:40.548315 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-a79dc643-a02c-41a0-8023-f295fddb2b2d None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:25:40.549542 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-a79dc643-a02c-41a0-8023-f295fddb2b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:25:40.611023 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1138/2277] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:25:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 22:25:40.621106 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe701df-a16e-4f36-a19b-624beb57e5e0 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:40.622657 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-bfe701df-a16e-4f36-a19b-624beb57e5e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:25:40.681968 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe701df-a16e-4f36-a19b-624beb57e5e0 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:40.686225 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ca0483-a7c0-4489-a5a2-8f560767e68d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b0b3ca4ecd41aaba9cf8e0f91fbf54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:40.686862 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ca0483-a7c0-4489-a5a2-8f560767e68d service neutron] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:40.687138 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ca0483-a7c0-4489-a5a2-8f560767e68d service neutron] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:40.687410 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ca0483-a7c0-4489-a5a2-8f560767e68d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:40.699572 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ca0483-a7c0-4489-a5a2-8f560767e68d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:40.701127 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ca0483-a7c0-4489-a5a2-8f560767e68d service neutron] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:40.713525 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1140/2278] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:25:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:25:41.014947 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79dc643-a02c-41a0-8023-f295fddb2b2d None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:41.016584 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-a79dc643-a02c-41a0-8023-f295fddb2b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:25:41.032526 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79dc643-a02c-41a0-8023-f295fddb2b2d None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:41.042817 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd5672b-62ec-470a-b8c4-874ee6652dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:41.043413 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd5672b-62ec-470a-b8c4-874ee6652dcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:41.043704 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd5672b-62ec-470a-b8c4-874ee6652dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:41.043945 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd5672b-62ec-470a-b8c4-874ee6652dcd admin admin] PATH_INFO: `/v3/projects/1e43c9ec13704a37937f62398caa1865` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:41.045401 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd5672b-62ec-470a-b8c4-874ee6652dcd admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e43c9ec13704a37937f62398caa1865)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:41.047322 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd5672b-62ec-470a-b8c4-874ee6652dcd admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:41.112768 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-ccd5672b-62ec-470a-b8c4-874ee6652dcd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e43c9ec13704a37937f62398caa1865', 'request_id': 'req-ccd5672b-62ec-470a-b8c4-874ee6652dcd'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:41.136855 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-ccd5672b-62ec-470a-b8c4-874ee6652dcd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e43c9ec13704a37937f62398caa1865', 'request_id': 'req-ccd5672b-62ec-470a-b8c4-874ee6652dcd'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:41.162831 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-ccd5672b-62ec-470a-b8c4-874ee6652dcd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e43c9ec13704a37937f62398caa1865', 'request_id': 'req-ccd5672b-62ec-470a-b8c4-874ee6652dcd'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:41.182142 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-ccd5672b-62ec-470a-b8c4-874ee6652dcd admin admin] The token cache is being invalidate because project 1e43c9ec13704a37937f62398caa1865 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81307) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 22:25:41.182385 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-ccd5672b-62ec-470a-b8c4-874ee6652dcd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:41.183330 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-ccd5672b-62ec-470a-b8c4-874ee6652dcd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:25:41.188733 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1139/2279] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 20 22:25:41 2022] DELETE /identity/v3/projects/1e43c9ec13704a37937f62398caa1865 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:25:41.190334 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f4581d-9462-4439-8842-316ca8eeb118 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:41.190825 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f4581d-9462-4439-8842-316ca8eeb118 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:41.191276 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f4581d-9462-4439-8842-316ca8eeb118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:41.223957 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-f9f4581d-9462-4439-8842-316ca8eeb118 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:25:41.226029 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-f9f4581d-9462-4439-8842-316ca8eeb118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:25:41.263466 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:25:41.339210 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1141/2280] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:25:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:25:41.348332 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45646adb-7e8e-4ee1-8e51-319081dfdae0 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:41.348908 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45646adb-7e8e-4ee1-8e51-319081dfdae0 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:41.348908 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45646adb-7e8e-4ee1-8e51-319081dfdae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:41.371226 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-45646adb-7e8e-4ee1-8e51-319081dfdae0 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:25:41.372865 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-45646adb-7e8e-4ee1-8e51-319081dfdae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:25:41.388348 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1140/2281] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:25:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:25:41.389351 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f4581d-9462-4439-8842-316ca8eeb118 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:41.405811 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f4581d-9462-4439-8842-316ca8eeb118 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:41.412587 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a39d201-afb7-4093-82bd-b728c2a5188a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:41.412728 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a39d201-afb7-4093-82bd-b728c2a5188a admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:41.412919 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a39d201-afb7-4093-82bd-b728c2a5188a admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:41.413180 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a39d201-afb7-4093-82bd-b728c2a5188a admin admin] PATH_INFO: `/v3/domains` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:41.413827 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a39d201-afb7-4093-82bd-b728c2a5188a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:25:41.414165 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a39d201-afb7-4093-82bd-b728c2a5188a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:41.415806 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a39d201-afb7-4093-82bd-b728c2a5188a admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:41.437411 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1142/2282] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 20 22:25:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:25:41.439312 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45646adb-7e8e-4ee1-8e51-319081dfdae0 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:41.461915 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45646adb-7e8e-4ee1-8e51-319081dfdae0 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:41.469302 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817b479b-f9ca-465c-a29c-a185880d4ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:41.470188 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817b479b-f9ca-465c-a29c-a185880d4ece admin admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:41.470771 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817b479b-f9ca-465c-a29c-a185880d4ece admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:41.471254 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817b479b-f9ca-465c-a29c-a185880d4ece admin admin] PATH_INFO: `/v3/projects` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:41.472674 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817b479b-f9ca-465c-a29c-a185880d4ece admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:41.477965 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817b479b-f9ca-465c-a29c-a185880d4ece admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:41.555854 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a39d201-afb7-4093-82bd-b728c2a5188a admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:41.564019 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1141/2283] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 20 22:25:41 2022] POST /identity/v3/projects => generated 365 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:25:41.571009 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a39d201-afb7-4093-82bd-b728c2a5188a admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:41.710861 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31597daa-95ce-44cc-a125-af3e26c22324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:41.711482 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31597daa-95ce-44cc-a125-af3e26c22324 admin admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:41.711765 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31597daa-95ce-44cc-a125-af3e26c22324 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:41.712038 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31597daa-95ce-44cc-a125-af3e26c22324 admin admin] PATH_INFO: `/v3/users` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:41.712725 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31597daa-95ce-44cc-a125-af3e26c22324 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:41.714649 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31597daa-95ce-44cc-a125-af3e26c22324 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:41.741569 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1143/2284] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 20 22:25:41 2022] POST /identity/v3/users => generated 283 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:25:41.743308 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817b479b-f9ca-465c-a29c-a185880d4ece admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:41.753967 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817b479b-f9ca-465c-a29c-a185880d4ece admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:41.759515 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4671a381-f5dc-4397-a3b7-732ef807ab42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:41.760129 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4671a381-f5dc-4397-a3b7-732ef807ab42 admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:41.760411 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4671a381-f5dc-4397-a3b7-732ef807ab42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:41.760684 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4671a381-f5dc-4397-a3b7-732ef807ab42 admin admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:41.762072 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4671a381-f5dc-4397-a3b7-732ef807ab42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:41.763848 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4671a381-f5dc-4397-a3b7-732ef807ab42 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:41.775423 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1142/2285] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:25:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 20 22:25:41.779379 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31597daa-95ce-44cc-a125-af3e26c22324 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:41.792610 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31597daa-95ce-44cc-a125-af3e26c22324 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:41.799756 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cd3607-09ab-4795-90c0-2f2fbee8cd52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:41.800621 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cd3607-09ab-4795-90c0-2f2fbee8cd52 admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:41.801324 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cd3607-09ab-4795-90c0-2f2fbee8cd52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:41.801781 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cd3607-09ab-4795-90c0-2f2fbee8cd52 admin admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:41.803797 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cd3607-09ab-4795-90c0-2f2fbee8cd52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:41.806340 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cd3607-09ab-4795-90c0-2f2fbee8cd52 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:41.822986 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1144/2286] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:25:41 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:25:41.824116 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4671a381-f5dc-4397-a3b7-732ef807ab42 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:41.836600 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4671a381-f5dc-4397-a3b7-732ef807ab42 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:41.841805 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdabad41-fced-41db-9237-94a2c5c9f60c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:41.842662 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdabad41-fced-41db-9237-94a2c5c9f60c admin admin] REQUEST_METHOD: `PUT` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:41.842947 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdabad41-fced-41db-9237-94a2c5c9f60c admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:41.843307 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdabad41-fced-41db-9237-94a2c5c9f60c admin admin] PATH_INFO: `/v3/projects/7e96395a9f104c82acd8d83942fef31b/users/c9075dfa4015464b848f5142b8eb6e3e/roles/604444e7ad0d437dbd1f5a6e02b761f5` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:41.864131 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdabad41-fced-41db-9237-94a2c5c9f60c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e96395a9f104c82acd8d83942fef31b, user_id=c9075dfa4015464b848f5142b8eb6e3e, role_id=604444e7ad0d437dbd1f5a6e02b761f5)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:41.868797 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdabad41-fced-41db-9237-94a2c5c9f60c admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:41.888680 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1143/2287] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:25:41 2022] PUT /identity/v3/projects/7e96395a9f104c82acd8d83942fef31b/users/c9075dfa4015464b848f5142b8eb6e3e/roles/604444e7ad0d437dbd1f5a6e02b761f5 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:25:41.899491 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633ac2dd-e5e4-4a46-a25d-9c15bef814a7 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:41.899786 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633ac2dd-e5e4-4a46-a25d-9c15bef814a7 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:41.900152 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633ac2dd-e5e4-4a46-a25d-9c15bef814a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:41.936527 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-633ac2dd-e5e4-4a46-a25d-9c15bef814a7 None None] MFA Rules not processed for user `c9075dfa4015464b848f5142b8eb6e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:25:41.937750 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-633ac2dd-e5e4-4a46-a25d-9c15bef814a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:25:42.011351 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1145/2288] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:25:41 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:25:42.023121 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdabad41-fced-41db-9237-94a2c5c9f60c admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:42.024995 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-fdabad41-fced-41db-9237-94a2c5c9f60c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:25:42.042397 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:25:42.089523 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdabad41-fced-41db-9237-94a2c5c9f60c admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:42.093241 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500eedda-bc02-4b79-9ba4-6eee09c21115 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577c8b14c1f4279beac13b9ba11aba1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:42.093851 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500eedda-bc02-4b79-9ba4-6eee09c21115 service cinder] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:42.094134 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500eedda-bc02-4b79-9ba4-6eee09c21115 service cinder] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:42.094408 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500eedda-bc02-4b79-9ba4-6eee09c21115 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:42.103211 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500eedda-bc02-4b79-9ba4-6eee09c21115 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:42.104590 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500eedda-bc02-4b79-9ba4-6eee09c21115 service cinder] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:42.113359 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1144/2289] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:25:42 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:25:44.630773 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0dad52-3d49-4114-87ba-fec0e8f93256 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:44.631188 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0dad52-3d49-4114-87ba-fec0e8f93256 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:44.631325 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0dad52-3d49-4114-87ba-fec0e8f93256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:44.653260 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-bb0dad52-3d49-4114-87ba-fec0e8f93256 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:25:44.654473 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-bb0dad52-3d49-4114-87ba-fec0e8f93256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:25:44.675392 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:25:44.727067 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1146/2290] 10.222.0.50 () {58 vars in 1016 bytes} [Tue Sep 20 22:25:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:25:44.749881 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500eedda-bc02-4b79-9ba4-6eee09c21115 service cinder] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:44.752280 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-500eedda-bc02-4b79-9ba4-6eee09c21115 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:25:44.839648 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500eedda-bc02-4b79-9ba4-6eee09c21115 service cinder] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:44.848333 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e22b18-a6ab-47b6-abad-02780bc29f80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db7eed561e99452289a662ad326cf919', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:44.848958 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e22b18-a6ab-47b6-abad-02780bc29f80 service nova] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:44.849231 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e22b18-a6ab-47b6-abad-02780bc29f80 service nova] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:44.849502 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e22b18-a6ab-47b6-abad-02780bc29f80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:44.879478 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e22b18-a6ab-47b6-abad-02780bc29f80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:44.881252 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e22b18-a6ab-47b6-abad-02780bc29f80 service nova] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:44.892240 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1145/2291] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:25:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:25:48.683368 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f46a98-3f3d-4022-8316-c6990972bc12 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:48.683946 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f46a98-3f3d-4022-8316-c6990972bc12 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:48.684046 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f46a98-3f3d-4022-8316-c6990972bc12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:48.703084 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-51f46a98-3f3d-4022-8316-c6990972bc12 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:25:48.704288 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-51f46a98-3f3d-4022-8316-c6990972bc12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:25:48.712032 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1147/2292] 10.222.0.50 () {58 vars in 1016 bytes} [Tue Sep 20 22:25:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:25:48.727555 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e22b18-a6ab-47b6-abad-02780bc29f80 service nova] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:48.729004 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-d9e22b18-a6ab-47b6-abad-02780bc29f80 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:25:48.744288 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e22b18-a6ab-47b6-abad-02780bc29f80 service nova] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:48.749747 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94bcddd-3770-4158-937d-02109ce96078 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db7eed561e99452289a662ad326cf919', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:48.750383 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94bcddd-3770-4158-937d-02109ce96078 service nova] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:48.750710 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94bcddd-3770-4158-937d-02109ce96078 service nova] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:48.751248 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94bcddd-3770-4158-937d-02109ce96078 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:48.760290 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94bcddd-3770-4158-937d-02109ce96078 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:48.761953 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94bcddd-3770-4158-937d-02109ce96078 service nova] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:48.771887 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1146/2293] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:25:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:25:56.039046 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d010f7-7fea-4dd1-a838-f9020e31bc01 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:56.039604 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d010f7-7fea-4dd1-a838-f9020e31bc01 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:56.039604 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d010f7-7fea-4dd1-a838-f9020e31bc01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:56.059860 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-56d010f7-7fea-4dd1-a838-f9020e31bc01 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:25:56.061079 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-56d010f7-7fea-4dd1-a838-f9020e31bc01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:25:56.069101 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1148/2294] 10.222.0.50 () {58 vars in 1016 bytes} [Tue Sep 20 22:25:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:25:56.083809 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94bcddd-3770-4158-937d-02109ce96078 service nova] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:25:56.096023 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94bcddd-3770-4158-937d-02109ce96078 service nova] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:25:56.102296 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235db955-1ce2-431b-8fab-8b7f6073dcad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db7eed561e99452289a662ad326cf919', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:25:56.102936 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235db955-1ce2-431b-8fab-8b7f6073dcad service nova] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:25:56.103213 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235db955-1ce2-431b-8fab-8b7f6073dcad service nova] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:25:56.103511 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235db955-1ce2-431b-8fab-8b7f6073dcad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:25:56.113080 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235db955-1ce2-431b-8fab-8b7f6073dcad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:25:56.114785 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235db955-1ce2-431b-8fab-8b7f6073dcad service nova] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:25:56.127733 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1147/2295] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:25:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:26:02.244632 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360137c9-e236-4c1c-9802-e4bb296c2742 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:02.245178 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360137c9-e236-4c1c-9802-e4bb296c2742 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:02.245178 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360137c9-e236-4c1c-9802-e4bb296c2742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:02.271918 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-360137c9-e236-4c1c-9802-e4bb296c2742 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:26:02.273541 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-360137c9-e236-4c1c-9802-e4bb296c2742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:26:02.283822 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1149/2296] 10.222.0.50 () {58 vars in 1016 bytes} [Tue Sep 20 22:26:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:26:02.304716 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235db955-1ce2-431b-8fab-8b7f6073dcad service nova] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:26:02.318528 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235db955-1ce2-431b-8fab-8b7f6073dcad service nova] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:26:02.324480 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557f1b03-42c7-475f-858c-24d4f59620ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db7eed561e99452289a662ad326cf919', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:26:02.325082 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557f1b03-42c7-475f-858c-24d4f59620ab service nova] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:02.325372 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557f1b03-42c7-475f-858c-24d4f59620ab service nova] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:02.325649 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557f1b03-42c7-475f-858c-24d4f59620ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:02.334172 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557f1b03-42c7-475f-858c-24d4f59620ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:26:02.335803 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557f1b03-42c7-475f-858c-24d4f59620ab service nova] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:26:02.345893 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1148/2297] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:26:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:26:02.441714 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360137c9-e236-4c1c-9802-e4bb296c2742 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:26:02.443211 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-360137c9-e236-4c1c-9802-e4bb296c2742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:26:02.456313 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360137c9-e236-4c1c-9802-e4bb296c2742 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:26:02.461019 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3cc7da-8aef-41f0-bc51-e521f57f8797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:26:02.461654 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3cc7da-8aef-41f0-bc51-e521f57f8797 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:02.461933 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3cc7da-8aef-41f0-bc51-e521f57f8797 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:02.462203 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3cc7da-8aef-41f0-bc51-e521f57f8797 admin admin] PATH_INFO: `/v3/users/99aaa030b3474fb4a212af5083d5e4ff` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:02.463387 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3cc7da-8aef-41f0-bc51-e521f57f8797 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99aaa030b3474fb4a212af5083d5e4ff)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:26:02.465294 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3cc7da-8aef-41f0-bc51-e521f57f8797 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:26:02.516588 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-df3cc7da-8aef-41f0-bc51-e521f57f8797 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99aaa030b3474fb4a212af5083d5e4ff'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:26:02.524755 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-df3cc7da-8aef-41f0-bc51-e521f57f8797 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99aaa030b3474fb4a212af5083d5e4ff'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:26:02.525647 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-df3cc7da-8aef-41f0-bc51-e521f57f8797 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99aaa030b3474fb4a212af5083d5e4ff'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:26:02.526478 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-df3cc7da-8aef-41f0-bc51-e521f57f8797 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99aaa030b3474fb4a212af5083d5e4ff'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:26:02.534483 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-df3cc7da-8aef-41f0-bc51-e521f57f8797 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99aaa030b3474fb4a212af5083d5e4ff'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:26:02.552537 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1150/2298] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 20 22:26:02 2022] DELETE /identity/v3/users/99aaa030b3474fb4a212af5083d5e4ff => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:26:02.557031 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b843a17f-6903-4848-a2db-f32d507858e8 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:02.557324 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b843a17f-6903-4848-a2db-f32d507858e8 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:02.557600 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b843a17f-6903-4848-a2db-f32d507858e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:02.577955 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-b843a17f-6903-4848-a2db-f32d507858e8 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:26:02.579205 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-b843a17f-6903-4848-a2db-f32d507858e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:26:02.642829 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1149/2299] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:26:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:26:02.654535 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3cc7da-8aef-41f0-bc51-e521f57f8797 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:26:02.656056 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-df3cc7da-8aef-41f0-bc51-e521f57f8797 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:26:02.720026 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3cc7da-8aef-41f0-bc51-e521f57f8797 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:26:02.723774 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a03a109-e068-4c0c-8855-bcaed68bd9cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b0b3ca4ecd41aaba9cf8e0f91fbf54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:26:02.724383 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a03a109-e068-4c0c-8855-bcaed68bd9cf service neutron] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:02.724658 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a03a109-e068-4c0c-8855-bcaed68bd9cf service neutron] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:02.724930 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a03a109-e068-4c0c-8855-bcaed68bd9cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:02.734273 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a03a109-e068-4c0c-8855-bcaed68bd9cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:26:02.735732 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a03a109-e068-4c0c-8855-bcaed68bd9cf service neutron] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:26:02.745379 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1151/2300] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:26:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:26:03.089674 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b843a17f-6903-4848-a2db-f32d507858e8 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:26:03.091189 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-b843a17f-6903-4848-a2db-f32d507858e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:26:03.099722 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:26:03.105096 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b843a17f-6903-4848-a2db-f32d507858e8 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:26:03.111241 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961f41a3-5650-4085-b857-08fb82d3a581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:26:03.112500 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f41a3-5650-4085-b857-08fb82d3a581 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:03.112500 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f41a3-5650-4085-b857-08fb82d3a581 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:03.112500 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f41a3-5650-4085-b857-08fb82d3a581 admin admin] PATH_INFO: `/v3/projects/bf5a507bd44b41f1a0eb5616018bfa1d` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:03.113548 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961f41a3-5650-4085-b857-08fb82d3a581 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf5a507bd44b41f1a0eb5616018bfa1d)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:26:03.115569 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961f41a3-5650-4085-b857-08fb82d3a581 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:26:03.168174 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-961f41a3-5650-4085-b857-08fb82d3a581 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf5a507bd44b41f1a0eb5616018bfa1d', 'request_id': 'req-961f41a3-5650-4085-b857-08fb82d3a581'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:26:03.175476 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-961f41a3-5650-4085-b857-08fb82d3a581 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf5a507bd44b41f1a0eb5616018bfa1d', 'request_id': 'req-961f41a3-5650-4085-b857-08fb82d3a581'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:26:03.183019 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-961f41a3-5650-4085-b857-08fb82d3a581 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf5a507bd44b41f1a0eb5616018bfa1d', 'request_id': 'req-961f41a3-5650-4085-b857-08fb82d3a581'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:26:03.194827 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-961f41a3-5650-4085-b857-08fb82d3a581 admin admin] The token cache is being invalidate because project bf5a507bd44b41f1a0eb5616018bfa1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81307) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 22:26:03.195043 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-961f41a3-5650-4085-b857-08fb82d3a581 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:26:03.195743 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-961f41a3-5650-4085-b857-08fb82d3a581 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:26:03.197577 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1150/2301] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 20 22:26:03 2022] DELETE /identity/v3/projects/bf5a507bd44b41f1a0eb5616018bfa1d => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:26:03.203093 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c541e54-5849-4b9a-a907-a39d5263e05f None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:03.203409 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c541e54-5849-4b9a-a907-a39d5263e05f None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:03.203681 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c541e54-5849-4b9a-a907-a39d5263e05f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:03.232149 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-4c541e54-5849-4b9a-a907-a39d5263e05f None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:26:03.234108 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-4c541e54-5849-4b9a-a907-a39d5263e05f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:26:03.252377 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:26:03.311627 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1152/2302] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:26:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 22:26:03.321034 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b9254b-c21f-4abc-a1cc-d0a56d3979d1 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:03.321524 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b9254b-c21f-4abc-a1cc-d0a56d3979d1 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:03.321605 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b9254b-c21f-4abc-a1cc-d0a56d3979d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:03.342388 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-87b9254b-c21f-4abc-a1cc-d0a56d3979d1 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:26:03.343668 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-87b9254b-c21f-4abc-a1cc-d0a56d3979d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:26:03.351802 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1151/2303] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:26:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:26:03.356347 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c541e54-5849-4b9a-a907-a39d5263e05f None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:26:03.370879 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c541e54-5849-4b9a-a907-a39d5263e05f None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:26:03.376879 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457e226d-d5bd-42b7-a9cc-0ee434a44887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:26:03.377531 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457e226d-d5bd-42b7-a9cc-0ee434a44887 admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:03.377906 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457e226d-d5bd-42b7-a9cc-0ee434a44887 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:03.378285 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457e226d-d5bd-42b7-a9cc-0ee434a44887 admin admin] PATH_INFO: `/v3/domains` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:03.379106 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457e226d-d5bd-42b7-a9cc-0ee434a44887 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:26:03.379413 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457e226d-d5bd-42b7-a9cc-0ee434a44887 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:26:03.381886 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457e226d-d5bd-42b7-a9cc-0ee434a44887 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:26:03.394548 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1153/2304] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 20 22:26:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 22:26:03.398674 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b9254b-c21f-4abc-a1cc-d0a56d3979d1 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:26:03.411509 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b9254b-c21f-4abc-a1cc-d0a56d3979d1 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:26:03.416295 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e33f30-0422-4629-878b-8142f29aa5e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:26:03.416988 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e33f30-0422-4629-878b-8142f29aa5e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:03.417265 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e33f30-0422-4629-878b-8142f29aa5e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:03.417531 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e33f30-0422-4629-878b-8142f29aa5e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:03.418264 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e33f30-0422-4629-878b-8142f29aa5e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:26:03.420479 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e33f30-0422-4629-878b-8142f29aa5e0 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:26:03.449488 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1152/2305] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 20 22:26:03 2022] POST /identity/v3/projects => generated 359 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:26:03.453644 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457e226d-d5bd-42b7-a9cc-0ee434a44887 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:26:03.463998 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457e226d-d5bd-42b7-a9cc-0ee434a44887 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:26:03.529170 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa624f5-b96f-4f29-a14b-e1aad10f2bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:26:03.529787 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa624f5-b96f-4f29-a14b-e1aad10f2bdc admin admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:03.530065 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa624f5-b96f-4f29-a14b-e1aad10f2bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:03.530338 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa624f5-b96f-4f29-a14b-e1aad10f2bdc admin admin] PATH_INFO: `/v3/users` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:03.531088 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa624f5-b96f-4f29-a14b-e1aad10f2bdc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:26:03.532996 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa624f5-b96f-4f29-a14b-e1aad10f2bdc admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:26:03.562761 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1154/2306] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 20 22:26:03 2022] POST /identity/v3/users => generated 280 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:26:03.566013 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e33f30-0422-4629-878b-8142f29aa5e0 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:26:03.589699 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e33f30-0422-4629-878b-8142f29aa5e0 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:26:03.594440 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0470f86e-52f8-47b6-9930-a7c10194060d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:26:03.595107 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0470f86e-52f8-47b6-9930-a7c10194060d admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:03.595387 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0470f86e-52f8-47b6-9930-a7c10194060d admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:03.595656 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0470f86e-52f8-47b6-9930-a7c10194060d admin admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:03.596299 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0470f86e-52f8-47b6-9930-a7c10194060d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:26:03.597944 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0470f86e-52f8-47b6-9930-a7c10194060d admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:26:03.609293 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1153/2307] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:26:03 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:26:03.615122 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa624f5-b96f-4f29-a14b-e1aad10f2bdc admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:26:03.625795 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa624f5-b96f-4f29-a14b-e1aad10f2bdc admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:26:03.630817 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031fdde9-3a39-4515-8f18-b711c025ec91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:26:03.631419 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031fdde9-3a39-4515-8f18-b711c025ec91 admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:03.631694 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031fdde9-3a39-4515-8f18-b711c025ec91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:03.631963 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031fdde9-3a39-4515-8f18-b711c025ec91 admin admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:03.632603 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031fdde9-3a39-4515-8f18-b711c025ec91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:26:03.634182 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031fdde9-3a39-4515-8f18-b711c025ec91 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:26:03.645555 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1155/2308] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:26:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:26:03.650410 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0470f86e-52f8-47b6-9930-a7c10194060d admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:26:03.661775 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0470f86e-52f8-47b6-9930-a7c10194060d admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:26:03.666714 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08899369-de89-4462-8e01-385e433514e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:26:03.667381 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08899369-de89-4462-8e01-385e433514e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:03.667696 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08899369-de89-4462-8e01-385e433514e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:03.667916 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08899369-de89-4462-8e01-385e433514e3 admin admin] PATH_INFO: `/v3/projects/32a89fb153e946728a4370b654797911/users/1fc2e80682e0485798e8bfee01989d53/roles/604444e7ad0d437dbd1f5a6e02b761f5` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:03.682966 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08899369-de89-4462-8e01-385e433514e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32a89fb153e946728a4370b654797911, user_id=1fc2e80682e0485798e8bfee01989d53, role_id=604444e7ad0d437dbd1f5a6e02b761f5)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:26:03.685580 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08899369-de89-4462-8e01-385e433514e3 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:26:03.700604 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1154/2309] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:26:03 2022] PUT /identity/v3/projects/32a89fb153e946728a4370b654797911/users/1fc2e80682e0485798e8bfee01989d53/roles/604444e7ad0d437dbd1f5a6e02b761f5 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 22:26:03.711479 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df40fe99-bd94-400b-9e47-990271449c77 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:03.711760 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df40fe99-bd94-400b-9e47-990271449c77 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:03.712030 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df40fe99-bd94-400b-9e47-990271449c77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:03.741223 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-df40fe99-bd94-400b-9e47-990271449c77 None None] MFA Rules not processed for user `1fc2e80682e0485798e8bfee01989d53`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:26:03.742435 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-df40fe99-bd94-400b-9e47-990271449c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:26:03.806413 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1156/2310] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:26:03 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 22:26:03.841278 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08899369-de89-4462-8e01-385e433514e3 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:26:03.843963 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-08899369-de89-4462-8e01-385e433514e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:26:03.902227 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08899369-de89-4462-8e01-385e433514e3 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:26:03.906461 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33be3207-48dd-4e0e-af6c-de9ffc01adc1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577c8b14c1f4279beac13b9ba11aba1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:26:03.907090 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be3207-48dd-4e0e-af6c-de9ffc01adc1 service cinder] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:03.907369 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be3207-48dd-4e0e-af6c-de9ffc01adc1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:03.907639 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be3207-48dd-4e0e-af6c-de9ffc01adc1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:03.915763 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33be3207-48dd-4e0e-af6c-de9ffc01adc1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:26:03.917170 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33be3207-48dd-4e0e-af6c-de9ffc01adc1 service cinder] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:26:03.926196 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1155/2311] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:26:03 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:26:03.941842 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df40fe99-bd94-400b-9e47-990271449c77 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:26:03.962208 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:26:04.011197 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df40fe99-bd94-400b-9e47-990271449c77 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:26:04.016796 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aca8a05-2ff9-43f4-b51b-52811b844bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:26:04.017438 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca8a05-2ff9-43f4-b51b-52811b844bca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:04.017716 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca8a05-2ff9-43f4-b51b-52811b844bca admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:04.017988 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca8a05-2ff9-43f4-b51b-52811b844bca admin admin] PATH_INFO: `/v3/users/1fc2e80682e0485798e8bfee01989d53` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:04.019152 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aca8a05-2ff9-43f4-b51b-52811b844bca admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fc2e80682e0485798e8bfee01989d53)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:26:04.021078 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aca8a05-2ff9-43f4-b51b-52811b844bca admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:26:04.073524 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-7aca8a05-2ff9-43f4-b51b-52811b844bca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fc2e80682e0485798e8bfee01989d53'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:26:04.081357 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-7aca8a05-2ff9-43f4-b51b-52811b844bca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fc2e80682e0485798e8bfee01989d53'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:26:04.081975 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-7aca8a05-2ff9-43f4-b51b-52811b844bca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fc2e80682e0485798e8bfee01989d53'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:26:04.082619 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-7aca8a05-2ff9-43f4-b51b-52811b844bca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fc2e80682e0485798e8bfee01989d53'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:26:04.089723 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-7aca8a05-2ff9-43f4-b51b-52811b844bca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fc2e80682e0485798e8bfee01989d53'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:26:04.107207 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1157/2312] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 20 22:26:03 2022] DELETE /identity/v3/users/1fc2e80682e0485798e8bfee01989d53 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:26:04.113039 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c22028c-c35a-4901-88b0-eadf8c005850 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:04.113476 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c22028c-c35a-4901-88b0-eadf8c005850 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:04.113992 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c22028c-c35a-4901-88b0-eadf8c005850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:04.133922 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-7c22028c-c35a-4901-88b0-eadf8c005850 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:26:04.135155 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-7c22028c-c35a-4901-88b0-eadf8c005850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:26:04.152963 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:26:04.198081 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1156/2313] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:26:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:26:04.207921 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aca8a05-2ff9-43f4-b51b-52811b844bca admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:26:04.209365 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-7aca8a05-2ff9-43f4-b51b-52811b844bca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:26:04.269594 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aca8a05-2ff9-43f4-b51b-52811b844bca admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:26:04.273235 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a511e46-9cd9-4660-be8b-135e312b5beb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b0b3ca4ecd41aaba9cf8e0f91fbf54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:26:04.273843 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a511e46-9cd9-4660-be8b-135e312b5beb service neutron] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:04.274121 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a511e46-9cd9-4660-be8b-135e312b5beb service neutron] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:04.274392 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a511e46-9cd9-4660-be8b-135e312b5beb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:04.283882 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a511e46-9cd9-4660-be8b-135e312b5beb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:26:04.285240 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a511e46-9cd9-4660-be8b-135e312b5beb service neutron] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:26:04.296633 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1158/2314] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:26:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:26:04.604791 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c22028c-c35a-4901-88b0-eadf8c005850 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:26:04.606424 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-7c22028c-c35a-4901-88b0-eadf8c005850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:26:04.619790 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c22028c-c35a-4901-88b0-eadf8c005850 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:26:04.626196 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758c12bd-4650-46fc-b2ad-059555f2a487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:26:04.627054 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758c12bd-4650-46fc-b2ad-059555f2a487 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:04.627475 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758c12bd-4650-46fc-b2ad-059555f2a487 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:04.627837 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758c12bd-4650-46fc-b2ad-059555f2a487 admin admin] PATH_INFO: `/v3/projects/32a89fb153e946728a4370b654797911` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:04.629061 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758c12bd-4650-46fc-b2ad-059555f2a487 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32a89fb153e946728a4370b654797911)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:26:04.631120 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758c12bd-4650-46fc-b2ad-059555f2a487 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:26:04.688887 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-758c12bd-4650-46fc-b2ad-059555f2a487 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32a89fb153e946728a4370b654797911', 'request_id': 'req-758c12bd-4650-46fc-b2ad-059555f2a487'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:26:04.703460 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-758c12bd-4650-46fc-b2ad-059555f2a487 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32a89fb153e946728a4370b654797911', 'request_id': 'req-758c12bd-4650-46fc-b2ad-059555f2a487'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:26:04.714191 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-758c12bd-4650-46fc-b2ad-059555f2a487 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32a89fb153e946728a4370b654797911', 'request_id': 'req-758c12bd-4650-46fc-b2ad-059555f2a487'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:26:04.726797 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-758c12bd-4650-46fc-b2ad-059555f2a487 admin admin] The token cache is being invalidate because project 32a89fb153e946728a4370b654797911 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81307) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 22:26:04.727120 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-758c12bd-4650-46fc-b2ad-059555f2a487 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:26:04.727747 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-758c12bd-4650-46fc-b2ad-059555f2a487 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:26:04.729541 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1157/2315] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 20 22:26:04 2022] DELETE /identity/v3/projects/32a89fb153e946728a4370b654797911 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:26:04.734236 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e3d17c-a8df-403f-bd27-58b26edca196 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:04.734539 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e3d17c-a8df-403f-bd27-58b26edca196 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:04.734830 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e3d17c-a8df-403f-bd27-58b26edca196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:04.757028 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-74e3d17c-a8df-403f-bd27-58b26edca196 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:26:04.758486 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-74e3d17c-a8df-403f-bd27-58b26edca196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:26:04.803613 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:26:04.834992 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1159/2316] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:26:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:26:04.842754 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4160421-77d1-49b2-bc99-881920031a9b None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:04.843631 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4160421-77d1-49b2-bc99-881920031a9b None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:04.843916 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4160421-77d1-49b2-bc99-881920031a9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:04.865157 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-f4160421-77d1-49b2-bc99-881920031a9b None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:26:04.866380 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-f4160421-77d1-49b2-bc99-881920031a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:26:04.876916 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1158/2317] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:26:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:26:04.879052 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e3d17c-a8df-403f-bd27-58b26edca196 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:26:04.889078 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e3d17c-a8df-403f-bd27-58b26edca196 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:26:04.894362 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d570d6-3d5d-4b58-b636-02d195b9e44d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:26:04.895000 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d570d6-3d5d-4b58-b636-02d195b9e44d admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:04.895279 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d570d6-3d5d-4b58-b636-02d195b9e44d admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:04.895548 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d570d6-3d5d-4b58-b636-02d195b9e44d admin admin] PATH_INFO: `/v3/domains` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:04.896196 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d570d6-3d5d-4b58-b636-02d195b9e44d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:26:04.896500 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d570d6-3d5d-4b58-b636-02d195b9e44d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:26:04.898084 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d570d6-3d5d-4b58-b636-02d195b9e44d admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:26:04.910194 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1160/2318] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 20 22:26:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:26:04.914628 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4160421-77d1-49b2-bc99-881920031a9b None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:26:04.924445 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4160421-77d1-49b2-bc99-881920031a9b None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:26:04.929267 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e945f0e-6cf9-421b-9f2f-5faede567d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:26:04.929899 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e945f0e-6cf9-421b-9f2f-5faede567d4d admin admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:04.930179 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e945f0e-6cf9-421b-9f2f-5faede567d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:04.930447 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e945f0e-6cf9-421b-9f2f-5faede567d4d admin admin] PATH_INFO: `/v3/projects` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:04.931112 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e945f0e-6cf9-421b-9f2f-5faede567d4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:26:04.933076 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e945f0e-6cf9-421b-9f2f-5faede567d4d admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:26:04.961126 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1159/2319] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 20 22:26:04 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:26:04.965561 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d570d6-3d5d-4b58-b636-02d195b9e44d admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:26:04.975635 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d570d6-3d5d-4b58-b636-02d195b9e44d admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:26:05.034236 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cd69e4-d981-4735-8d8a-183a68a683d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:26:05.034986 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cd69e4-d981-4735-8d8a-183a68a683d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:05.035539 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cd69e4-d981-4735-8d8a-183a68a683d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:05.035900 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cd69e4-d981-4735-8d8a-183a68a683d2 admin admin] PATH_INFO: `/v3/users` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:05.037054 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cd69e4-d981-4735-8d8a-183a68a683d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:26:05.040327 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cd69e4-d981-4735-8d8a-183a68a683d2 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:26:05.062850 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1161/2320] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 20 22:26:04 2022] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 20 22:26:05.066912 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e945f0e-6cf9-421b-9f2f-5faede567d4d admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:26:05.077325 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e945f0e-6cf9-421b-9f2f-5faede567d4d admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:26:05.082051 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365a1ac8-97ac-474e-991e-d98cd973ba39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:26:05.082691 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365a1ac8-97ac-474e-991e-d98cd973ba39 admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:05.082967 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365a1ac8-97ac-474e-991e-d98cd973ba39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:05.083242 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365a1ac8-97ac-474e-991e-d98cd973ba39 admin admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:05.083918 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365a1ac8-97ac-474e-991e-d98cd973ba39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:26:05.085581 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365a1ac8-97ac-474e-991e-d98cd973ba39 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:26:05.096544 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1160/2321] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:26:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:26:05.100859 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cd69e4-d981-4735-8d8a-183a68a683d2 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:26:05.111754 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cd69e4-d981-4735-8d8a-183a68a683d2 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:26:05.116397 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191bbf59-2ae7-476b-ad05-0233a3d73777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:26:05.116995 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191bbf59-2ae7-476b-ad05-0233a3d73777 admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:05.117272 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191bbf59-2ae7-476b-ad05-0233a3d73777 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:05.117544 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191bbf59-2ae7-476b-ad05-0233a3d73777 admin admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:05.118181 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191bbf59-2ae7-476b-ad05-0233a3d73777 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:26:05.119810 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191bbf59-2ae7-476b-ad05-0233a3d73777 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:26:05.136401 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1162/2322] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:26:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:26:05.137567 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365a1ac8-97ac-474e-991e-d98cd973ba39 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:26:05.148072 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365a1ac8-97ac-474e-991e-d98cd973ba39 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:26:05.152831 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808bb18f-3d9e-4c95-897a-d27f9f727b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:26:05.153516 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808bb18f-3d9e-4c95-897a-d27f9f727b7f admin admin] REQUEST_METHOD: `PUT` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:05.153798 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808bb18f-3d9e-4c95-897a-d27f9f727b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:05.154076 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808bb18f-3d9e-4c95-897a-d27f9f727b7f admin admin] PATH_INFO: `/v3/projects/cb81fb71dbfb4f1280c2e14570579983/users/2694ae1e62b444379e9c51dba349dd5a/roles/604444e7ad0d437dbd1f5a6e02b761f5` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:05.169770 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808bb18f-3d9e-4c95-897a-d27f9f727b7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb81fb71dbfb4f1280c2e14570579983, user_id=2694ae1e62b444379e9c51dba349dd5a, role_id=604444e7ad0d437dbd1f5a6e02b761f5)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:26:05.173177 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808bb18f-3d9e-4c95-897a-d27f9f727b7f admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:26:05.188075 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1161/2323] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:26:05 2022] PUT /identity/v3/projects/cb81fb71dbfb4f1280c2e14570579983/users/2694ae1e62b444379e9c51dba349dd5a/roles/604444e7ad0d437dbd1f5a6e02b761f5 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:26:05.199155 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7150caa8-322f-4a7b-a3ab-2da6522a69f4 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:05.199440 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7150caa8-322f-4a7b-a3ab-2da6522a69f4 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:05.199715 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7150caa8-322f-4a7b-a3ab-2da6522a69f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:05.227884 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-7150caa8-322f-4a7b-a3ab-2da6522a69f4 None None] MFA Rules not processed for user `2694ae1e62b444379e9c51dba349dd5a`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:26:05.229087 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-7150caa8-322f-4a7b-a3ab-2da6522a69f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:26:05.292238 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1163/2324] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:26:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:26:05.297450 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808bb18f-3d9e-4c95-897a-d27f9f727b7f admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:26:05.343477 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:26:05.361070 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808bb18f-3d9e-4c95-897a-d27f9f727b7f admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:26:05.365689 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f63c03-6660-4ca3-b2d7-c6b3ee7c1783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:26:05.366291 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f63c03-6660-4ca3-b2d7-c6b3ee7c1783 admin admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:05.366601 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f63c03-6660-4ca3-b2d7-c6b3ee7c1783 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:05.366873 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f63c03-6660-4ca3-b2d7-c6b3ee7c1783 admin admin] PATH_INFO: `/v3/projects` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:05.367507 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f63c03-6660-4ca3-b2d7-c6b3ee7c1783 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:26:05.369452 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f63c03-6660-4ca3-b2d7-c6b3ee7c1783 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:26:05.396364 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1162/2325] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 20 22:26:05 2022] POST /identity/v3/projects => generated 377 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 20 22:26:05.400401 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7150caa8-322f-4a7b-a3ab-2da6522a69f4 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:26:05.410922 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7150caa8-322f-4a7b-a3ab-2da6522a69f4 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:26:05.444868 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:26:05.470894 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e972d6-2a51-43e4-b4dd-cd7a80c5887b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:26:05.471606 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e972d6-2a51-43e4-b4dd-cd7a80c5887b admin admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:05.471977 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e972d6-2a51-43e4-b4dd-cd7a80c5887b admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:05.472329 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e972d6-2a51-43e4-b4dd-cd7a80c5887b admin admin] PATH_INFO: `/v3/users` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:05.472965 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e972d6-2a51-43e4-b4dd-cd7a80c5887b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:26:05.475107 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e972d6-2a51-43e4-b4dd-cd7a80c5887b admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:26:05.496953 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1164/2326] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 20 22:26:05 2022] POST /identity/v3/users => generated 289 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 20 22:26:05.501785 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f63c03-6660-4ca3-b2d7-c6b3ee7c1783 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:26:05.516043 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f63c03-6660-4ca3-b2d7-c6b3ee7c1783 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:26:05.522174 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaf1fe6-dc43-405c-be56-ac4ed54ba578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:26:05.523891 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaf1fe6-dc43-405c-be56-ac4ed54ba578 admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:05.524184 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaf1fe6-dc43-405c-be56-ac4ed54ba578 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:05.524462 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaf1fe6-dc43-405c-be56-ac4ed54ba578 admin admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:05.525494 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaf1fe6-dc43-405c-be56-ac4ed54ba578 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:26:05.527146 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaf1fe6-dc43-405c-be56-ac4ed54ba578 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:26:05.539684 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1163/2327] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:26:05 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:26:05.544404 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e972d6-2a51-43e4-b4dd-cd7a80c5887b admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:26:05.555036 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e972d6-2a51-43e4-b4dd-cd7a80c5887b admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:26:05.559603 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd4e7a3-d29d-48bb-aab9-e39dfdd9599c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:26:05.560203 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd4e7a3-d29d-48bb-aab9-e39dfdd9599c admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:05.560477 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd4e7a3-d29d-48bb-aab9-e39dfdd9599c admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:05.560744 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd4e7a3-d29d-48bb-aab9-e39dfdd9599c admin admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:05.561377 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd4e7a3-d29d-48bb-aab9-e39dfdd9599c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:26:05.563575 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd4e7a3-d29d-48bb-aab9-e39dfdd9599c admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:26:05.573284 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1165/2328] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:26:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:26:05.577949 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaf1fe6-dc43-405c-be56-ac4ed54ba578 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:26:05.589830 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaf1fe6-dc43-405c-be56-ac4ed54ba578 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:26:05.595229 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f6be1f-a43f-4fb4-8d70-790c29f1ad49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:26:05.595903 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f6be1f-a43f-4fb4-8d70-790c29f1ad49 admin admin] REQUEST_METHOD: `PUT` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:05.596183 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f6be1f-a43f-4fb4-8d70-790c29f1ad49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:05.596451 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f6be1f-a43f-4fb4-8d70-790c29f1ad49 admin admin] PATH_INFO: `/v3/projects/4c7aa0a36e654ac3bcc6f3fedd7e8f82/users/17e75a5611bb4bcba6f417727e9b66e6/roles/604444e7ad0d437dbd1f5a6e02b761f5` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:05.613269 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f6be1f-a43f-4fb4-8d70-790c29f1ad49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c7aa0a36e654ac3bcc6f3fedd7e8f82, user_id=17e75a5611bb4bcba6f417727e9b66e6, role_id=604444e7ad0d437dbd1f5a6e02b761f5)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:26:05.616105 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f6be1f-a43f-4fb4-8d70-790c29f1ad49 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:26:05.638489 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1164/2329] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:26:05 2022] PUT /identity/v3/projects/4c7aa0a36e654ac3bcc6f3fedd7e8f82/users/17e75a5611bb4bcba6f417727e9b66e6/roles/604444e7ad0d437dbd1f5a6e02b761f5 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:26:05.649255 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d01eb0b-e49f-4565-b94f-f5472af9e3e4 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:05.649539 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d01eb0b-e49f-4565-b94f-f5472af9e3e4 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:05.649814 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d01eb0b-e49f-4565-b94f-f5472af9e3e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:05.689111 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-8d01eb0b-e49f-4565-b94f-f5472af9e3e4 None None] MFA Rules not processed for user `17e75a5611bb4bcba6f417727e9b66e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:26:05.690335 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-8d01eb0b-e49f-4565-b94f-f5472af9e3e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:26:05.762969 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1166/2330] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:26:05 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:26:05.768127 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f6be1f-a43f-4fb4-8d70-790c29f1ad49 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:26:05.843519 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f6be1f-a43f-4fb4-8d70-790c29f1ad49 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:26:05.848232 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76edfedf-104a-4e51-b7ae-2a0e903e21df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:26:05.848843 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76edfedf-104a-4e51-b7ae-2a0e903e21df admin admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:05.849120 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76edfedf-104a-4e51-b7ae-2a0e903e21df admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:05.849389 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76edfedf-104a-4e51-b7ae-2a0e903e21df admin admin] PATH_INFO: `/v3/projects` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:05.850019 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76edfedf-104a-4e51-b7ae-2a0e903e21df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:26:05.851931 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76edfedf-104a-4e51-b7ae-2a0e903e21df admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:26:05.891459 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1165/2331] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 20 22:26:05 2022] POST /identity/v3/projects => generated 377 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:26:05.895374 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d01eb0b-e49f-4565-b94f-f5472af9e3e4 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:26:05.914809 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d01eb0b-e49f-4565-b94f-f5472af9e3e4 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:26:05.993978 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e06d22-9b60-4666-9dc3-cb0c7e7cd5ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:26:05.995225 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e06d22-9b60-4666-9dc3-cb0c7e7cd5ff admin admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:05.995507 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e06d22-9b60-4666-9dc3-cb0c7e7cd5ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:05.995780 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e06d22-9b60-4666-9dc3-cb0c7e7cd5ff admin admin] PATH_INFO: `/v3/users` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:05.996419 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e06d22-9b60-4666-9dc3-cb0c7e7cd5ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:26:06.000139 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e06d22-9b60-4666-9dc3-cb0c7e7cd5ff admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:26:06.025952 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1167/2332] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 20 22:26:05 2022] POST /identity/v3/users => generated 295 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:26:06.030221 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76edfedf-104a-4e51-b7ae-2a0e903e21df admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:26:06.043519 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76edfedf-104a-4e51-b7ae-2a0e903e21df admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:26:06.048695 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c1ae77-6da2-4d1f-ab67-0cb43fdf2ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:26:06.049378 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c1ae77-6da2-4d1f-ab67-0cb43fdf2ded admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:06.049732 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c1ae77-6da2-4d1f-ab67-0cb43fdf2ded admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:06.050129 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c1ae77-6da2-4d1f-ab67-0cb43fdf2ded admin admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:06.050811 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c1ae77-6da2-4d1f-ab67-0cb43fdf2ded admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:26:06.052410 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c1ae77-6da2-4d1f-ab67-0cb43fdf2ded admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:26:06.064207 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1166/2333] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:26:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 20 22:26:06.068197 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e06d22-9b60-4666-9dc3-cb0c7e7cd5ff admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:26:06.078702 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e06d22-9b60-4666-9dc3-cb0c7e7cd5ff admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:26:06.083940 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7bf2af-1f0b-4a32-9445-acdc29737e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:26:06.084628 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7bf2af-1f0b-4a32-9445-acdc29737e72 admin admin] REQUEST_METHOD: `PUT` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:06.084911 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7bf2af-1f0b-4a32-9445-acdc29737e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:06.085187 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7bf2af-1f0b-4a32-9445-acdc29737e72 admin admin] PATH_INFO: `/v3/projects/d581561f0b784836b670deb0231737e9/users/1ef3b65932d64800b55c031f8f172a58/roles/8a829170b29d42d6af589399e51edb0f` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:06.100672 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7bf2af-1f0b-4a32-9445-acdc29737e72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d581561f0b784836b670deb0231737e9, user_id=1ef3b65932d64800b55c031f8f172a58, role_id=8a829170b29d42d6af589399e51edb0f)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:26:06.103485 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7bf2af-1f0b-4a32-9445-acdc29737e72 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:26:06.118307 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1168/2334] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:26:06 2022] PUT /identity/v3/projects/d581561f0b784836b670deb0231737e9/users/1ef3b65932d64800b55c031f8f172a58/roles/8a829170b29d42d6af589399e51edb0f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:26:06.122164 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c1ae77-6da2-4d1f-ab67-0cb43fdf2ded admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:26:06.133133 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c1ae77-6da2-4d1f-ab67-0cb43fdf2ded admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:26:06.222432 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0290c3d-080e-454f-b6af-90dcb077f2bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:26:06.223246 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0290c3d-080e-454f-b6af-90dcb077f2bc admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:06.223553 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0290c3d-080e-454f-b6af-90dcb077f2bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:06.223808 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0290c3d-080e-454f-b6af-90dcb077f2bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:06.224610 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0290c3d-080e-454f-b6af-90dcb077f2bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:26:06.227267 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0290c3d-080e-454f-b6af-90dcb077f2bc admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:26:06.238550 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1167/2335] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:26:06 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:26:06.241229 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7bf2af-1f0b-4a32-9445-acdc29737e72 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:26:06.253175 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7bf2af-1f0b-4a32-9445-acdc29737e72 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:26:06.258770 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1847e2ce-cdfb-4dc9-8def-8b3fda4c7f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:26:06.259438 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1847e2ce-cdfb-4dc9-8def-8b3fda4c7f83 admin admin] REQUEST_METHOD: `PUT` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:06.259715 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1847e2ce-cdfb-4dc9-8def-8b3fda4c7f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:06.259987 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1847e2ce-cdfb-4dc9-8def-8b3fda4c7f83 admin admin] PATH_INFO: `/v3/projects/d581561f0b784836b670deb0231737e9/users/1ef3b65932d64800b55c031f8f172a58/roles/8a829170b29d42d6af589399e51edb0f` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:06.261893 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1847e2ce-cdfb-4dc9-8def-8b3fda4c7f83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d581561f0b784836b670deb0231737e9, user_id=1ef3b65932d64800b55c031f8f172a58, role_id=8a829170b29d42d6af589399e51edb0f)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:26:06.264560 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1847e2ce-cdfb-4dc9-8def-8b3fda4c7f83 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:26:06.268415 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:26:06.276888 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1169/2336] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:26:06 2022] PUT /identity/v3/projects/d581561f0b784836b670deb0231737e9/users/1ef3b65932d64800b55c031f8f172a58/roles/8a829170b29d42d6af589399e51edb0f => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 22:26:06.287572 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc39a5b-3605-4d5d-b96b-4286da82f70f None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:06.287897 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc39a5b-3605-4d5d-b96b-4286da82f70f None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:06.288177 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc39a5b-3605-4d5d-b96b-4286da82f70f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:06.302710 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:26:06.321985 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-5fc39a5b-3605-4d5d-b96b-4286da82f70f None None] MFA Rules not processed for user `1ef3b65932d64800b55c031f8f172a58`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:26:06.323227 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-5fc39a5b-3605-4d5d-b96b-4286da82f70f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:26:06.395818 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1168/2337] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:26:06 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:26:06.407423 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1847e2ce-cdfb-4dc9-8def-8b3fda4c7f83 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:26:06.409122 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-1847e2ce-cdfb-4dc9-8def-8b3fda4c7f83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:26:06.474903 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1847e2ce-cdfb-4dc9-8def-8b3fda4c7f83 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:26:06.478641 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aba016-6543-41a9-9b6b-a79e5fd3adea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577c8b14c1f4279beac13b9ba11aba1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:26:06.479261 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aba016-6543-41a9-9b6b-a79e5fd3adea service cinder] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:06.479538 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aba016-6543-41a9-9b6b-a79e5fd3adea service cinder] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:06.479812 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aba016-6543-41a9-9b6b-a79e5fd3adea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:06.541525 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aba016-6543-41a9-9b6b-a79e5fd3adea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:26:06.543039 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aba016-6543-41a9-9b6b-a79e5fd3adea service cinder] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:26:06.553585 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1170/2338] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:26:06 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:26:08.092203 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc39a5b-3605-4d5d-b96b-4286da82f70f None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:26:08.102568 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc39a5b-3605-4d5d-b96b-4286da82f70f None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:26:08.106316 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e7109c-0d66-45ce-8942-ce995e46b59d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577c8b14c1f4279beac13b9ba11aba1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:26:08.106962 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e7109c-0d66-45ce-8942-ce995e46b59d service cinder] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:08.107236 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e7109c-0d66-45ce-8942-ce995e46b59d service cinder] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:08.107501 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e7109c-0d66-45ce-8942-ce995e46b59d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:08.165224 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e7109c-0d66-45ce-8942-ce995e46b59d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:26:08.166682 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e7109c-0d66-45ce-8942-ce995e46b59d service cinder] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:26:08.176655 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1169/2339] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:26:08 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:26:08.743125 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aba016-6543-41a9-9b6b-a79e5fd3adea service cinder] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:26:08.752151 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aba016-6543-41a9-9b6b-a79e5fd3adea service cinder] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:26:08.755756 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fb7122-d36c-4c23-9976-962bdd4b7086 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577c8b14c1f4279beac13b9ba11aba1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:26:08.756355 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fb7122-d36c-4c23-9976-962bdd4b7086 service cinder] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:08.756635 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fb7122-d36c-4c23-9976-962bdd4b7086 service cinder] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:08.756908 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fb7122-d36c-4c23-9976-962bdd4b7086 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:08.766602 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fb7122-d36c-4c23-9976-962bdd4b7086 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:26:08.768008 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fb7122-d36c-4c23-9976-962bdd4b7086 service cinder] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:26:08.777220 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1171/2340] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:26:08 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:26:09.515571 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c49496b-5098-4b24-9fde-4e0f0e5e9847 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:09.516106 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c49496b-5098-4b24-9fde-4e0f0e5e9847 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:09.516106 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c49496b-5098-4b24-9fde-4e0f0e5e9847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:09.536082 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-0c49496b-5098-4b24-9fde-4e0f0e5e9847 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:26:09.537289 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-0c49496b-5098-4b24-9fde-4e0f0e5e9847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:26:09.597998 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1170/2341] 10.222.0.50 () {58 vars in 1016 bytes} [Tue Sep 20 22:26:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:26:09.613729 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fb7122-d36c-4c23-9976-962bdd4b7086 service cinder] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:26:09.615177 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-55fb7122-d36c-4c23-9976-962bdd4b7086 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:26:09.692315 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fb7122-d36c-4c23-9976-962bdd4b7086 service cinder] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:26:09.698150 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df415a54-3100-4268-9e97-9b999db9b8ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db7eed561e99452289a662ad326cf919', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:26:09.698795 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df415a54-3100-4268-9e97-9b999db9b8ad service nova] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:09.699070 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df415a54-3100-4268-9e97-9b999db9b8ad service nova] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:09.699336 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df415a54-3100-4268-9e97-9b999db9b8ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:09.708159 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df415a54-3100-4268-9e97-9b999db9b8ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:26:09.711411 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df415a54-3100-4268-9e97-9b999db9b8ad service nova] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:26:09.724639 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1172/2342] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:26:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:26:12.669063 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c49496b-5098-4b24-9fde-4e0f0e5e9847 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:26:12.680411 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c49496b-5098-4b24-9fde-4e0f0e5e9847 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:26:12.685477 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3624226a-e391-46f4-a085-35d2f8cd8175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:26:12.686957 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3624226a-e391-46f4-a085-35d2f8cd8175 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:12.687388 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3624226a-e391-46f4-a085-35d2f8cd8175 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:12.687660 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3624226a-e391-46f4-a085-35d2f8cd8175 admin admin] PATH_INFO: `/v3/users/2694ae1e62b444379e9c51dba349dd5a` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:12.688852 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3624226a-e391-46f4-a085-35d2f8cd8175 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2694ae1e62b444379e9c51dba349dd5a)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:26:12.690730 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3624226a-e391-46f4-a085-35d2f8cd8175 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:26:12.714418 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:26:12.739416 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-3624226a-e391-46f4-a085-35d2f8cd8175 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2694ae1e62b444379e9c51dba349dd5a'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:26:12.747340 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-3624226a-e391-46f4-a085-35d2f8cd8175 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2694ae1e62b444379e9c51dba349dd5a'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:26:12.747986 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-3624226a-e391-46f4-a085-35d2f8cd8175 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2694ae1e62b444379e9c51dba349dd5a'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:26:12.748591 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-3624226a-e391-46f4-a085-35d2f8cd8175 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2694ae1e62b444379e9c51dba349dd5a'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:26:12.756685 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-3624226a-e391-46f4-a085-35d2f8cd8175 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2694ae1e62b444379e9c51dba349dd5a'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:26:12.775474 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1171/2343] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 20 22:26:12 2022] DELETE /identity/v3/users/2694ae1e62b444379e9c51dba349dd5a => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:26:12.780047 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4786213-5e15-4aaf-9819-00c8c684c834 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:12.780517 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4786213-5e15-4aaf-9819-00c8c684c834 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:12.780638 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4786213-5e15-4aaf-9819-00c8c684c834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:12.801414 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-f4786213-5e15-4aaf-9819-00c8c684c834 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:26:12.802642 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-f4786213-5e15-4aaf-9819-00c8c684c834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:26:12.820031 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:26:12.864583 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1173/2344] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:26:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 22:26:12.874980 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3624226a-e391-46f4-a085-35d2f8cd8175 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:26:12.876464 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-3624226a-e391-46f4-a085-35d2f8cd8175 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:26:12.940489 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3624226a-e391-46f4-a085-35d2f8cd8175 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:26:12.945571 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475031d3-ffad-49d7-864a-5819061b9e74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b0b3ca4ecd41aaba9cf8e0f91fbf54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:26:12.946183 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475031d3-ffad-49d7-864a-5819061b9e74 service neutron] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:12.946457 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475031d3-ffad-49d7-864a-5819061b9e74 service neutron] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:12.946751 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475031d3-ffad-49d7-864a-5819061b9e74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:12.956314 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475031d3-ffad-49d7-864a-5819061b9e74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:26:12.957737 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475031d3-ffad-49d7-864a-5819061b9e74 service neutron] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:26:12.967774 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1172/2345] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:26:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:26:13.255379 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4786213-5e15-4aaf-9819-00c8c684c834 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:26:13.257167 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-f4786213-5e15-4aaf-9819-00c8c684c834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:26:13.271870 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4786213-5e15-4aaf-9819-00c8c684c834 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:26:13.285390 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcc10b3-6f63-4a84-8d15-28cb2eb9cb2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:26:13.286045 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcc10b3-6f63-4a84-8d15-28cb2eb9cb2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:13.286372 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcc10b3-6f63-4a84-8d15-28cb2eb9cb2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:13.286612 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcc10b3-6f63-4a84-8d15-28cb2eb9cb2a admin admin] PATH_INFO: `/v3/projects/cb81fb71dbfb4f1280c2e14570579983` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:13.288752 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcc10b3-6f63-4a84-8d15-28cb2eb9cb2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb81fb71dbfb4f1280c2e14570579983)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:26:13.291157 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcc10b3-6f63-4a84-8d15-28cb2eb9cb2a admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:26:13.355648 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-8fcc10b3-6f63-4a84-8d15-28cb2eb9cb2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb81fb71dbfb4f1280c2e14570579983', 'request_id': 'req-8fcc10b3-6f63-4a84-8d15-28cb2eb9cb2a'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:26:13.363229 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-8fcc10b3-6f63-4a84-8d15-28cb2eb9cb2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb81fb71dbfb4f1280c2e14570579983', 'request_id': 'req-8fcc10b3-6f63-4a84-8d15-28cb2eb9cb2a'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:26:13.372184 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-8fcc10b3-6f63-4a84-8d15-28cb2eb9cb2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb81fb71dbfb4f1280c2e14570579983', 'request_id': 'req-8fcc10b3-6f63-4a84-8d15-28cb2eb9cb2a'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:26:13.384216 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-8fcc10b3-6f63-4a84-8d15-28cb2eb9cb2a admin admin] The token cache is being invalidate because project cb81fb71dbfb4f1280c2e14570579983 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81306) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 22:26:13.384577 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-8fcc10b3-6f63-4a84-8d15-28cb2eb9cb2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:26:13.385280 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-8fcc10b3-6f63-4a84-8d15-28cb2eb9cb2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:26:13.387019 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1174/2346] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 20 22:26:13 2022] DELETE /identity/v3/projects/cb81fb71dbfb4f1280c2e14570579983 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:26:13.391703 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475031d3-ffad-49d7-864a-5819061b9e74 service neutron] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:26:13.402856 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475031d3-ffad-49d7-864a-5819061b9e74 service neutron] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:26:13.468366 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dc3cd2-1701-45c9-8022-e87bc107d539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:26:13.469006 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dc3cd2-1701-45c9-8022-e87bc107d539 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:13.469289 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dc3cd2-1701-45c9-8022-e87bc107d539 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:13.469570 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dc3cd2-1701-45c9-8022-e87bc107d539 admin admin] PATH_INFO: `/v3/users/17e75a5611bb4bcba6f417727e9b66e6` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:13.470944 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dc3cd2-1701-45c9-8022-e87bc107d539 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17e75a5611bb4bcba6f417727e9b66e6)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:26:13.472866 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dc3cd2-1701-45c9-8022-e87bc107d539 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:26:13.522019 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:26:13.524207 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-00dc3cd2-1701-45c9-8022-e87bc107d539 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17e75a5611bb4bcba6f417727e9b66e6'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:26:13.534191 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-00dc3cd2-1701-45c9-8022-e87bc107d539 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17e75a5611bb4bcba6f417727e9b66e6'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:26:13.535083 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-00dc3cd2-1701-45c9-8022-e87bc107d539 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17e75a5611bb4bcba6f417727e9b66e6'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:26:13.535692 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-00dc3cd2-1701-45c9-8022-e87bc107d539 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17e75a5611bb4bcba6f417727e9b66e6'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:26:13.542843 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-00dc3cd2-1701-45c9-8022-e87bc107d539 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17e75a5611bb4bcba6f417727e9b66e6'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:26:13.562085 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1173/2347] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 20 22:26:13 2022] DELETE /identity/v3/users/17e75a5611bb4bcba6f417727e9b66e6 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:26:13.853309 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcc10b3-6f63-4a84-8d15-28cb2eb9cb2a admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:26:13.855462 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-8fcc10b3-6f63-4a84-8d15-28cb2eb9cb2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:26:13.873198 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcc10b3-6f63-4a84-8d15-28cb2eb9cb2a admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:26:13.934262 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e18dbfe-59d6-4281-ba71-81ffa268e43d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:26:13.934935 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e18dbfe-59d6-4281-ba71-81ffa268e43d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:13.935218 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e18dbfe-59d6-4281-ba71-81ffa268e43d admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:13.935491 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e18dbfe-59d6-4281-ba71-81ffa268e43d admin admin] PATH_INFO: `/v3/projects/4c7aa0a36e654ac3bcc6f3fedd7e8f82` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:13.937274 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e18dbfe-59d6-4281-ba71-81ffa268e43d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c7aa0a36e654ac3bcc6f3fedd7e8f82)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:26:13.939222 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e18dbfe-59d6-4281-ba71-81ffa268e43d admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:26:13.985475 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:26:13.987570 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-3e18dbfe-59d6-4281-ba71-81ffa268e43d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c7aa0a36e654ac3bcc6f3fedd7e8f82', 'request_id': 'req-3e18dbfe-59d6-4281-ba71-81ffa268e43d'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:26:13.996141 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-3e18dbfe-59d6-4281-ba71-81ffa268e43d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c7aa0a36e654ac3bcc6f3fedd7e8f82', 'request_id': 'req-3e18dbfe-59d6-4281-ba71-81ffa268e43d'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:26:14.004888 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-3e18dbfe-59d6-4281-ba71-81ffa268e43d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c7aa0a36e654ac3bcc6f3fedd7e8f82', 'request_id': 'req-3e18dbfe-59d6-4281-ba71-81ffa268e43d'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:26:14.016581 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-3e18dbfe-59d6-4281-ba71-81ffa268e43d admin admin] The token cache is being invalidate because project 4c7aa0a36e654ac3bcc6f3fedd7e8f82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81306) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 22:26:14.016988 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-3e18dbfe-59d6-4281-ba71-81ffa268e43d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:26:14.017664 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-3e18dbfe-59d6-4281-ba71-81ffa268e43d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:26:14.019187 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1175/2348] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 20 22:26:13 2022] DELETE /identity/v3/projects/4c7aa0a36e654ac3bcc6f3fedd7e8f82 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:26:14.023184 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dc3cd2-1701-45c9-8022-e87bc107d539 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:26:14.024620 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-00dc3cd2-1701-45c9-8022-e87bc107d539 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:26:14.037773 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dc3cd2-1701-45c9-8022-e87bc107d539 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:26:14.096934 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeb7b9c-775d-4b6a-bc98-de9858ebcf7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:26:14.097582 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeb7b9c-775d-4b6a-bc98-de9858ebcf7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:14.097870 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeb7b9c-775d-4b6a-bc98-de9858ebcf7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:14.098166 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeb7b9c-775d-4b6a-bc98-de9858ebcf7a admin admin] PATH_INFO: `/v3/users/1ef3b65932d64800b55c031f8f172a58` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:14.099308 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeb7b9c-775d-4b6a-bc98-de9858ebcf7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ef3b65932d64800b55c031f8f172a58)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:26:14.101260 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeb7b9c-775d-4b6a-bc98-de9858ebcf7a admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:26:14.149700 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-dfeb7b9c-775d-4b6a-bc98-de9858ebcf7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ef3b65932d64800b55c031f8f172a58'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:26:14.157171 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-dfeb7b9c-775d-4b6a-bc98-de9858ebcf7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ef3b65932d64800b55c031f8f172a58'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:26:14.158676 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-dfeb7b9c-775d-4b6a-bc98-de9858ebcf7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ef3b65932d64800b55c031f8f172a58'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:26:14.159355 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-dfeb7b9c-775d-4b6a-bc98-de9858ebcf7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ef3b65932d64800b55c031f8f172a58'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:26:14.167330 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-dfeb7b9c-775d-4b6a-bc98-de9858ebcf7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ef3b65932d64800b55c031f8f172a58'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:26:14.187726 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1174/2349] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 20 22:26:14 2022] DELETE /identity/v3/users/1ef3b65932d64800b55c031f8f172a58 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:26:14.401482 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d22df49-db14-4a90-9565-6cc98ca1afb0 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:14.402134 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d22df49-db14-4a90-9565-6cc98ca1afb0 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:14.402581 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d22df49-db14-4a90-9565-6cc98ca1afb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:14.425498 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-3d22df49-db14-4a90-9565-6cc98ca1afb0 None None] MFA Rules not processed for user `e916748fdee84c34af034e75a919b986`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:26:14.427300 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-3d22df49-db14-4a90-9565-6cc98ca1afb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:26:14.490005 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1176/2350] 10.222.0.33 () {58 vars in 1009 bytes} [Tue Sep 20 22:26:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:26:14.535043 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeb7b9c-775d-4b6a-bc98-de9858ebcf7a admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:26:14.537095 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-dfeb7b9c-775d-4b6a-bc98-de9858ebcf7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:26:14.591369 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:26:14.600611 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d22df49-db14-4a90-9565-6cc98ca1afb0 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:26:14.601961 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-3d22df49-db14-4a90-9565-6cc98ca1afb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:26:14.639901 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeb7b9c-775d-4b6a-bc98-de9858ebcf7a admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:26:14.656852 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739f476d-e994-4be1-b909-1c8b18de73b7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '257983500d7b430c8f0377b2aa743ae0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:26:14.657164 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f476d-e994-4be1-b909-1c8b18de73b7 service swift] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:14.658701 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f476d-e994-4be1-b909-1c8b18de73b7 service swift] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:14.659023 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f476d-e994-4be1-b909-1c8b18de73b7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:14.679952 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739f476d-e994-4be1-b909-1c8b18de73b7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:26:14.681649 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739f476d-e994-4be1-b909-1c8b18de73b7 service swift] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:26:14.691271 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1175/2351] 10.222.0.33 () {60 vars in 1384 bytes} [Tue Sep 20 22:26:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 20 22:26:14.698293 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d22df49-db14-4a90-9565-6cc98ca1afb0 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:26:14.704670 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba041ebf-a0fa-40d3-9158-902b317aa7ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:26:14.705389 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba041ebf-a0fa-40d3-9158-902b317aa7ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:14.705740 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba041ebf-a0fa-40d3-9158-902b317aa7ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:14.706085 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba041ebf-a0fa-40d3-9158-902b317aa7ab admin admin] PATH_INFO: `/v3/projects/d581561f0b784836b670deb0231737e9` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:14.707530 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba041ebf-a0fa-40d3-9158-902b317aa7ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=d581561f0b784836b670deb0231737e9)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:26:14.709913 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba041ebf-a0fa-40d3-9158-902b317aa7ab admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:26:14.783899 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcb04a6-4f8f-4618-a70b-78119c8cfb44 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:14.784202 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcb04a6-4f8f-4618-a70b-78119c8cfb44 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:14.784484 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcb04a6-4f8f-4618-a70b-78119c8cfb44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:14.814711 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-7bcb04a6-4f8f-4618-a70b-78119c8cfb44 None None] MFA Rules not processed for user `fb0b83edd8754e659729e05787f3bf4d`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:26:14.815947 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-7bcb04a6-4f8f-4618-a70b-78119c8cfb44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:26:14.816072 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-ba041ebf-a0fa-40d3-9158-902b317aa7ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd581561f0b784836b670deb0231737e9', 'request_id': 'req-ba041ebf-a0fa-40d3-9158-902b317aa7ab'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:26:14.823501 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-ba041ebf-a0fa-40d3-9158-902b317aa7ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd581561f0b784836b670deb0231737e9', 'request_id': 'req-ba041ebf-a0fa-40d3-9158-902b317aa7ab'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:26:14.832078 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-ba041ebf-a0fa-40d3-9158-902b317aa7ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd581561f0b784836b670deb0231737e9', 'request_id': 'req-ba041ebf-a0fa-40d3-9158-902b317aa7ab'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:26:14.854653 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-ba041ebf-a0fa-40d3-9158-902b317aa7ab admin admin] The token cache is being invalidate because project d581561f0b784836b670deb0231737e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81306) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 22:26:14.856152 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-ba041ebf-a0fa-40d3-9158-902b317aa7ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:26:14.858643 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-ba041ebf-a0fa-40d3-9158-902b317aa7ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:26:14.862840 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1177/2352] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 20 22:26:14 2022] DELETE /identity/v3/projects/d581561f0b784836b670deb0231737e9 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 22:26:14.867579 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751d9a19-e5e7-41f7-8e9f-3d1afb380581 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:14.869602 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751d9a19-e5e7-41f7-8e9f-3d1afb380581 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:14.869993 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751d9a19-e5e7-41f7-8e9f-3d1afb380581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:14.901895 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1176/2353] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:26:14 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:26:14.911600 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-751d9a19-e5e7-41f7-8e9f-3d1afb380581 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:26:14.913032 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-751d9a19-e5e7-41f7-8e9f-3d1afb380581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:26:14.920526 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:26:14.992762 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1178/2354] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:26:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:26:15.000998 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4856c561-bc12-4532-ada5-022a5a611819 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:15.001292 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4856c561-bc12-4532-ada5-022a5a611819 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:15.001953 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4856c561-bc12-4532-ada5-022a5a611819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:15.029449 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-4856c561-bc12-4532-ada5-022a5a611819 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:26:15.031521 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-4856c561-bc12-4532-ada5-022a5a611819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:26:15.045232 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751d9a19-e5e7-41f7-8e9f-3d1afb380581 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:26:15.049993 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1177/2355] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:26:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:26:15.055679 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751d9a19-e5e7-41f7-8e9f-3d1afb380581 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:26:15.065168 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dc446e-2077-4903-b2e8-7d61404e9063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:26:15.065875 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc446e-2077-4903-b2e8-7d61404e9063 admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:15.066158 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc446e-2077-4903-b2e8-7d61404e9063 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:15.066432 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc446e-2077-4903-b2e8-7d61404e9063 admin admin] PATH_INFO: `/v3/domains` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:15.067126 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dc446e-2077-4903-b2e8-7d61404e9063 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:26:15.067433 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dc446e-2077-4903-b2e8-7d61404e9063 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:26:15.069058 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dc446e-2077-4903-b2e8-7d61404e9063 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:26:15.087787 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4856c561-bc12-4532-ada5-022a5a611819 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:26:15.092279 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1179/2356] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 20 22:26:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:26:15.102744 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4856c561-bc12-4532-ada5-022a5a611819 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:26:15.115262 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf9825a-489e-4b9b-8e45-74c4f95939b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:26:15.120341 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf9825a-489e-4b9b-8e45-74c4f95939b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:15.120791 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf9825a-489e-4b9b-8e45-74c4f95939b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:15.121562 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf9825a-489e-4b9b-8e45-74c4f95939b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:15.122638 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf9825a-489e-4b9b-8e45-74c4f95939b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:26:15.125827 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf9825a-489e-4b9b-8e45-74c4f95939b7 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:26:15.163797 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1178/2357] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 20 22:26:15 2022] POST /identity/v3/projects => generated 373 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 20 22:26:15.167590 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dc446e-2077-4903-b2e8-7d61404e9063 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:26:15.180757 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dc446e-2077-4903-b2e8-7d61404e9063 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:26:15.256082 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa46a67-30fc-412a-a40a-4fbc982efae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:26:15.257912 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa46a67-30fc-412a-a40a-4fbc982efae8 admin admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:15.258398 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa46a67-30fc-412a-a40a-4fbc982efae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:15.258857 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa46a67-30fc-412a-a40a-4fbc982efae8 admin admin] PATH_INFO: `/v3/users` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:15.259674 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa46a67-30fc-412a-a40a-4fbc982efae8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:26:15.261982 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa46a67-30fc-412a-a40a-4fbc982efae8 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:26:15.293887 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1180/2358] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 20 22:26:15 2022] POST /identity/v3/users => generated 287 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:26:15.307746 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf9825a-489e-4b9b-8e45-74c4f95939b7 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:26:15.321358 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf9825a-489e-4b9b-8e45-74c4f95939b7 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:26:15.326491 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da6f413-3bf7-4f6a-ad6e-fafa22096cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:26:15.327662 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da6f413-3bf7-4f6a-ad6e-fafa22096cb8 admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:15.327939 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da6f413-3bf7-4f6a-ad6e-fafa22096cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:15.328218 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da6f413-3bf7-4f6a-ad6e-fafa22096cb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:15.328851 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da6f413-3bf7-4f6a-ad6e-fafa22096cb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:26:15.330447 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da6f413-3bf7-4f6a-ad6e-fafa22096cb8 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:26:15.342061 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1179/2359] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:26:15 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:26:15.346168 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa46a67-30fc-412a-a40a-4fbc982efae8 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:26:15.356895 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa46a67-30fc-412a-a40a-4fbc982efae8 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:26:15.363214 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fb0a8f-c857-4490-a84b-9b59134cced0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:26:15.364245 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fb0a8f-c857-4490-a84b-9b59134cced0 admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:15.364753 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fb0a8f-c857-4490-a84b-9b59134cced0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:15.365028 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fb0a8f-c857-4490-a84b-9b59134cced0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:15.366146 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fb0a8f-c857-4490-a84b-9b59134cced0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:26:15.368217 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fb0a8f-c857-4490-a84b-9b59134cced0 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:26:15.385940 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1181/2360] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:26:15 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:26:15.387463 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da6f413-3bf7-4f6a-ad6e-fafa22096cb8 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:26:15.401403 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da6f413-3bf7-4f6a-ad6e-fafa22096cb8 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:26:15.408725 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2be34e5-dde9-45c6-9cdb-60203d5b3f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:26:15.409902 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2be34e5-dde9-45c6-9cdb-60203d5b3f16 admin admin] REQUEST_METHOD: `PUT` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:15.410382 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2be34e5-dde9-45c6-9cdb-60203d5b3f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:15.410801 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2be34e5-dde9-45c6-9cdb-60203d5b3f16 admin admin] PATH_INFO: `/v3/projects/02d66bbe851040a6a33b6715fdb648d6/users/7e15004ee2804ad8ba06cbcff3c7cc40/roles/604444e7ad0d437dbd1f5a6e02b761f5` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:15.439728 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2be34e5-dde9-45c6-9cdb-60203d5b3f16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02d66bbe851040a6a33b6715fdb648d6, user_id=7e15004ee2804ad8ba06cbcff3c7cc40, role_id=604444e7ad0d437dbd1f5a6e02b761f5)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:26:15.442697 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2be34e5-dde9-45c6-9cdb-60203d5b3f16 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:26:15.465309 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1180/2361] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:26:15 2022] PUT /identity/v3/projects/02d66bbe851040a6a33b6715fdb648d6/users/7e15004ee2804ad8ba06cbcff3c7cc40/roles/604444e7ad0d437dbd1f5a6e02b761f5 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:26:15.466869 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038ee6b4-8483-4c0f-9def-60096cb72980 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:15.467159 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038ee6b4-8483-4c0f-9def-60096cb72980 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:15.467465 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038ee6b4-8483-4c0f-9def-60096cb72980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:15.490677 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-038ee6b4-8483-4c0f-9def-60096cb72980 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:26:15.492031 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-038ee6b4-8483-4c0f-9def-60096cb72980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:26:15.620858 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1182/2362] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:26:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 22:26:15.638883 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2be34e5-dde9-45c6-9cdb-60203d5b3f16 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:26:15.640728 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-f2be34e5-dde9-45c6-9cdb-60203d5b3f16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:26:15.716926 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2be34e5-dde9-45c6-9cdb-60203d5b3f16 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:26:15.722180 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151a2dff-5398-411e-a91a-d19abc7830e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b0b3ca4ecd41aaba9cf8e0f91fbf54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:26:15.722940 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151a2dff-5398-411e-a91a-d19abc7830e4 service neutron] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:15.723365 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151a2dff-5398-411e-a91a-d19abc7830e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:15.723706 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151a2dff-5398-411e-a91a-d19abc7830e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:15.745515 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151a2dff-5398-411e-a91a-d19abc7830e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:26:15.749826 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151a2dff-5398-411e-a91a-d19abc7830e4 service neutron] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:26:15.777417 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1181/2363] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:26:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:26:21.217324 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982d0878-372a-47be-a011-56caf2e5bb1b None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:21.218620 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982d0878-372a-47be-a011-56caf2e5bb1b None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:21.219039 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982d0878-372a-47be-a011-56caf2e5bb1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:21.259422 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-982d0878-372a-47be-a011-56caf2e5bb1b None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:26:21.260920 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-982d0878-372a-47be-a011-56caf2e5bb1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:26:21.274004 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1183/2364] 10.222.0.50 () {58 vars in 1016 bytes} [Tue Sep 20 22:26:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:26:21.293044 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151a2dff-5398-411e-a91a-d19abc7830e4 service neutron] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:26:21.296229 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-151a2dff-5398-411e-a91a-d19abc7830e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:26:21.340422 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:26:21.457216 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151a2dff-5398-411e-a91a-d19abc7830e4 service neutron] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:26:21.469649 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4a21d2-8a87-453f-a9fa-9dd7fa2fb47f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db7eed561e99452289a662ad326cf919', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:26:21.470843 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4a21d2-8a87-453f-a9fa-9dd7fa2fb47f service nova] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:21.471394 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4a21d2-8a87-453f-a9fa-9dd7fa2fb47f service nova] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:21.471895 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4a21d2-8a87-453f-a9fa-9dd7fa2fb47f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:21.499461 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4a21d2-8a87-453f-a9fa-9dd7fa2fb47f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:26:21.501337 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4a21d2-8a87-453f-a9fa-9dd7fa2fb47f service nova] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:26:21.517180 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1182/2365] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:26:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:26:21.818295 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982d0878-372a-47be-a011-56caf2e5bb1b None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:26:21.821541 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-982d0878-372a-47be-a011-56caf2e5bb1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:26:21.870723 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982d0878-372a-47be-a011-56caf2e5bb1b None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:26:21.876180 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1e56f9-0619-42a4-803b-2a38ddcee27b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:26:21.876828 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e56f9-0619-42a4-803b-2a38ddcee27b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:21.877200 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e56f9-0619-42a4-803b-2a38ddcee27b admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:21.877481 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e56f9-0619-42a4-803b-2a38ddcee27b admin admin] PATH_INFO: `/v3/users/c9075dfa4015464b848f5142b8eb6e3e` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:21.878983 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1e56f9-0619-42a4-803b-2a38ddcee27b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9075dfa4015464b848f5142b8eb6e3e)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:26:21.881016 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1e56f9-0619-42a4-803b-2a38ddcee27b admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:26:21.886770 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:26:21.975457 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-6e1e56f9-0619-42a4-803b-2a38ddcee27b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9075dfa4015464b848f5142b8eb6e3e'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:26:21.995533 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-6e1e56f9-0619-42a4-803b-2a38ddcee27b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9075dfa4015464b848f5142b8eb6e3e'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:26:22.009448 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-6e1e56f9-0619-42a4-803b-2a38ddcee27b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9075dfa4015464b848f5142b8eb6e3e'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:26:22.012709 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-6e1e56f9-0619-42a4-803b-2a38ddcee27b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9075dfa4015464b848f5142b8eb6e3e'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:26:22.035886 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-6e1e56f9-0619-42a4-803b-2a38ddcee27b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9075dfa4015464b848f5142b8eb6e3e'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:26:22.097352 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1184/2366] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 20 22:26:21 2022] DELETE /identity/v3/users/c9075dfa4015464b848f5142b8eb6e3e => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:26:22.100108 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44788e1-5c6d-43b7-a931-b0dc2dc69fbb None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:22.100398 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44788e1-5c6d-43b7-a931-b0dc2dc69fbb None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:22.100678 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44788e1-5c6d-43b7-a931-b0dc2dc69fbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:22.135486 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-f44788e1-5c6d-43b7-a931-b0dc2dc69fbb None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:26:22.136733 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-f44788e1-5c6d-43b7-a931-b0dc2dc69fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:26:22.230362 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1183/2367] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:26:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:26:22.242288 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1e56f9-0619-42a4-803b-2a38ddcee27b admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:26:22.245834 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-6e1e56f9-0619-42a4-803b-2a38ddcee27b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:26:22.387029 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1e56f9-0619-42a4-803b-2a38ddcee27b admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:26:22.392786 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e43832-609c-45d3-82de-07b003d6252a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b0b3ca4ecd41aaba9cf8e0f91fbf54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:26:22.393984 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e43832-609c-45d3-82de-07b003d6252a service neutron] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:22.395488 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e43832-609c-45d3-82de-07b003d6252a service neutron] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:22.395974 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e43832-609c-45d3-82de-07b003d6252a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:22.411815 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e43832-609c-45d3-82de-07b003d6252a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:26:22.415490 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e43832-609c-45d3-82de-07b003d6252a service neutron] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:26:22.432446 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1185/2368] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:26:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:26:23.416063 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44788e1-5c6d-43b7-a931-b0dc2dc69fbb None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:26:23.418585 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-f44788e1-5c6d-43b7-a931-b0dc2dc69fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:26:23.543965 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44788e1-5c6d-43b7-a931-b0dc2dc69fbb None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:26:23.568655 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fec4397-27e9-47f0-b6d1-fadbb0b955e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:26:23.569257 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fec4397-27e9-47f0-b6d1-fadbb0b955e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:23.569540 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fec4397-27e9-47f0-b6d1-fadbb0b955e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:23.569812 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fec4397-27e9-47f0-b6d1-fadbb0b955e4 admin admin] PATH_INFO: `/v3/projects/7e96395a9f104c82acd8d83942fef31b` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:23.582710 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fec4397-27e9-47f0-b6d1-fadbb0b955e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e96395a9f104c82acd8d83942fef31b)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:26:23.591006 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fec4397-27e9-47f0-b6d1-fadbb0b955e4 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:26:23.679929 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-3fec4397-27e9-47f0-b6d1-fadbb0b955e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e96395a9f104c82acd8d83942fef31b', 'request_id': 'req-3fec4397-27e9-47f0-b6d1-fadbb0b955e4'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:26:23.687793 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-3fec4397-27e9-47f0-b6d1-fadbb0b955e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e96395a9f104c82acd8d83942fef31b', 'request_id': 'req-3fec4397-27e9-47f0-b6d1-fadbb0b955e4'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:26:23.697784 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-3fec4397-27e9-47f0-b6d1-fadbb0b955e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e96395a9f104c82acd8d83942fef31b', 'request_id': 'req-3fec4397-27e9-47f0-b6d1-fadbb0b955e4'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:26:23.713323 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-3fec4397-27e9-47f0-b6d1-fadbb0b955e4 admin admin] The token cache is being invalidate because project 7e96395a9f104c82acd8d83942fef31b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81307) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 22:26:23.713614 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-3fec4397-27e9-47f0-b6d1-fadbb0b955e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:26:23.714287 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-3fec4397-27e9-47f0-b6d1-fadbb0b955e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:26:23.715954 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1184/2369] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 20 22:26:23 2022] DELETE /identity/v3/projects/7e96395a9f104c82acd8d83942fef31b => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:26:23.720882 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce6443c-3588-40d7-ba32-e225223f88e6 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:23.721991 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce6443c-3588-40d7-ba32-e225223f88e6 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:23.722445 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce6443c-3588-40d7-ba32-e225223f88e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:23.745913 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-bce6443c-3588-40d7-ba32-e225223f88e6 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:26:23.747166 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-bce6443c-3588-40d7-ba32-e225223f88e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:26:23.881484 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1186/2370] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:26:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:26:23.891538 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517fd70a-060c-4a8e-9901-b0a77f1525c9 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:23.891830 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517fd70a-060c-4a8e-9901-b0a77f1525c9 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:23.892111 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517fd70a-060c-4a8e-9901-b0a77f1525c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:23.931589 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-517fd70a-060c-4a8e-9901-b0a77f1525c9 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:26:23.932846 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-517fd70a-060c-4a8e-9901-b0a77f1525c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:26:23.936087 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a39cf2d-df43-4333-8291-40733a906b93 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:23.940351 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a39cf2d-df43-4333-8291-40733a906b93 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:23.942158 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a39cf2d-df43-4333-8291-40733a906b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:23.951309 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1185/2371] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:26:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:26:23.955429 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517fd70a-060c-4a8e-9901-b0a77f1525c9 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:26:23.978455 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517fd70a-060c-4a8e-9901-b0a77f1525c9 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:26:23.985251 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca65c035-4dc6-4e43-a547-8e658b11891e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:26:23.986343 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca65c035-4dc6-4e43-a547-8e658b11891e admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:23.986956 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca65c035-4dc6-4e43-a547-8e658b11891e admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:23.987441 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca65c035-4dc6-4e43-a547-8e658b11891e admin admin] PATH_INFO: `/v3/domains` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:23.988747 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca65c035-4dc6-4e43-a547-8e658b11891e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:26:23.989221 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca65c035-4dc6-4e43-a547-8e658b11891e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:26:23.991615 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca65c035-4dc6-4e43-a547-8e658b11891e admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:26:24.032040 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1186/2372] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 20 22:26:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:26:24.033596 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca65c035-4dc6-4e43-a547-8e658b11891e admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:26:24.034661 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-2a39cf2d-df43-4333-8291-40733a906b93 None None] MFA Rules not processed for user `7e15004ee2804ad8ba06cbcff3c7cc40`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:26:24.042547 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:26:24.050776 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca65c035-4dc6-4e43-a547-8e658b11891e admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:26:24.051841 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-2a39cf2d-df43-4333-8291-40733a906b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:26:24.066421 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e37be1-208d-48e1-953b-d2b6c2fabddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:26:24.067293 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e37be1-208d-48e1-953b-d2b6c2fabddc admin admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:24.067741 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e37be1-208d-48e1-953b-d2b6c2fabddc admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:24.068178 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e37be1-208d-48e1-953b-d2b6c2fabddc admin admin] PATH_INFO: `/v3/projects` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:24.068971 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e37be1-208d-48e1-953b-d2b6c2fabddc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:26:24.071143 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e37be1-208d-48e1-953b-d2b6c2fabddc admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:26:24.074413 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:26:24.135674 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1187/2373] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 20 22:26:24 2022] POST /identity/v3/projects => generated 375 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:26:24.138062 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e37be1-208d-48e1-953b-d2b6c2fabddc admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:26:24.166171 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1187/2374] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:26:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:26:24.170804 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a39cf2d-df43-4333-8291-40733a906b93 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:26:24.174324 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-2a39cf2d-df43-4333-8291-40733a906b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:26:24.209151 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a39cf2d-df43-4333-8291-40733a906b93 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:26:24.245628 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e37be1-208d-48e1-953b-d2b6c2fabddc admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:26:24.252552 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570d4db6-0602-46f1-aa81-f6cbba94ba7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:26:24.253517 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570d4db6-0602-46f1-aa81-f6cbba94ba7f admin admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:24.254036 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570d4db6-0602-46f1-aa81-f6cbba94ba7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:24.254566 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570d4db6-0602-46f1-aa81-f6cbba94ba7f admin admin] PATH_INFO: `/v3/users` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:24.255761 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570d4db6-0602-46f1-aa81-f6cbba94ba7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:26:24.258292 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570d4db6-0602-46f1-aa81-f6cbba94ba7f admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:26:24.295831 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1188/2375] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 20 22:26:24 2022] POST /identity/v3/users => generated 288 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:26:24.297096 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570d4db6-0602-46f1-aa81-f6cbba94ba7f admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:26:24.311597 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570d4db6-0602-46f1-aa81-f6cbba94ba7f admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:26:24.313586 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a489f1de-e2c1-49e7-9abd-fee9bcbab13b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:26:24.314317 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a489f1de-e2c1-49e7-9abd-fee9bcbab13b admin admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:24.314811 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a489f1de-e2c1-49e7-9abd-fee9bcbab13b admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:24.315184 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a489f1de-e2c1-49e7-9abd-fee9bcbab13b admin admin] PATH_INFO: `/v3/projects` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:24.315967 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a489f1de-e2c1-49e7-9abd-fee9bcbab13b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:26:24.317965 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a489f1de-e2c1-49e7-9abd-fee9bcbab13b admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:26:24.318308 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab97344f-0877-4076-9f83-423fc98aaa9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:26:24.319304 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab97344f-0877-4076-9f83-423fc98aaa9f admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:24.319605 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab97344f-0877-4076-9f83-423fc98aaa9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:24.319869 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab97344f-0877-4076-9f83-423fc98aaa9f admin admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:24.320528 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab97344f-0877-4076-9f83-423fc98aaa9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:26:24.327062 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab97344f-0877-4076-9f83-423fc98aaa9f admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:26:24.340450 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1189/2376] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:26:24 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:26:24.344883 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab97344f-0877-4076-9f83-423fc98aaa9f admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:26:24.369312 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab97344f-0877-4076-9f83-423fc98aaa9f admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:26:24.379011 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1188/2377] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 20 22:26:24 2022] POST /identity/v3/projects => generated 371 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 20 22:26:24.380962 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a489f1de-e2c1-49e7-9abd-fee9bcbab13b admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:26:24.541923 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d71be1-d3c5-4d16-a427-a7295b1c32d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:26:24.543910 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d71be1-d3c5-4d16-a427-a7295b1c32d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:24.544910 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d71be1-d3c5-4d16-a427-a7295b1c32d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:24.546183 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d71be1-d3c5-4d16-a427-a7295b1c32d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:24.547044 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d71be1-d3c5-4d16-a427-a7295b1c32d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:26:24.548844 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d71be1-d3c5-4d16-a427-a7295b1c32d4 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:26:24.580380 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1190/2378] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:26:24 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:26:24.581693 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d71be1-d3c5-4d16-a427-a7295b1c32d4 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:26:24.603941 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d71be1-d3c5-4d16-a427-a7295b1c32d4 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:26:24.613387 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f79333f-70d9-4754-8299-7861860fd03f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:26:24.616240 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f79333f-70d9-4754-8299-7861860fd03f admin admin] REQUEST_METHOD: `PUT` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:24.616525 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f79333f-70d9-4754-8299-7861860fd03f admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:24.616803 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f79333f-70d9-4754-8299-7861860fd03f admin admin] PATH_INFO: `/v3/projects/b205ac4c603649479acd113d3b183364/users/d9c4b9642b53410b81f9f8f85f617530/roles/604444e7ad0d437dbd1f5a6e02b761f5` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:24.620443 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a489f1de-e2c1-49e7-9abd-fee9bcbab13b admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:26:24.631572 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5945e061-d787-4256-b8f6-0c8393ef0398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:26:24.632891 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5945e061-d787-4256-b8f6-0c8393ef0398 admin admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:24.632891 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5945e061-d787-4256-b8f6-0c8393ef0398 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:24.633350 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5945e061-d787-4256-b8f6-0c8393ef0398 admin admin] PATH_INFO: `/v3/users` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:24.633690 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5945e061-d787-4256-b8f6-0c8393ef0398 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:26:24.635872 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5945e061-d787-4256-b8f6-0c8393ef0398 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:26:24.661053 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f79333f-70d9-4754-8299-7861860fd03f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b205ac4c603649479acd113d3b183364, user_id=d9c4b9642b53410b81f9f8f85f617530, role_id=604444e7ad0d437dbd1f5a6e02b761f5)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:26:24.664402 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f79333f-70d9-4754-8299-7861860fd03f admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:26:24.683143 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1189/2379] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 20 22:26:24 2022] POST /identity/v3/users => generated 292 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:26:24.683853 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1191/2380] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:26:24 2022] PUT /identity/v3/projects/b205ac4c603649479acd113d3b183364/users/d9c4b9642b53410b81f9f8f85f617530/roles/604444e7ad0d437dbd1f5a6e02b761f5 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:26:24.695095 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9356b6d5-56ed-4cfd-b371-05c32a9e5a8e None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:24.695442 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9356b6d5-56ed-4cfd-b371-05c32a9e5a8e None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:24.695652 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9356b6d5-56ed-4cfd-b371-05c32a9e5a8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:24.700237 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5945e061-d787-4256-b8f6-0c8393ef0398 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:26:24.725323 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5945e061-d787-4256-b8f6-0c8393ef0398 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:26:24.757763 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-9356b6d5-56ed-4cfd-b371-05c32a9e5a8e None None] MFA Rules not processed for user `d9c4b9642b53410b81f9f8f85f617530`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:26:24.762912 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-9356b6d5-56ed-4cfd-b371-05c32a9e5a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:26:24.804109 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:26:24.811391 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:26:24.878621 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9513cc-c425-40b0-a1d0-7d34a8c6233a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:26:24.880186 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9513cc-c425-40b0-a1d0-7d34a8c6233a admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:24.881085 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9513cc-c425-40b0-a1d0-7d34a8c6233a admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:24.882288 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9513cc-c425-40b0-a1d0-7d34a8c6233a admin admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:24.883770 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9513cc-c425-40b0-a1d0-7d34a8c6233a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:26:24.887408 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9513cc-c425-40b0-a1d0-7d34a8c6233a admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:26:24.915580 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1190/2381] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:26:24 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:26:24.916758 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9513cc-c425-40b0-a1d0-7d34a8c6233a admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:26:24.936293 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1192/2382] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:26:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:26:24.956812 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9356b6d5-56ed-4cfd-b371-05c32a9e5a8e None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:26:24.961644 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-9356b6d5-56ed-4cfd-b371-05c32a9e5a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:26:24.976466 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9513cc-c425-40b0-a1d0-7d34a8c6233a admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:26:24.994081 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb7a976-0670-4b63-86e0-24dfc1f6df55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:26:24.996639 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb7a976-0670-4b63-86e0-24dfc1f6df55 admin admin] REQUEST_METHOD: `PUT` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:24.998817 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb7a976-0670-4b63-86e0-24dfc1f6df55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:25.001902 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb7a976-0670-4b63-86e0-24dfc1f6df55 admin admin] PATH_INFO: `/v3/projects/819eeeffab00402c9b528aca9a1a29d8/users/b5a7ed7822c14c0c9934ab8b824e0046/roles/8a829170b29d42d6af589399e51edb0f` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:25.050833 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb7a976-0670-4b63-86e0-24dfc1f6df55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=819eeeffab00402c9b528aca9a1a29d8, user_id=b5a7ed7822c14c0c9934ab8b824e0046, role_id=8a829170b29d42d6af589399e51edb0f)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:26:25.053632 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb7a976-0670-4b63-86e0-24dfc1f6df55 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:26:25.085179 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1191/2383] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:26:24 2022] PUT /identity/v3/projects/819eeeffab00402c9b528aca9a1a29d8/users/b5a7ed7822c14c0c9934ab8b824e0046/roles/8a829170b29d42d6af589399e51edb0f => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:26:25.086436 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb7a976-0670-4b63-86e0-24dfc1f6df55 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:26:25.119020 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9356b6d5-56ed-4cfd-b371-05c32a9e5a8e None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:26:25.226364 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb7a976-0670-4b63-86e0-24dfc1f6df55 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:26:25.237928 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4db3f33-1c73-4bd7-a0d6-abca2573e94b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:26:25.239998 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4db3f33-1c73-4bd7-a0d6-abca2573e94b admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:25.241049 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4db3f33-1c73-4bd7-a0d6-abca2573e94b admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:25.241445 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4db3f33-1c73-4bd7-a0d6-abca2573e94b admin admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:25.243242 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4db3f33-1c73-4bd7-a0d6-abca2573e94b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:26:25.245402 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8fa82a-6f7b-40a0-9dad-a0174db009e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577c8b14c1f4279beac13b9ba11aba1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:26:25.247856 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8fa82a-6f7b-40a0-9dad-a0174db009e7 service cinder] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:25.249090 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4db3f33-1c73-4bd7-a0d6-abca2573e94b admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:26:25.249513 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8fa82a-6f7b-40a0-9dad-a0174db009e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:25.249893 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8fa82a-6f7b-40a0-9dad-a0174db009e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:25.273370 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1192/2384] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:26:25 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 20 22:26:25.278046 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4db3f33-1c73-4bd7-a0d6-abca2573e94b admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:26:25.302052 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4db3f33-1c73-4bd7-a0d6-abca2573e94b admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:26:25.318908 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b07e88-8b5c-4d51-9dd6-e9141189ea99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:26:25.319661 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b07e88-8b5c-4d51-9dd6-e9141189ea99 admin admin] REQUEST_METHOD: `PUT` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:25.320022 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b07e88-8b5c-4d51-9dd6-e9141189ea99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:25.320369 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b07e88-8b5c-4d51-9dd6-e9141189ea99 admin admin] PATH_INFO: `/v3/projects/819eeeffab00402c9b528aca9a1a29d8/users/b5a7ed7822c14c0c9934ab8b824e0046/roles/8a829170b29d42d6af589399e51edb0f` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:25.323121 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b07e88-8b5c-4d51-9dd6-e9141189ea99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=819eeeffab00402c9b528aca9a1a29d8, user_id=b5a7ed7822c14c0c9934ab8b824e0046, role_id=8a829170b29d42d6af589399e51edb0f)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:26:25.326100 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b07e88-8b5c-4d51-9dd6-e9141189ea99 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:26:25.340943 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1193/2385] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:26:25 2022] PUT /identity/v3/projects/819eeeffab00402c9b528aca9a1a29d8/users/b5a7ed7822c14c0c9934ab8b824e0046/roles/8a829170b29d42d6af589399e51edb0f => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:26:25.373692 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8fa82a-6f7b-40a0-9dad-a0174db009e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:26:25.375301 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8fa82a-6f7b-40a0-9dad-a0174db009e7 service cinder] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:26:25.387413 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1193/2386] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:26:24 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:26:27.048128 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f7c94-3476-4cc8-b8d0-336fd9966f26 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:27.048865 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f7c94-3476-4cc8-b8d0-336fd9966f26 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:27.048865 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f7c94-3476-4cc8-b8d0-336fd9966f26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:27.070777 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-972f7c94-3476-4cc8-b8d0-336fd9966f26 None None] MFA Rules not processed for user `d9c4b9642b53410b81f9f8f85f617530`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:26:27.072031 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-972f7c94-3476-4cc8-b8d0-336fd9966f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:26:27.216055 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1194/2387] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:26:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:26:34.248936 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d473d-8073-42a1-a382-0d47df74929f None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:34.249556 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d473d-8073-42a1-a382-0d47df74929f None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:34.249556 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d473d-8073-42a1-a382-0d47df74929f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:34.356635 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-fc0d473d-8073-42a1-a382-0d47df74929f None None] MFA Rules not processed for user `b5a7ed7822c14c0c9934ab8b824e0046`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:26:34.378732 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-fc0d473d-8073-42a1-a382-0d47df74929f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:26:34.459104 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:26:34.559695 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1194/2388] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:26:34 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:26:34.567716 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972f7c94-3476-4cc8-b8d0-336fd9966f26 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:26:34.569146 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-972f7c94-3476-4cc8-b8d0-336fd9966f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:26:34.612245 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:26:34.658264 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972f7c94-3476-4cc8-b8d0-336fd9966f26 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:26:34.664774 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2efd2f-f362-4087-96ab-5d044c34e6a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db7eed561e99452289a662ad326cf919', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:26:34.665336 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2efd2f-f362-4087-96ab-5d044c34e6a2 service nova] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:34.665616 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2efd2f-f362-4087-96ab-5d044c34e6a2 service nova] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:34.666044 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2efd2f-f362-4087-96ab-5d044c34e6a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:34.734612 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2efd2f-f362-4087-96ab-5d044c34e6a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:26:34.736574 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2efd2f-f362-4087-96ab-5d044c34e6a2 service nova] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:26:34.748560 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1195/2389] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:26:34 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:26:38.006096 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9dc877-ca70-4cb8-811b-1de4039e579a None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:38.006698 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9dc877-ca70-4cb8-811b-1de4039e579a None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:38.006698 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9dc877-ca70-4cb8-811b-1de4039e579a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:38.067797 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-8c9dc877-ca70-4cb8-811b-1de4039e579a None None] MFA Rules not processed for user `7e15004ee2804ad8ba06cbcff3c7cc40`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:26:38.069283 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-8c9dc877-ca70-4cb8-811b-1de4039e579a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:26:38.080321 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1195/2390] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:26:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:26:43.045477 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d7430a-4b9a-4ba3-a21f-a47eda292883 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:43.046046 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d7430a-4b9a-4ba3-a21f-a47eda292883 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:43.046046 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d7430a-4b9a-4ba3-a21f-a47eda292883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:43.065371 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-88d7430a-4b9a-4ba3-a21f-a47eda292883 None None] MFA Rules not processed for user `e916748fdee84c34af034e75a919b986`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:26:43.066639 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-88d7430a-4b9a-4ba3-a21f-a47eda292883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:26:43.119637 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1196/2391] 10.222.0.33 () {58 vars in 967 bytes} [Tue Sep 20 22:26:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:26:43.132958 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9dc877-ca70-4cb8-811b-1de4039e579a None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:26:43.134375 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-8c9dc877-ca70-4cb8-811b-1de4039e579a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:26:43.204242 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9dc877-ca70-4cb8-811b-1de4039e579a None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:26:43.209494 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b933f1-464c-4e89-8887-6f30413011db service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '257983500d7b430c8f0377b2aa743ae0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:26:43.210124 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b933f1-464c-4e89-8887-6f30413011db service swift] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:43.210403 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b933f1-464c-4e89-8887-6f30413011db service swift] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:43.210703 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b933f1-464c-4e89-8887-6f30413011db service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:43.220147 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b933f1-464c-4e89-8887-6f30413011db service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:26:43.221683 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b933f1-464c-4e89-8887-6f30413011db service swift] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:26:43.229710 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1196/2392] 10.222.0.33 () {60 vars in 1384 bytes} [Tue Sep 20 22:26:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 20 22:26:43.562231 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26647c11-5063-4748-8f7d-01da9ccae145 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:43.562548 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26647c11-5063-4748-8f7d-01da9ccae145 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:43.562827 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26647c11-5063-4748-8f7d-01da9ccae145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:43.594171 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-26647c11-5063-4748-8f7d-01da9ccae145 None None] MFA Rules not processed for user `ca00195a004e446db16f3ecb2dfe9282`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:26:43.596345 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-26647c11-5063-4748-8f7d-01da9ccae145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:26:43.660355 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1197/2393] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:26:43 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:26:45.359026 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b933f1-464c-4e89-8887-6f30413011db service swift] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:26:45.361148 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-b7b933f1-464c-4e89-8887-6f30413011db service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:26:45.433272 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b933f1-464c-4e89-8887-6f30413011db service swift] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:26:45.437971 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786d04d9-7c61-422a-b41c-4c324d58a473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:26:45.438640 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d04d9-7c61-422a-b41c-4c324d58a473 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:45.438921 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d04d9-7c61-422a-b41c-4c324d58a473 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:45.440025 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d04d9-7c61-422a-b41c-4c324d58a473 admin admin] PATH_INFO: `/v3/users/276d1a5055364733aebc64b38bdabc32` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:45.441200 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786d04d9-7c61-422a-b41c-4c324d58a473 admin admin] RBAC: Authorizing `identity:delete_user(user_id=276d1a5055364733aebc64b38bdabc32)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:26:45.443181 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786d04d9-7c61-422a-b41c-4c324d58a473 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:26:45.493272 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:26:45.498074 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-786d04d9-7c61-422a-b41c-4c324d58a473 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '276d1a5055364733aebc64b38bdabc32'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:26:45.511204 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-786d04d9-7c61-422a-b41c-4c324d58a473 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '276d1a5055364733aebc64b38bdabc32'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:26:45.512132 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-786d04d9-7c61-422a-b41c-4c324d58a473 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '276d1a5055364733aebc64b38bdabc32'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:26:45.512871 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-786d04d9-7c61-422a-b41c-4c324d58a473 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '276d1a5055364733aebc64b38bdabc32'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:26:45.521497 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-786d04d9-7c61-422a-b41c-4c324d58a473 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '276d1a5055364733aebc64b38bdabc32'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:26:45.549479 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1197/2394] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 20 22:26:45 2022] DELETE /identity/v3/users/276d1a5055364733aebc64b38bdabc32 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:26:45.756851 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26647c11-5063-4748-8f7d-01da9ccae145 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:26:45.779937 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26647c11-5063-4748-8f7d-01da9ccae145 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:26:45.796223 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:26:45.854526 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067e3784-f875-46b9-9fa6-d5ab306c2f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:26:45.855432 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067e3784-f875-46b9-9fa6-d5ab306c2f7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:45.855909 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067e3784-f875-46b9-9fa6-d5ab306c2f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:45.856180 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067e3784-f875-46b9-9fa6-d5ab306c2f7b admin admin] PATH_INFO: `/v3/projects/0ab78459b0ca489799e2fd5f187533b3` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:45.858121 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067e3784-f875-46b9-9fa6-d5ab306c2f7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ab78459b0ca489799e2fd5f187533b3)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:26:45.860248 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067e3784-f875-46b9-9fa6-d5ab306c2f7b admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:26:45.914908 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-067e3784-f875-46b9-9fa6-d5ab306c2f7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ab78459b0ca489799e2fd5f187533b3', 'request_id': 'req-067e3784-f875-46b9-9fa6-d5ab306c2f7b'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:26:45.922614 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-067e3784-f875-46b9-9fa6-d5ab306c2f7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ab78459b0ca489799e2fd5f187533b3', 'request_id': 'req-067e3784-f875-46b9-9fa6-d5ab306c2f7b'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:26:45.937065 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-067e3784-f875-46b9-9fa6-d5ab306c2f7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ab78459b0ca489799e2fd5f187533b3', 'request_id': 'req-067e3784-f875-46b9-9fa6-d5ab306c2f7b'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:26:45.950243 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-067e3784-f875-46b9-9fa6-d5ab306c2f7b admin admin] The token cache is being invalidate because project 0ab78459b0ca489799e2fd5f187533b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81306) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 22:26:45.950619 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-067e3784-f875-46b9-9fa6-d5ab306c2f7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:26:45.951241 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-067e3784-f875-46b9-9fa6-d5ab306c2f7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:26:45.952987 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1198/2395] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 20 22:26:45 2022] DELETE /identity/v3/projects/0ab78459b0ca489799e2fd5f187533b3 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:26:45.957876 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa580fe-b408-4c2a-bf23-3b36d336aafd None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:45.958736 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa580fe-b408-4c2a-bf23-3b36d336aafd None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:45.959251 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa580fe-b408-4c2a-bf23-3b36d336aafd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:46.020734 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-caa580fe-b408-4c2a-bf23-3b36d336aafd None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:26:46.022532 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-caa580fe-b408-4c2a-bf23-3b36d336aafd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:26:46.116969 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1198/2396] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:26:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:26:46.125306 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe476ea-d02c-4262-9374-92fe41930abf None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:46.125672 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe476ea-d02c-4262-9374-92fe41930abf None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:46.125957 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe476ea-d02c-4262-9374-92fe41930abf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:46.148908 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-2fe476ea-d02c-4262-9374-92fe41930abf None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:26:46.150764 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-2fe476ea-d02c-4262-9374-92fe41930abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:26:46.165630 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1199/2397] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:26:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:26:46.166689 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa580fe-b408-4c2a-bf23-3b36d336aafd None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:26:46.177192 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa580fe-b408-4c2a-bf23-3b36d336aafd None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:26:46.192205 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47b8c13-0bad-4af5-b00e-4326c7e93961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:26:46.192934 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47b8c13-0bad-4af5-b00e-4326c7e93961 admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:46.193281 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47b8c13-0bad-4af5-b00e-4326c7e93961 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:46.193657 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47b8c13-0bad-4af5-b00e-4326c7e93961 admin admin] PATH_INFO: `/v3/domains` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:46.194408 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47b8c13-0bad-4af5-b00e-4326c7e93961 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:26:46.194808 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47b8c13-0bad-4af5-b00e-4326c7e93961 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:26:46.196495 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47b8c13-0bad-4af5-b00e-4326c7e93961 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:26:46.213194 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1199/2398] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 20 22:26:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 22:26:46.214597 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe476ea-d02c-4262-9374-92fe41930abf None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:26:46.224285 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe476ea-d02c-4262-9374-92fe41930abf None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:26:46.230021 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060d7ccb-54e7-4160-8316-df2af952c95f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:26:46.230760 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060d7ccb-54e7-4160-8316-df2af952c95f admin admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:46.231130 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060d7ccb-54e7-4160-8316-df2af952c95f admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:46.231521 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060d7ccb-54e7-4160-8316-df2af952c95f admin admin] PATH_INFO: `/v3/projects` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:46.232233 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060d7ccb-54e7-4160-8316-df2af952c95f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:26:46.234308 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060d7ccb-54e7-4160-8316-df2af952c95f admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:26:46.268999 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1200/2399] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 20 22:26:46 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 20 22:26:46.273141 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47b8c13-0bad-4af5-b00e-4326c7e93961 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:26:46.284873 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47b8c13-0bad-4af5-b00e-4326c7e93961 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:26:46.357185 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111b3c40-cc96-438f-8db6-8fda570e45db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:26:46.357801 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111b3c40-cc96-438f-8db6-8fda570e45db admin admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:46.358083 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111b3c40-cc96-438f-8db6-8fda570e45db admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:46.358359 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111b3c40-cc96-438f-8db6-8fda570e45db admin admin] PATH_INFO: `/v3/users` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:46.359036 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111b3c40-cc96-438f-8db6-8fda570e45db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:26:46.360974 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111b3c40-cc96-438f-8db6-8fda570e45db admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:26:46.382976 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1200/2400] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 20 22:26:46 2022] POST /identity/v3/users => generated 287 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:26:46.387263 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060d7ccb-54e7-4160-8316-df2af952c95f admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:26:46.397993 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060d7ccb-54e7-4160-8316-df2af952c95f admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:26:46.402833 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d796265-bf2f-47c9-901c-c415ed76ea97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:26:46.404004 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d796265-bf2f-47c9-901c-c415ed76ea97 admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:46.404282 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d796265-bf2f-47c9-901c-c415ed76ea97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:46.404548 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d796265-bf2f-47c9-901c-c415ed76ea97 admin admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:46.405188 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d796265-bf2f-47c9-901c-c415ed76ea97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:26:46.406822 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d796265-bf2f-47c9-901c-c415ed76ea97 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:26:46.416800 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1201/2401] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:26:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 20 22:26:46.421672 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111b3c40-cc96-438f-8db6-8fda570e45db admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:26:46.431559 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111b3c40-cc96-438f-8db6-8fda570e45db admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:26:46.436231 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bf640d-e774-403d-ab3d-baab5a6de99b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:26:46.436840 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bf640d-e774-403d-ab3d-baab5a6de99b admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:46.437118 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bf640d-e774-403d-ab3d-baab5a6de99b admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:46.437578 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bf640d-e774-403d-ab3d-baab5a6de99b admin admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:46.438231 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bf640d-e774-403d-ab3d-baab5a6de99b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:26:46.439871 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bf640d-e774-403d-ab3d-baab5a6de99b admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:26:46.454441 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1201/2402] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:26:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:26:46.459108 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d796265-bf2f-47c9-901c-c415ed76ea97 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:26:46.471454 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d796265-bf2f-47c9-901c-c415ed76ea97 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:26:46.476115 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faced62-636b-4bcd-acec-2f995656c664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:26:46.476770 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faced62-636b-4bcd-acec-2f995656c664 admin admin] REQUEST_METHOD: `PUT` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:46.477048 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faced62-636b-4bcd-acec-2f995656c664 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:46.477321 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faced62-636b-4bcd-acec-2f995656c664 admin admin] PATH_INFO: `/v3/projects/5e48450b5cfd43e2a5ad86a248430d99/users/ac71c0e80a754ce7adaee68fe2bf639f/roles/604444e7ad0d437dbd1f5a6e02b761f5` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:46.492601 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faced62-636b-4bcd-acec-2f995656c664 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e48450b5cfd43e2a5ad86a248430d99, user_id=ac71c0e80a754ce7adaee68fe2bf639f, role_id=604444e7ad0d437dbd1f5a6e02b761f5)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:26:46.496296 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faced62-636b-4bcd-acec-2f995656c664 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:26:46.510310 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1202/2403] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:26:46 2022] PUT /identity/v3/projects/5e48450b5cfd43e2a5ad86a248430d99/users/ac71c0e80a754ce7adaee68fe2bf639f/roles/604444e7ad0d437dbd1f5a6e02b761f5 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:26:46.522712 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2abe69-f9f7-406f-9ed0-12867b32786b None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:46.523109 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2abe69-f9f7-406f-9ed0-12867b32786b None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:46.523395 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2abe69-f9f7-406f-9ed0-12867b32786b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:46.552766 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-ec2abe69-f9f7-406f-9ed0-12867b32786b None None] MFA Rules not processed for user `ac71c0e80a754ce7adaee68fe2bf639f`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:26:46.554254 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-ec2abe69-f9f7-406f-9ed0-12867b32786b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:26:46.581418 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:26:46.650907 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1202/2404] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:26:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:26:46.667173 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faced62-636b-4bcd-acec-2f995656c664 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:26:46.669266 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-6faced62-636b-4bcd-acec-2f995656c664 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:26:46.717351 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:26:46.731017 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faced62-636b-4bcd-acec-2f995656c664 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:26:46.734934 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f93c8a-4b68-46f6-a31c-a8d74b4929c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577c8b14c1f4279beac13b9ba11aba1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:26:46.735546 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f93c8a-4b68-46f6-a31c-a8d74b4929c6 service cinder] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:46.735821 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f93c8a-4b68-46f6-a31c-a8d74b4929c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:46.736090 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f93c8a-4b68-46f6-a31c-a8d74b4929c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:46.745044 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f93c8a-4b68-46f6-a31c-a8d74b4929c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:26:46.746472 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f93c8a-4b68-46f6-a31c-a8d74b4929c6 service cinder] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:26:46.756150 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1203/2405] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:26:46 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:26:46.782587 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2abe69-f9f7-406f-9ed0-12867b32786b None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:26:46.871121 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2abe69-f9f7-406f-9ed0-12867b32786b None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:26:46.878929 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc79179-24a4-4f1d-b109-e5c881098b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:26:46.879581 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc79179-24a4-4f1d-b109-e5c881098b7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:46.879862 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc79179-24a4-4f1d-b109-e5c881098b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:46.880143 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc79179-24a4-4f1d-b109-e5c881098b7a admin admin] PATH_INFO: `/v3/users/ac71c0e80a754ce7adaee68fe2bf639f` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:46.882375 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc79179-24a4-4f1d-b109-e5c881098b7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac71c0e80a754ce7adaee68fe2bf639f)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:26:46.883675 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc79179-24a4-4f1d-b109-e5c881098b7a admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:26:46.942112 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-9dc79179-24a4-4f1d-b109-e5c881098b7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac71c0e80a754ce7adaee68fe2bf639f'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:26:46.953549 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-9dc79179-24a4-4f1d-b109-e5c881098b7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac71c0e80a754ce7adaee68fe2bf639f'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:26:46.954376 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-9dc79179-24a4-4f1d-b109-e5c881098b7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac71c0e80a754ce7adaee68fe2bf639f'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:26:46.955463 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-9dc79179-24a4-4f1d-b109-e5c881098b7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac71c0e80a754ce7adaee68fe2bf639f'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:26:46.964965 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-9dc79179-24a4-4f1d-b109-e5c881098b7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac71c0e80a754ce7adaee68fe2bf639f'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:26:46.993069 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1203/2406] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 20 22:26:46 2022] DELETE /identity/v3/users/ac71c0e80a754ce7adaee68fe2bf639f => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:26:46.994744 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68de07f-ac76-4a64-b5cd-f34841f1df9f None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:46.995235 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68de07f-ac76-4a64-b5cd-f34841f1df9f None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:46.995328 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68de07f-ac76-4a64-b5cd-f34841f1df9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:47.019996 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-f68de07f-ac76-4a64-b5cd-f34841f1df9f None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:26:47.021488 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-f68de07f-ac76-4a64-b5cd-f34841f1df9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:26:47.122627 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1204/2407] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:26:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:26:47.129702 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc79179-24a4-4f1d-b109-e5c881098b7a admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:26:47.131560 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-9dc79179-24a4-4f1d-b109-e5c881098b7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:26:47.192969 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:26:47.217257 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc79179-24a4-4f1d-b109-e5c881098b7a admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:26:47.234162 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2acc8b4-0aed-4637-a600-d18848723392 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b0b3ca4ecd41aaba9cf8e0f91fbf54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:26:47.235035 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2acc8b4-0aed-4637-a600-d18848723392 service neutron] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:47.235318 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2acc8b4-0aed-4637-a600-d18848723392 service neutron] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:47.235589 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2acc8b4-0aed-4637-a600-d18848723392 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:47.245821 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2acc8b4-0aed-4637-a600-d18848723392 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:26:47.248243 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2acc8b4-0aed-4637-a600-d18848723392 service neutron] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:26:47.259465 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1204/2408] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:26:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:26:47.861837 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68de07f-ac76-4a64-b5cd-f34841f1df9f None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:26:47.863396 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-f68de07f-ac76-4a64-b5cd-f34841f1df9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:26:47.876254 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68de07f-ac76-4a64-b5cd-f34841f1df9f None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:26:47.880940 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f702efc-1d99-44e2-894f-f413b8234c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:26:47.881632 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f702efc-1d99-44e2-894f-f413b8234c16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:47.881916 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f702efc-1d99-44e2-894f-f413b8234c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:47.882193 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f702efc-1d99-44e2-894f-f413b8234c16 admin admin] PATH_INFO: `/v3/projects/5e48450b5cfd43e2a5ad86a248430d99` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:47.883413 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f702efc-1d99-44e2-894f-f413b8234c16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e48450b5cfd43e2a5ad86a248430d99)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:26:47.885923 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f702efc-1d99-44e2-894f-f413b8234c16 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:26:47.952710 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-6f702efc-1d99-44e2-894f-f413b8234c16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e48450b5cfd43e2a5ad86a248430d99', 'request_id': 'req-6f702efc-1d99-44e2-894f-f413b8234c16'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:26:47.959381 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-6f702efc-1d99-44e2-894f-f413b8234c16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e48450b5cfd43e2a5ad86a248430d99', 'request_id': 'req-6f702efc-1d99-44e2-894f-f413b8234c16'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:26:47.969011 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-6f702efc-1d99-44e2-894f-f413b8234c16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e48450b5cfd43e2a5ad86a248430d99', 'request_id': 'req-6f702efc-1d99-44e2-894f-f413b8234c16'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:26:47.982410 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-6f702efc-1d99-44e2-894f-f413b8234c16 admin admin] The token cache is being invalidate because project 5e48450b5cfd43e2a5ad86a248430d99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81306) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 22:26:47.982886 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-6f702efc-1d99-44e2-894f-f413b8234c16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:26:47.983756 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-6f702efc-1d99-44e2-894f-f413b8234c16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:26:47.986069 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1205/2409] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 20 22:26:47 2022] DELETE /identity/v3/projects/5e48450b5cfd43e2a5ad86a248430d99 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:26:47.990795 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c82b26-74ee-4a32-8300-ee7bc92cec95 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:47.991288 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c82b26-74ee-4a32-8300-ee7bc92cec95 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:47.991819 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c82b26-74ee-4a32-8300-ee7bc92cec95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:48.025937 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-b3c82b26-74ee-4a32-8300-ee7bc92cec95 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:26:48.027659 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-b3c82b26-74ee-4a32-8300-ee7bc92cec95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:26:48.094893 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1205/2410] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:26:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:26:48.102570 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b5e1c6-6235-4424-b90d-d52362f49650 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:48.103049 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b5e1c6-6235-4424-b90d-d52362f49650 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:48.103149 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b5e1c6-6235-4424-b90d-d52362f49650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:48.125345 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-00b5e1c6-6235-4424-b90d-d52362f49650 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:26:48.126473 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-00b5e1c6-6235-4424-b90d-d52362f49650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:26:48.134578 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1206/2411] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:26:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:26:48.138829 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c82b26-74ee-4a32-8300-ee7bc92cec95 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:26:48.148949 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c82b26-74ee-4a32-8300-ee7bc92cec95 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:26:48.154482 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d4e6ec-7798-4e70-80dc-3da9cf2ab02f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:26:48.155167 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d4e6ec-7798-4e70-80dc-3da9cf2ab02f admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:48.155478 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d4e6ec-7798-4e70-80dc-3da9cf2ab02f admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:48.155755 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d4e6ec-7798-4e70-80dc-3da9cf2ab02f admin admin] PATH_INFO: `/v3/domains` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:48.156404 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d4e6ec-7798-4e70-80dc-3da9cf2ab02f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:26:48.156710 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d4e6ec-7798-4e70-80dc-3da9cf2ab02f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:26:48.158334 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d4e6ec-7798-4e70-80dc-3da9cf2ab02f admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:26:48.171539 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1206/2412] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 20 22:26:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:26:48.175831 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b5e1c6-6235-4424-b90d-d52362f49650 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:26:48.186033 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b5e1c6-6235-4424-b90d-d52362f49650 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:26:48.191026 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147c4dd0-a625-4c26-9eb4-6a6d27d57f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:26:48.191766 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c4dd0-a625-4c26-9eb4-6a6d27d57f6a admin admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:48.192114 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c4dd0-a625-4c26-9eb4-6a6d27d57f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:48.192403 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c4dd0-a625-4c26-9eb4-6a6d27d57f6a admin admin] PATH_INFO: `/v3/projects` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:48.193030 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147c4dd0-a625-4c26-9eb4-6a6d27d57f6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:26:48.194952 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147c4dd0-a625-4c26-9eb4-6a6d27d57f6a admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:26:48.224768 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1207/2413] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 20 22:26:48 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:26:48.241047 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d4e6ec-7798-4e70-80dc-3da9cf2ab02f admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:26:48.251667 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d4e6ec-7798-4e70-80dc-3da9cf2ab02f admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:26:48.312612 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e6c9da-4472-423f-bf35-a5cd1df15345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:26:48.313229 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e6c9da-4472-423f-bf35-a5cd1df15345 admin admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:48.313514 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e6c9da-4472-423f-bf35-a5cd1df15345 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:48.313789 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e6c9da-4472-423f-bf35-a5cd1df15345 admin admin] PATH_INFO: `/v3/users` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:48.314422 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e6c9da-4472-423f-bf35-a5cd1df15345 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:26:48.316420 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e6c9da-4472-423f-bf35-a5cd1df15345 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:26:48.337645 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1207/2414] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 20 22:26:48 2022] POST /identity/v3/users => generated 288 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:26:48.342423 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147c4dd0-a625-4c26-9eb4-6a6d27d57f6a admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:26:48.352519 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147c4dd0-a625-4c26-9eb4-6a6d27d57f6a admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:26:48.357390 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4e7680-1d1f-464d-bf9f-e72589295db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:26:48.357985 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e7680-1d1f-464d-bf9f-e72589295db1 admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:48.358283 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e7680-1d1f-464d-bf9f-e72589295db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:48.358585 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e7680-1d1f-464d-bf9f-e72589295db1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:48.359218 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4e7680-1d1f-464d-bf9f-e72589295db1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:26:48.360836 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4e7680-1d1f-464d-bf9f-e72589295db1 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:26:48.370751 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1208/2415] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:26:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:26:48.375088 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e6c9da-4472-423f-bf35-a5cd1df15345 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:26:48.384977 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e6c9da-4472-423f-bf35-a5cd1df15345 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:26:48.390104 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12f7a6f-8294-45ad-95f9-39429259680a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:26:48.390725 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12f7a6f-8294-45ad-95f9-39429259680a admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:48.391004 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12f7a6f-8294-45ad-95f9-39429259680a admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:48.391275 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12f7a6f-8294-45ad-95f9-39429259680a admin admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:48.391902 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12f7a6f-8294-45ad-95f9-39429259680a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:26:48.393508 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12f7a6f-8294-45ad-95f9-39429259680a admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:26:48.403712 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1208/2416] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:26:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:26:48.407658 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4e7680-1d1f-464d-bf9f-e72589295db1 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:26:48.417444 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4e7680-1d1f-464d-bf9f-e72589295db1 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:26:48.422617 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1f49a5-988c-453a-8589-1c3d174c0919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:26:48.423266 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1f49a5-988c-453a-8589-1c3d174c0919 admin admin] REQUEST_METHOD: `PUT` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:48.423549 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1f49a5-988c-453a-8589-1c3d174c0919 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:48.423827 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1f49a5-988c-453a-8589-1c3d174c0919 admin admin] PATH_INFO: `/v3/projects/8e661cdbb0ea44bbae51d91d64a68a5a/users/dc0bda6af5b74b2d8eae7dc35160bd45/roles/604444e7ad0d437dbd1f5a6e02b761f5` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:48.441527 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1f49a5-988c-453a-8589-1c3d174c0919 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e661cdbb0ea44bbae51d91d64a68a5a, user_id=dc0bda6af5b74b2d8eae7dc35160bd45, role_id=604444e7ad0d437dbd1f5a6e02b761f5)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:26:48.448358 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1f49a5-988c-453a-8589-1c3d174c0919 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:26:48.472609 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1209/2417] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:26:48 2022] PUT /identity/v3/projects/8e661cdbb0ea44bbae51d91d64a68a5a/users/dc0bda6af5b74b2d8eae7dc35160bd45/roles/604444e7ad0d437dbd1f5a6e02b761f5 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:26:48.482859 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0688ef0-107e-469a-8fef-1ad5d5dc9b98 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:48.483150 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0688ef0-107e-469a-8fef-1ad5d5dc9b98 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:48.483428 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0688ef0-107e-469a-8fef-1ad5d5dc9b98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:48.512213 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-d0688ef0-107e-469a-8fef-1ad5d5dc9b98 None None] MFA Rules not processed for user `dc0bda6af5b74b2d8eae7dc35160bd45`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:26:48.514356 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-d0688ef0-107e-469a-8fef-1ad5d5dc9b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:26:48.557332 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:26:48.603804 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1209/2418] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:26:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:26:48.615056 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1f49a5-988c-453a-8589-1c3d174c0919 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:26:48.617444 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-ad1f49a5-988c-453a-8589-1c3d174c0919 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:26:48.627953 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:26:48.680544 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1f49a5-988c-453a-8589-1c3d174c0919 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:26:48.684894 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8071b095-577d-402a-86fe-9fe1e8a5b754 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577c8b14c1f4279beac13b9ba11aba1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:26:48.685531 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8071b095-577d-402a-86fe-9fe1e8a5b754 service cinder] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:48.685816 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8071b095-577d-402a-86fe-9fe1e8a5b754 service cinder] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:48.686092 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8071b095-577d-402a-86fe-9fe1e8a5b754 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:48.695895 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8071b095-577d-402a-86fe-9fe1e8a5b754 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:26:48.697345 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8071b095-577d-402a-86fe-9fe1e8a5b754 service cinder] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:26:48.706532 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1210/2419] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:26:48 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:26:58.600315 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=12 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:26:58.702396 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=23 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:26:59.060875 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0688ef0-107e-469a-8fef-1ad5d5dc9b98 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:26:59.122755 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0688ef0-107e-469a-8fef-1ad5d5dc9b98 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:26:59.127368 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd69b119-bf18-43a1-ba75-a4eef185b25f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:26:59.128002 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd69b119-bf18-43a1-ba75-a4eef185b25f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:59.128285 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd69b119-bf18-43a1-ba75-a4eef185b25f admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:59.128558 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd69b119-bf18-43a1-ba75-a4eef185b25f admin admin] PATH_INFO: `/v3/users/dc0bda6af5b74b2d8eae7dc35160bd45` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:59.129680 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd69b119-bf18-43a1-ba75-a4eef185b25f admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc0bda6af5b74b2d8eae7dc35160bd45)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:26:59.131743 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd69b119-bf18-43a1-ba75-a4eef185b25f admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:26:59.178356 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-dd69b119-bf18-43a1-ba75-a4eef185b25f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc0bda6af5b74b2d8eae7dc35160bd45'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:26:59.186890 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-dd69b119-bf18-43a1-ba75-a4eef185b25f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc0bda6af5b74b2d8eae7dc35160bd45'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:26:59.187858 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-dd69b119-bf18-43a1-ba75-a4eef185b25f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc0bda6af5b74b2d8eae7dc35160bd45'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:26:59.188678 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-dd69b119-bf18-43a1-ba75-a4eef185b25f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc0bda6af5b74b2d8eae7dc35160bd45'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:26:59.196935 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-dd69b119-bf18-43a1-ba75-a4eef185b25f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc0bda6af5b74b2d8eae7dc35160bd45'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:26:59.224319 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1210/2420] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 20 22:26:59 2022] DELETE /identity/v3/users/dc0bda6af5b74b2d8eae7dc35160bd45 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:26:59.229490 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84daac4f-2afd-479d-b541-c109f8b3dfab None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:59.229786 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84daac4f-2afd-479d-b541-c109f8b3dfab None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:59.230070 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84daac4f-2afd-479d-b541-c109f8b3dfab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:59.255600 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-84daac4f-2afd-479d-b541-c109f8b3dfab None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:26:59.257452 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-84daac4f-2afd-479d-b541-c109f8b3dfab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:26:59.357066 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1211/2421] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:26:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:26:59.364750 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd69b119-bf18-43a1-ba75-a4eef185b25f admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:26:59.366165 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-dd69b119-bf18-43a1-ba75-a4eef185b25f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:26:59.504635 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd69b119-bf18-43a1-ba75-a4eef185b25f admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:26:59.508796 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d01fc1-e504-4bcf-8b7d-e777c1f7e49b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b0b3ca4ecd41aaba9cf8e0f91fbf54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:26:59.509474 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d01fc1-e504-4bcf-8b7d-e777c1f7e49b service neutron] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:59.509698 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d01fc1-e504-4bcf-8b7d-e777c1f7e49b service neutron] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:59.509968 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d01fc1-e504-4bcf-8b7d-e777c1f7e49b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:59.529434 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d01fc1-e504-4bcf-8b7d-e777c1f7e49b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:26:59.532545 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d01fc1-e504-4bcf-8b7d-e777c1f7e49b service neutron] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:26:59.548209 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1211/2422] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:26:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:26:59.922206 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84daac4f-2afd-479d-b541-c109f8b3dfab None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:26:59.925189 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-84daac4f-2afd-479d-b541-c109f8b3dfab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:26:59.945506 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84daac4f-2afd-479d-b541-c109f8b3dfab None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:26:59.952645 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4173c769-1fba-4d95-ac64-98150170cd37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:26:59.953301 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4173c769-1fba-4d95-ac64-98150170cd37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:26:59.953630 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4173c769-1fba-4d95-ac64-98150170cd37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:26:59.953898 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4173c769-1fba-4d95-ac64-98150170cd37 admin admin] PATH_INFO: `/v3/projects/8e661cdbb0ea44bbae51d91d64a68a5a` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:26:59.955245 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4173c769-1fba-4d95-ac64-98150170cd37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e661cdbb0ea44bbae51d91d64a68a5a)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:26:59.957894 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4173c769-1fba-4d95-ac64-98150170cd37 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:27:00.005532 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-4173c769-1fba-4d95-ac64-98150170cd37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e661cdbb0ea44bbae51d91d64a68a5a', 'request_id': 'req-4173c769-1fba-4d95-ac64-98150170cd37'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:27:00.012373 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-4173c769-1fba-4d95-ac64-98150170cd37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e661cdbb0ea44bbae51d91d64a68a5a', 'request_id': 'req-4173c769-1fba-4d95-ac64-98150170cd37'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:27:00.021380 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-4173c769-1fba-4d95-ac64-98150170cd37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e661cdbb0ea44bbae51d91d64a68a5a', 'request_id': 'req-4173c769-1fba-4d95-ac64-98150170cd37'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:27:00.032810 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-4173c769-1fba-4d95-ac64-98150170cd37 admin admin] The token cache is being invalidate because project 8e661cdbb0ea44bbae51d91d64a68a5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81306) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 22:27:00.033110 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-4173c769-1fba-4d95-ac64-98150170cd37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:27:00.033750 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-4173c769-1fba-4d95-ac64-98150170cd37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:27:00.035285 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1212/2423] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 20 22:26:59 2022] DELETE /identity/v3/projects/8e661cdbb0ea44bbae51d91d64a68a5a => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:27:01.257194 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d01fc1-e504-4bcf-8b7d-e777c1f7e49b service neutron] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:27:01.260526 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-c3d01fc1-e504-4bcf-8b7d-e777c1f7e49b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:27:01.296451 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:27:01.378077 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d01fc1-e504-4bcf-8b7d-e777c1f7e49b service neutron] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:27:01.452442 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e87d06-0212-4fba-b1b8-d01f3eed9fd6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c79676ee86294dab92ba732e38d6fa74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:27:01.453108 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e87d06-0212-4fba-b1b8-d01f3eed9fd6 service placement] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:27:01.453399 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e87d06-0212-4fba-b1b8-d01f3eed9fd6 service placement] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:27:01.453674 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e87d06-0212-4fba-b1b8-d01f3eed9fd6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:27:01.455618 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-b6e87d06-0212-4fba-b1b8-d01f3eed9fd6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:27:01.468343 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e87d06-0212-4fba-b1b8-d01f3eed9fd6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:27:01.469997 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e87d06-0212-4fba-b1b8-d01f3eed9fd6 service placement] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:27:01.480604 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1212/2424] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:27:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:27:01.635849 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdc6274-8ec9-4d6e-a30d-be7a2d407e0e None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:27:01.636335 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdc6274-8ec9-4d6e-a30d-be7a2d407e0e None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:27:01.636498 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdc6274-8ec9-4d6e-a30d-be7a2d407e0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:27:01.659229 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-efdc6274-8ec9-4d6e-a30d-be7a2d407e0e None None] MFA Rules not processed for user `c0a26034863a4590b4e2ec3a853a12b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:27:01.660499 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-efdc6274-8ec9-4d6e-a30d-be7a2d407e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:27:01.739577 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1213/2425] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:27:01 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:27:01.990148 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e80264-ad42-471e-b03c-88446b765690 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:27:01.990590 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e80264-ad42-471e-b03c-88446b765690 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:27:01.990874 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e80264-ad42-471e-b03c-88446b765690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:27:02.015589 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-00e80264-ad42-471e-b03c-88446b765690 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:27:02.016851 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-00e80264-ad42-471e-b03c-88446b765690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:27:02.091005 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1213/2426] 10.222.0.50 () {58 vars in 1016 bytes} [Tue Sep 20 22:27:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:27:02.488265 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdc6274-8ec9-4d6e-a30d-be7a2d407e0e None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:27:02.489874 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-efdc6274-8ec9-4d6e-a30d-be7a2d407e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:27:02.571673 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:27:02.654154 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdc6274-8ec9-4d6e-a30d-be7a2d407e0e None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:27:02.669939 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34b6d37-fbad-454c-b72a-60a9745c7981 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db7eed561e99452289a662ad326cf919', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:27:02.671106 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34b6d37-fbad-454c-b72a-60a9745c7981 service nova] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:27:02.684123 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34b6d37-fbad-454c-b72a-60a9745c7981 service nova] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:27:02.685411 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34b6d37-fbad-454c-b72a-60a9745c7981 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:27:02.704982 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34b6d37-fbad-454c-b72a-60a9745c7981 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:27:02.707900 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34b6d37-fbad-454c-b72a-60a9745c7981 service nova] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:27:02.730158 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1214/2427] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:27:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:27:03.726429 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb26cac-d1e8-4f30-aa58-1c30a0b83ab3 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:27:03.726907 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb26cac-d1e8-4f30-aa58-1c30a0b83ab3 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:27:03.727027 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb26cac-d1e8-4f30-aa58-1c30a0b83ab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:27:03.746278 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-cbb26cac-d1e8-4f30-aa58-1c30a0b83ab3 None None] MFA Rules not processed for user `e916748fdee84c34af034e75a919b986`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:27:03.748138 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-cbb26cac-d1e8-4f30-aa58-1c30a0b83ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:27:03.795644 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:27:03.803623 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1214/2428] 10.222.0.33 () {58 vars in 1009 bytes} [Tue Sep 20 22:27:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:27:03.815393 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34b6d37-fbad-454c-b72a-60a9745c7981 service nova] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:27:03.816932 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-e34b6d37-fbad-454c-b72a-60a9745c7981 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:27:03.889101 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34b6d37-fbad-454c-b72a-60a9745c7981 service nova] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:27:03.894046 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4555a8-6503-400e-bdbc-076246dbda22 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '257983500d7b430c8f0377b2aa743ae0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:27:03.894696 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4555a8-6503-400e-bdbc-076246dbda22 service swift] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:27:03.894975 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4555a8-6503-400e-bdbc-076246dbda22 service swift] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:27:03.895246 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4555a8-6503-400e-bdbc-076246dbda22 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:27:03.904998 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4555a8-6503-400e-bdbc-076246dbda22 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:27:03.906653 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4555a8-6503-400e-bdbc-076246dbda22 service swift] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:27:03.915075 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1215/2429] 10.222.0.33 () {60 vars in 1384 bytes} [Tue Sep 20 22:27:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 20 22:27:04.528961 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b23ffaa-5076-4d16-b89f-48be4ab3ea7e None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:27:04.529251 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b23ffaa-5076-4d16-b89f-48be4ab3ea7e None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:27:04.529522 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b23ffaa-5076-4d16-b89f-48be4ab3ea7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:27:04.548687 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-3b23ffaa-5076-4d16-b89f-48be4ab3ea7e None None] MFA Rules not processed for user `e916748fdee84c34af034e75a919b986`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:27:04.549897 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-3b23ffaa-5076-4d16-b89f-48be4ab3ea7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:27:04.556859 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1215/2430] 10.222.0.33 () {58 vars in 967 bytes} [Tue Sep 20 22:27:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:27:04.569638 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4555a8-6503-400e-bdbc-076246dbda22 service swift] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:27:04.580710 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4555a8-6503-400e-bdbc-076246dbda22 service swift] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:27:04.585720 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98600ee-a8fd-4169-99e6-a9eb4a9fed97 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '257983500d7b430c8f0377b2aa743ae0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:27:04.586316 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98600ee-a8fd-4169-99e6-a9eb4a9fed97 service swift] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:27:04.586761 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98600ee-a8fd-4169-99e6-a9eb4a9fed97 service swift] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:27:04.587043 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98600ee-a8fd-4169-99e6-a9eb4a9fed97 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:27:04.594934 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98600ee-a8fd-4169-99e6-a9eb4a9fed97 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:27:04.596505 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98600ee-a8fd-4169-99e6-a9eb4a9fed97 service swift] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:27:04.604371 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1216/2431] 10.222.0.33 () {60 vars in 1384 bytes} [Tue Sep 20 22:27:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 20 22:27:04.838937 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319fd0da-1550-498d-9d97-54758d16b459 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:27:04.839405 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319fd0da-1550-498d-9d97-54758d16b459 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:27:04.839742 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319fd0da-1550-498d-9d97-54758d16b459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:27:04.860069 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-319fd0da-1550-498d-9d97-54758d16b459 None None] MFA Rules not processed for user `e916748fdee84c34af034e75a919b986`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:27:04.861283 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-319fd0da-1550-498d-9d97-54758d16b459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:27:04.868479 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1216/2432] 10.222.0.33 () {58 vars in 1009 bytes} [Tue Sep 20 22:27:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:27:04.880490 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98600ee-a8fd-4169-99e6-a9eb4a9fed97 service swift] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:27:04.891513 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98600ee-a8fd-4169-99e6-a9eb4a9fed97 service swift] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:27:04.896549 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4e8617-6059-4179-a5fc-736951874ce6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '257983500d7b430c8f0377b2aa743ae0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:27:04.897142 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4e8617-6059-4179-a5fc-736951874ce6 service swift] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:27:04.897424 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4e8617-6059-4179-a5fc-736951874ce6 service swift] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:27:04.897697 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4e8617-6059-4179-a5fc-736951874ce6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:27:04.906310 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4e8617-6059-4179-a5fc-736951874ce6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:27:04.907911 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4e8617-6059-4179-a5fc-736951874ce6 service swift] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:27:04.916294 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1217/2433] 10.222.0.33 () {60 vars in 1384 bytes} [Tue Sep 20 22:27:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 20 22:27:05.276201 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4198f8b3-8d5d-406b-aa0f-981bc2a03e11 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:27:05.276490 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4198f8b3-8d5d-406b-aa0f-981bc2a03e11 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:27:05.276775 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4198f8b3-8d5d-406b-aa0f-981bc2a03e11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:27:05.310068 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-4198f8b3-8d5d-406b-aa0f-981bc2a03e11 None None] MFA Rules not processed for user `e916748fdee84c34af034e75a919b986`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:27:05.311497 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-4198f8b3-8d5d-406b-aa0f-981bc2a03e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:27:05.318745 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1217/2434] 10.222.0.33 () {58 vars in 967 bytes} [Tue Sep 20 22:27:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:27:05.330877 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4e8617-6059-4179-a5fc-736951874ce6 service swift] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:27:05.341958 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4e8617-6059-4179-a5fc-736951874ce6 service swift] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:27:05.346853 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c865e370-1a56-4329-b091-ffbbc42618eb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '257983500d7b430c8f0377b2aa743ae0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:27:05.347428 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c865e370-1a56-4329-b091-ffbbc42618eb service swift] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:27:05.347706 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c865e370-1a56-4329-b091-ffbbc42618eb service swift] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:27:05.347977 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c865e370-1a56-4329-b091-ffbbc42618eb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:27:05.355831 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c865e370-1a56-4329-b091-ffbbc42618eb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:27:05.358013 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c865e370-1a56-4329-b091-ffbbc42618eb service swift] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:27:05.365936 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1218/2435] 10.222.0.33 () {60 vars in 1384 bytes} [Tue Sep 20 22:27:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 20 22:27:07.367288 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05001ce8-77f8-4622-99b9-e207100de068 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:27:07.367860 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05001ce8-77f8-4622-99b9-e207100de068 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:27:07.367860 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05001ce8-77f8-4622-99b9-e207100de068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:27:07.395996 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-05001ce8-77f8-4622-99b9-e207100de068 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:27:07.407755 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-05001ce8-77f8-4622-99b9-e207100de068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:27:07.424247 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1218/2436] 10.222.0.50 () {58 vars in 1016 bytes} [Tue Sep 20 22:27:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:27:07.535041 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c865e370-1a56-4329-b091-ffbbc42618eb service swift] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:27:07.548761 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c865e370-1a56-4329-b091-ffbbc42618eb service swift] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:27:07.555631 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1555ea26-104f-485a-a2b7-6406a65b3731 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db7eed561e99452289a662ad326cf919', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:27:07.556443 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1555ea26-104f-485a-a2b7-6406a65b3731 service nova] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:27:07.556877 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1555ea26-104f-485a-a2b7-6406a65b3731 service nova] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:27:07.557293 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1555ea26-104f-485a-a2b7-6406a65b3731 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:27:07.567616 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05001ce8-77f8-4622-99b9-e207100de068 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:27:07.569130 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-05001ce8-77f8-4622-99b9-e207100de068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:27:07.573168 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1555ea26-104f-485a-a2b7-6406a65b3731 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:27:07.574804 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1555ea26-104f-485a-a2b7-6406a65b3731 service nova] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:27:07.584851 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05001ce8-77f8-4622-99b9-e207100de068 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:27:07.588439 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1219/2437] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:27:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 20 22:27:07.607275 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab255a0-30e1-49a4-86d4-7e581296c389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:27:07.607937 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab255a0-30e1-49a4-86d4-7e581296c389 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:27:07.608351 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab255a0-30e1-49a4-86d4-7e581296c389 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:27:07.608635 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab255a0-30e1-49a4-86d4-7e581296c389 admin admin] PATH_INFO: `/v3/users/d9c4b9642b53410b81f9f8f85f617530` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:27:07.610584 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab255a0-30e1-49a4-86d4-7e581296c389 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9c4b9642b53410b81f9f8f85f617530)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:27:07.612651 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab255a0-30e1-49a4-86d4-7e581296c389 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:27:07.751469 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-cab255a0-30e1-49a4-86d4-7e581296c389 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9c4b9642b53410b81f9f8f85f617530'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:27:07.769664 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-cab255a0-30e1-49a4-86d4-7e581296c389 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9c4b9642b53410b81f9f8f85f617530'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:27:07.770745 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-cab255a0-30e1-49a4-86d4-7e581296c389 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9c4b9642b53410b81f9f8f85f617530'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:27:07.772396 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-cab255a0-30e1-49a4-86d4-7e581296c389 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9c4b9642b53410b81f9f8f85f617530'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:27:07.785283 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-cab255a0-30e1-49a4-86d4-7e581296c389 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9c4b9642b53410b81f9f8f85f617530'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:27:07.814133 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1219/2438] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 20 22:27:07 2022] DELETE /identity/v3/users/d9c4b9642b53410b81f9f8f85f617530 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 22:27:07.818956 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51396ba5-ac05-463f-b294-5d4bfe067eec None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:27:07.819641 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51396ba5-ac05-463f-b294-5d4bfe067eec None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:27:07.820109 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51396ba5-ac05-463f-b294-5d4bfe067eec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:27:07.848576 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-51396ba5-ac05-463f-b294-5d4bfe067eec None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:27:07.849691 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-51396ba5-ac05-463f-b294-5d4bfe067eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:27:07.915135 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:27:07.937476 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1220/2439] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:27:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 22:27:07.947601 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab255a0-30e1-49a4-86d4-7e581296c389 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:27:07.949439 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-cab255a0-30e1-49a4-86d4-7e581296c389 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:27:08.020729 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab255a0-30e1-49a4-86d4-7e581296c389 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:27:08.024515 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de67977-a246-4ab1-92b2-6ef54f8717cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b0b3ca4ecd41aaba9cf8e0f91fbf54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:27:08.025209 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de67977-a246-4ab1-92b2-6ef54f8717cc service neutron] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:27:08.025558 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de67977-a246-4ab1-92b2-6ef54f8717cc service neutron] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:27:08.025837 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de67977-a246-4ab1-92b2-6ef54f8717cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:27:08.035782 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de67977-a246-4ab1-92b2-6ef54f8717cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:27:08.037222 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de67977-a246-4ab1-92b2-6ef54f8717cc service neutron] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:27:08.047257 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1220/2440] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:27:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:27:08.221805 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51396ba5-ac05-463f-b294-5d4bfe067eec None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:27:08.223343 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-51396ba5-ac05-463f-b294-5d4bfe067eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:27:08.236153 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51396ba5-ac05-463f-b294-5d4bfe067eec None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:27:08.240837 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef843e29-3922-47b1-9c49-dc6ed73108a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:27:08.241473 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef843e29-3922-47b1-9c49-dc6ed73108a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:27:08.241752 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef843e29-3922-47b1-9c49-dc6ed73108a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:27:08.242029 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef843e29-3922-47b1-9c49-dc6ed73108a4 admin admin] PATH_INFO: `/v3/projects/b205ac4c603649479acd113d3b183364` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:27:08.243173 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef843e29-3922-47b1-9c49-dc6ed73108a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b205ac4c603649479acd113d3b183364)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:27:08.245202 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef843e29-3922-47b1-9c49-dc6ed73108a4 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:27:08.298187 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-ef843e29-3922-47b1-9c49-dc6ed73108a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b205ac4c603649479acd113d3b183364', 'request_id': 'req-ef843e29-3922-47b1-9c49-dc6ed73108a4'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:27:08.307633 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-ef843e29-3922-47b1-9c49-dc6ed73108a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b205ac4c603649479acd113d3b183364', 'request_id': 'req-ef843e29-3922-47b1-9c49-dc6ed73108a4'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:27:08.316779 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-ef843e29-3922-47b1-9c49-dc6ed73108a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b205ac4c603649479acd113d3b183364', 'request_id': 'req-ef843e29-3922-47b1-9c49-dc6ed73108a4'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:27:08.329049 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-ef843e29-3922-47b1-9c49-dc6ed73108a4 admin admin] The token cache is being invalidate because project b205ac4c603649479acd113d3b183364 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81306) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 22:27:08.329339 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-ef843e29-3922-47b1-9c49-dc6ed73108a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:27:08.330007 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-ef843e29-3922-47b1-9c49-dc6ed73108a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:27:08.331585 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1221/2441] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 20 22:27:08 2022] DELETE /identity/v3/projects/b205ac4c603649479acd113d3b183364 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:27:12.671181 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111aab7a-19a8-41e7-825e-0dea46f53e20 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:27:12.671686 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111aab7a-19a8-41e7-825e-0dea46f53e20 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:27:12.671776 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111aab7a-19a8-41e7-825e-0dea46f53e20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:27:12.691731 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-111aab7a-19a8-41e7-825e-0dea46f53e20 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:27:12.692950 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-111aab7a-19a8-41e7-825e-0dea46f53e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:27:12.743071 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:27:12.760262 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1221/2442] 10.222.0.50 () {58 vars in 1016 bytes} [Tue Sep 20 22:27:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:27:12.777701 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef843e29-3922-47b1-9c49-dc6ed73108a4 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:27:12.779175 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-ef843e29-3922-47b1-9c49-dc6ed73108a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:27:12.858789 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef843e29-3922-47b1-9c49-dc6ed73108a4 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:27:12.864166 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0f8ebe-2390-40c8-985c-624397c0ac95 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db7eed561e99452289a662ad326cf919', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:27:12.864770 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0f8ebe-2390-40c8-985c-624397c0ac95 service nova] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:27:12.865046 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0f8ebe-2390-40c8-985c-624397c0ac95 service nova] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:27:12.865318 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0f8ebe-2390-40c8-985c-624397c0ac95 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:27:12.873820 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0f8ebe-2390-40c8-985c-624397c0ac95 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:27:12.875408 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0f8ebe-2390-40c8-985c-624397c0ac95 service nova] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:27:12.884555 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1222/2443] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:27:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:27:18.974296 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069caed0-89ef-4560-880e-426e64add1e5 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:27:18.974832 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069caed0-89ef-4560-880e-426e64add1e5 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:27:18.975083 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069caed0-89ef-4560-880e-426e64add1e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:27:18.994880 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-069caed0-89ef-4560-880e-426e64add1e5 None None] MFA Rules not processed for user `e916748fdee84c34af034e75a919b986`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:27:18.996109 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-069caed0-89ef-4560-880e-426e64add1e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:27:19.051676 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1222/2444] 10.222.0.33 () {58 vars in 1009 bytes} [Tue Sep 20 22:27:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 22:27:19.074253 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0f8ebe-2390-40c8-985c-624397c0ac95 service nova] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:27:19.076341 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-ed0f8ebe-2390-40c8-985c-624397c0ac95 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:27:19.138532 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:27:19.145191 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0f8ebe-2390-40c8-985c-624397c0ac95 service nova] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:27:19.151186 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e907c616-a279-4df4-b785-51549897a650 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '257983500d7b430c8f0377b2aa743ae0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:27:19.151786 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e907c616-a279-4df4-b785-51549897a650 service swift] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:27:19.152062 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e907c616-a279-4df4-b785-51549897a650 service swift] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:27:19.152331 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e907c616-a279-4df4-b785-51549897a650 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:27:19.160208 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e907c616-a279-4df4-b785-51549897a650 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:27:19.162312 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e907c616-a279-4df4-b785-51549897a650 service swift] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:27:19.171391 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1223/2445] 10.222.0.33 () {60 vars in 1384 bytes} [Tue Sep 20 22:27:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 20 22:27:22.052588 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5026a69b-c97e-401c-8dfb-a8668b55de94 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:27:22.053058 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5026a69b-c97e-401c-8dfb-a8668b55de94 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:27:22.053652 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5026a69b-c97e-401c-8dfb-a8668b55de94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:27:22.083811 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-5026a69b-c97e-401c-8dfb-a8668b55de94 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:27:22.086991 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-5026a69b-c97e-401c-8dfb-a8668b55de94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:27:22.103398 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1223/2446] 10.222.0.50 () {58 vars in 1016 bytes} [Tue Sep 20 22:27:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:27:22.120248 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e907c616-a279-4df4-b785-51549897a650 service swift] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:27:22.139516 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e907c616-a279-4df4-b785-51549897a650 service swift] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:27:22.146839 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e52b2d8-3f20-4e78-9faf-432d7e9c4836 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db7eed561e99452289a662ad326cf919', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:27:22.147868 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e52b2d8-3f20-4e78-9faf-432d7e9c4836 service nova] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:27:22.148223 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e52b2d8-3f20-4e78-9faf-432d7e9c4836 service nova] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:27:22.148729 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e52b2d8-3f20-4e78-9faf-432d7e9c4836 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:27:22.171310 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e52b2d8-3f20-4e78-9faf-432d7e9c4836 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:27:22.173121 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e52b2d8-3f20-4e78-9faf-432d7e9c4836 service nova] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:27:22.186579 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1224/2447] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:27:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:27:23.270780 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5026a69b-c97e-401c-8dfb-a8668b55de94 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:27:23.272264 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-5026a69b-c97e-401c-8dfb-a8668b55de94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:27:23.359274 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5026a69b-c97e-401c-8dfb-a8668b55de94 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:27:23.363602 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369c1e3e-7f5a-4ab1-8ab5-c95448b97841 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b0b3ca4ecd41aaba9cf8e0f91fbf54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:27:23.364511 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369c1e3e-7f5a-4ab1-8ab5-c95448b97841 service neutron] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:27:23.364938 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369c1e3e-7f5a-4ab1-8ab5-c95448b97841 service neutron] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:27:23.365394 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369c1e3e-7f5a-4ab1-8ab5-c95448b97841 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:27:23.367519 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-369c1e3e-7f5a-4ab1-8ab5-c95448b97841 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:27:23.443128 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369c1e3e-7f5a-4ab1-8ab5-c95448b97841 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:27:23.445082 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369c1e3e-7f5a-4ab1-8ab5-c95448b97841 service neutron] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:27:23.457128 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1224/2448] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:27:23 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:27:28.456896 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e18fc61-4450-45cf-aed2-5e28d3310949 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:27:28.458305 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e18fc61-4450-45cf-aed2-5e28d3310949 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:27:28.458785 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e18fc61-4450-45cf-aed2-5e28d3310949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:27:28.495422 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-6e18fc61-4450-45cf-aed2-5e28d3310949 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:27:28.497920 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-6e18fc61-4450-45cf-aed2-5e28d3310949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:27:28.508239 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1225/2449] 10.222.0.50 () {58 vars in 1016 bytes} [Tue Sep 20 22:27:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:27:28.530744 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369c1e3e-7f5a-4ab1-8ab5-c95448b97841 service neutron] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:27:28.550983 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369c1e3e-7f5a-4ab1-8ab5-c95448b97841 service neutron] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:27:28.559295 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544606ea-030d-42ae-a148-0162d0666bb1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db7eed561e99452289a662ad326cf919', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:27:28.560140 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544606ea-030d-42ae-a148-0162d0666bb1 service nova] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:27:28.560722 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544606ea-030d-42ae-a148-0162d0666bb1 service nova] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:27:28.561197 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544606ea-030d-42ae-a148-0162d0666bb1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:27:28.577855 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544606ea-030d-42ae-a148-0162d0666bb1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:27:28.579985 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544606ea-030d-42ae-a148-0162d0666bb1 service nova] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:27:28.627507 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1225/2450] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:27:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:27:36.888989 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5182295-5945-4c64-a8e0-69dabe6be565 None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:27:36.889552 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5182295-5945-4c64-a8e0-69dabe6be565 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:27:36.889552 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5182295-5945-4c64-a8e0-69dabe6be565 None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:27:36.890903 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1226/2451] 10.222.0.33 () {54 vars in 921 bytes} [Tue Sep 20 22:27:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:27:36.896645 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6012cac8-4c7e-4d0c-864e-9f20e51b8a0e None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:27:36.897125 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6012cac8-4c7e-4d0c-864e-9f20e51b8a0e None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:27:36.897258 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6012cac8-4c7e-4d0c-864e-9f20e51b8a0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:27:36.917835 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-6012cac8-4c7e-4d0c-864e-9f20e51b8a0e None None] MFA Rules not processed for user `db7eed561e99452289a662ad326cf919`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:27:36.919256 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-6012cac8-4c7e-4d0c-864e-9f20e51b8a0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:27:36.928659 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1226/2452] 10.222.0.33 () {58 vars in 1018 bytes} [Tue Sep 20 22:27:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:27:36.940839 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5182295-5945-4c64-a8e0-69dabe6be565 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:27:36.942623 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-a5182295-5945-4c64-a8e0-69dabe6be565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:27:37.125477 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5182295-5945-4c64-a8e0-69dabe6be565 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:27:37.129004 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d299f4-e208-4abf-9241-6bf09db2ddd6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbecfbbf24fd425ca99499fd44d8c7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:27:37.129599 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d299f4-e208-4abf-9241-6bf09db2ddd6 service glance] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:27:37.129875 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d299f4-e208-4abf-9241-6bf09db2ddd6 service glance] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:27:37.130144 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d299f4-e208-4abf-9241-6bf09db2ddd6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:27:37.140502 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d299f4-e208-4abf-9241-6bf09db2ddd6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:27:37.141906 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d299f4-e208-4abf-9241-6bf09db2ddd6 service glance] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:27:37.152933 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1227/2453] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:27:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:27:37.222244 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591fed6b-454e-4a09-8399-9e30986cd564 None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:27:37.222550 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591fed6b-454e-4a09-8399-9e30986cd564 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:27:37.222856 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591fed6b-454e-4a09-8399-9e30986cd564 None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:27:37.224205 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1227/2454] 10.222.0.33 () {54 vars in 921 bytes} [Tue Sep 20 22:27:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:27:37.228882 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3de8f8c-969c-480b-9472-423cf3d2bd0b None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:27:37.229166 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3de8f8c-969c-480b-9472-423cf3d2bd0b None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:27:37.229440 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3de8f8c-969c-480b-9472-423cf3d2bd0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:27:37.249833 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-b3de8f8c-969c-480b-9472-423cf3d2bd0b None None] MFA Rules not processed for user `e9b0b3ca4ecd41aaba9cf8e0f91fbf54`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:27:37.251111 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-b3de8f8c-969c-480b-9472-423cf3d2bd0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:27:37.257485 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1228/2455] 10.222.0.33 () {58 vars in 1018 bytes} [Tue Sep 20 22:27:37 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:27:37.277076 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591fed6b-454e-4a09-8399-9e30986cd564 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:27:37.278824 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-591fed6b-454e-4a09-8399-9e30986cd564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:27:37.292898 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591fed6b-454e-4a09-8399-9e30986cd564 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:27:37.296795 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520cf61d-5710-48d5-a3b9-9cdd1fc32dd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b0b3ca4ecd41aaba9cf8e0f91fbf54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:27:37.297405 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520cf61d-5710-48d5-a3b9-9cdd1fc32dd7 service neutron] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:27:37.297679 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520cf61d-5710-48d5-a3b9-9cdd1fc32dd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:27:37.297947 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520cf61d-5710-48d5-a3b9-9cdd1fc32dd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:27:37.305634 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520cf61d-5710-48d5-a3b9-9cdd1fc32dd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:27:37.307102 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520cf61d-5710-48d5-a3b9-9cdd1fc32dd7 service neutron] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:27:37.316232 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1228/2456] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:27:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:27:37.406476 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08399747-6a68-42ab-9122-8a92c91e0f51 None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:27:37.407030 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08399747-6a68-42ab-9122-8a92c91e0f51 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:27:37.407314 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08399747-6a68-42ab-9122-8a92c91e0f51 None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:27:37.408656 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1229/2457] 10.222.0.33 () {54 vars in 921 bytes} [Tue Sep 20 22:27:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 20 22:27:37.414256 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bb775f-9c13-49ad-a13c-2a6ce48688ea None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:27:37.414932 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bb775f-9c13-49ad-a13c-2a6ce48688ea None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:27:37.414932 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bb775f-9c13-49ad-a13c-2a6ce48688ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:27:37.424477 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=100 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:27:37.436432 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-23bb775f-9c13-49ad-a13c-2a6ce48688ea None None] MFA Rules not processed for user `db7eed561e99452289a662ad326cf919`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:27:37.437806 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-23bb775f-9c13-49ad-a13c-2a6ce48688ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:27:37.447790 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1229/2458] 10.222.0.33 () {58 vars in 1018 bytes} [Tue Sep 20 22:27:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:27:37.458668 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08399747-6a68-42ab-9122-8a92c91e0f51 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:27:37.470441 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08399747-6a68-42ab-9122-8a92c91e0f51 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:27:37.474210 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c30589-a22b-4c5a-b97d-f4a1ad87ccfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b0b3ca4ecd41aaba9cf8e0f91fbf54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:27:37.474839 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c30589-a22b-4c5a-b97d-f4a1ad87ccfd service neutron] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:27:37.475113 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c30589-a22b-4c5a-b97d-f4a1ad87ccfd service neutron] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:27:37.475377 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c30589-a22b-4c5a-b97d-f4a1ad87ccfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:27:37.490436 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c30589-a22b-4c5a-b97d-f4a1ad87ccfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:27:37.491881 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c30589-a22b-4c5a-b97d-f4a1ad87ccfd service neutron] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:27:37.502803 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1230/2459] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:27:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:27:43.319398 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979bc005-0663-438a-a134-22caeeafff0e None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:27:43.319904 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979bc005-0663-438a-a134-22caeeafff0e None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:27:43.320140 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979bc005-0663-438a-a134-22caeeafff0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:27:43.341216 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-979bc005-0663-438a-a134-22caeeafff0e None None] MFA Rules not processed for user `e916748fdee84c34af034e75a919b986`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:27:43.342377 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-979bc005-0663-438a-a134-22caeeafff0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:27:43.350290 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1230/2460] 10.222.0.33 () {58 vars in 1009 bytes} [Tue Sep 20 22:27:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:27:43.366746 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c30589-a22b-4c5a-b97d-f4a1ad87ccfd service neutron] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:27:43.377195 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c30589-a22b-4c5a-b97d-f4a1ad87ccfd service neutron] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:27:43.382807 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819c9999-b120-444d-829e-d32e5a86fe90 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '257983500d7b430c8f0377b2aa743ae0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:27:43.383412 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819c9999-b120-444d-829e-d32e5a86fe90 service swift] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:27:43.383690 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819c9999-b120-444d-829e-d32e5a86fe90 service swift] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:27:43.384082 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819c9999-b120-444d-829e-d32e5a86fe90 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:27:43.392547 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819c9999-b120-444d-829e-d32e5a86fe90 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:27:43.394141 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819c9999-b120-444d-829e-d32e5a86fe90 service swift] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:27:43.402759 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1231/2461] 10.222.0.33 () {60 vars in 1384 bytes} [Tue Sep 20 22:27:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 20 22:27:53.335395 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=4 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:27:53.399210 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=55 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:28:04.076411 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541fcae1-214b-4ae4-aeeb-758dd7afda83 None None] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:28:04.076981 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541fcae1-214b-4ae4-aeeb-758dd7afda83 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:28:04.076981 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541fcae1-214b-4ae4-aeeb-758dd7afda83 None None] PATH_INFO: `/` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:28:04.078333 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1231/2462] 10.222.0.33 () {54 vars in 921 bytes} [Tue Sep 20 22:28:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:28:04.105982 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee787db6-ce1c-4822-bbac-1023db0fc8d8 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:28:04.106606 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee787db6-ce1c-4822-bbac-1023db0fc8d8 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:28:04.106606 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee787db6-ce1c-4822-bbac-1023db0fc8d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:28:04.126448 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-ee787db6-ce1c-4822-bbac-1023db0fc8d8 None None] MFA Rules not processed for user `c79676ee86294dab92ba732e38d6fa74`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:28:04.127823 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-ee787db6-ce1c-4822-bbac-1023db0fc8d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:28:04.139049 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541fcae1-214b-4ae4-aeeb-758dd7afda83 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:28:04.141734 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-541fcae1-214b-4ae4-aeeb-758dd7afda83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:28:04.161212 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541fcae1-214b-4ae4-aeeb-758dd7afda83 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:28:04.166201 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f166a83-4b4c-4bed-8de8-d3cec699c6b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:28:04.166890 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f166a83-4b4c-4bed-8de8-d3cec699c6b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:28:04.167169 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f166a83-4b4c-4bed-8de8-d3cec699c6b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:28:04.167441 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f166a83-4b4c-4bed-8de8-d3cec699c6b7 admin admin] PATH_INFO: `/v3/users/ca00195a004e446db16f3ecb2dfe9282` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:28:04.168609 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f166a83-4b4c-4bed-8de8-d3cec699c6b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca00195a004e446db16f3ecb2dfe9282)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:28:04.171065 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f166a83-4b4c-4bed-8de8-d3cec699c6b7 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:28:04.197633 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1232/2463] 10.222.0.33 () {58 vars in 1018 bytes} [Tue Sep 20 22:28:04 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:28:04.209643 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee787db6-ce1c-4822-bbac-1023db0fc8d8 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:28:04.210988 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-ee787db6-ce1c-4822-bbac-1023db0fc8d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:28:04.220851 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-3f166a83-4b4c-4bed-8de8-d3cec699c6b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca00195a004e446db16f3ecb2dfe9282'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:28:04.225445 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee787db6-ce1c-4822-bbac-1023db0fc8d8 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:28:04.229502 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-3f166a83-4b4c-4bed-8de8-d3cec699c6b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca00195a004e446db16f3ecb2dfe9282'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:28:04.230322 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-3f166a83-4b4c-4bed-8de8-d3cec699c6b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca00195a004e446db16f3ecb2dfe9282'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:28:04.230998 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-3f166a83-4b4c-4bed-8de8-d3cec699c6b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca00195a004e446db16f3ecb2dfe9282'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:28:04.232362 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ab0428-115f-46aa-a300-f46f6d455a53 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c79676ee86294dab92ba732e38d6fa74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:28:04.233080 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ab0428-115f-46aa-a300-f46f6d455a53 service placement] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:28:04.233448 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ab0428-115f-46aa-a300-f46f6d455a53 service placement] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:28:04.233792 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ab0428-115f-46aa-a300-f46f6d455a53 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:28:04.235642 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-29ab0428-115f-46aa-a300-f46f6d455a53 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:28:04.239112 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-3f166a83-4b4c-4bed-8de8-d3cec699c6b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca00195a004e446db16f3ecb2dfe9282'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:28:04.248813 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ab0428-115f-46aa-a300-f46f6d455a53 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:28:04.250598 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ab0428-115f-46aa-a300-f46f6d455a53 service placement] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:28:04.258671 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1232/2464] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 20 22:28:04 2022] DELETE /identity/v3/users/ca00195a004e446db16f3ecb2dfe9282 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:28:04.261890 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1233/2465] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:28:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 20 22:28:04.487568 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f166a83-4b4c-4bed-8de8-d3cec699c6b7 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:28:04.488769 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-3f166a83-4b4c-4bed-8de8-d3cec699c6b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:28:04.566306 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f166a83-4b4c-4bed-8de8-d3cec699c6b7 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:28:04.570874 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977db8c0-e79a-4203-b84e-42c1095c1fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:28:04.571508 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977db8c0-e79a-4203-b84e-42c1095c1fbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:28:04.571785 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977db8c0-e79a-4203-b84e-42c1095c1fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:28:04.572056 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977db8c0-e79a-4203-b84e-42c1095c1fbe admin admin] PATH_INFO: `/v3/projects/75dcd7bec6784c58b4b4cc19e9554947` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:28:04.573162 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977db8c0-e79a-4203-b84e-42c1095c1fbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=75dcd7bec6784c58b4b4cc19e9554947)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:28:04.575099 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977db8c0-e79a-4203-b84e-42c1095c1fbe admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:28:04.620647 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-977db8c0-e79a-4203-b84e-42c1095c1fbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75dcd7bec6784c58b4b4cc19e9554947', 'request_id': 'req-977db8c0-e79a-4203-b84e-42c1095c1fbe'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:28:04.627301 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-977db8c0-e79a-4203-b84e-42c1095c1fbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75dcd7bec6784c58b4b4cc19e9554947', 'request_id': 'req-977db8c0-e79a-4203-b84e-42c1095c1fbe'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:28:04.635599 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-977db8c0-e79a-4203-b84e-42c1095c1fbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75dcd7bec6784c58b4b4cc19e9554947', 'request_id': 'req-977db8c0-e79a-4203-b84e-42c1095c1fbe'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:28:04.646707 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-977db8c0-e79a-4203-b84e-42c1095c1fbe admin admin] The token cache is being invalidate because project 75dcd7bec6784c58b4b4cc19e9554947 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81307) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 22:28:04.646992 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-977db8c0-e79a-4203-b84e-42c1095c1fbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:28:04.647613 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-977db8c0-e79a-4203-b84e-42c1095c1fbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:28:04.649091 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1233/2466] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 20 22:28:04 2022] DELETE /identity/v3/projects/75dcd7bec6784c58b4b4cc19e9554947 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:28:07.195189 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ea661a-7c21-4cd3-bd92-d5c47be99e0a None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:28:07.195658 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ea661a-7c21-4cd3-bd92-d5c47be99e0a None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:28:07.195763 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ea661a-7c21-4cd3-bd92-d5c47be99e0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:28:07.214928 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-70ea661a-7c21-4cd3-bd92-d5c47be99e0a None None] MFA Rules not processed for user `e916748fdee84c34af034e75a919b986`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:28:07.217041 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-70ea661a-7c21-4cd3-bd92-d5c47be99e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:28:07.270008 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1234/2467] 10.222.0.33 () {58 vars in 967 bytes} [Tue Sep 20 22:28:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:28:07.285776 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977db8c0-e79a-4203-b84e-42c1095c1fbe admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:28:07.287266 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-977db8c0-e79a-4203-b84e-42c1095c1fbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:28:07.292937 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:28:07.359028 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977db8c0-e79a-4203-b84e-42c1095c1fbe admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:28:07.363982 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187b2a12-8658-49bd-84e3-1fb509a45553 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '257983500d7b430c8f0377b2aa743ae0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:28:07.364591 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187b2a12-8658-49bd-84e3-1fb509a45553 service swift] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:28:07.364868 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187b2a12-8658-49bd-84e3-1fb509a45553 service swift] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:28:07.365137 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187b2a12-8658-49bd-84e3-1fb509a45553 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:28:07.373039 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187b2a12-8658-49bd-84e3-1fb509a45553 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:28:07.375211 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187b2a12-8658-49bd-84e3-1fb509a45553 service swift] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:28:07.383021 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1234/2468] 10.222.0.33 () {60 vars in 1384 bytes} [Tue Sep 20 22:28:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 20 22:28:17.262985 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=60 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:28:17.379862 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=31 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:28:47.050180 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce27c2a-c68d-4081-a2bf-d43cde8cf99b None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:28:47.050770 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce27c2a-c68d-4081-a2bf-d43cde8cf99b None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:28:47.050770 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce27c2a-c68d-4081-a2bf-d43cde8cf99b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:28:47.070672 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-4ce27c2a-c68d-4081-a2bf-d43cde8cf99b None None] MFA Rules not processed for user `fb0b83edd8754e659729e05787f3bf4d`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:28:47.071873 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-4ce27c2a-c68d-4081-a2bf-d43cde8cf99b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:28:47.124877 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1235/2469] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:28:47 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:28:51.043799 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187b2a12-8658-49bd-84e3-1fb509a45553 service swift] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:28:51.045462 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-187b2a12-8658-49bd-84e3-1fb509a45553 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:28:51.105864 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187b2a12-8658-49bd-84e3-1fb509a45553 service swift] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:28:51.110232 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85d18e2-8842-47f2-a259-d8f7fa899aad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b0b3ca4ecd41aaba9cf8e0f91fbf54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:28:51.110884 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85d18e2-8842-47f2-a259-d8f7fa899aad service neutron] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:28:51.111165 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85d18e2-8842-47f2-a259-d8f7fa899aad service neutron] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:28:51.111437 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85d18e2-8842-47f2-a259-d8f7fa899aad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:28:51.113224 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-f85d18e2-8842-47f2-a259-d8f7fa899aad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:28:51.184190 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85d18e2-8842-47f2-a259-d8f7fa899aad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:28:51.185641 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85d18e2-8842-47f2-a259-d8f7fa899aad service neutron] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:28:51.196822 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1235/2470] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:28:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:28:57.118304 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=25 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:28:59.348531 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce27c2a-c68d-4081-a2bf-d43cde8cf99b None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:28:59.349914 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-4ce27c2a-c68d-4081-a2bf-d43cde8cf99b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:28:59.362173 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce27c2a-c68d-4081-a2bf-d43cde8cf99b None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:28:59.365631 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a95d46a-1cc8-4e4c-bdcd-ee933094d149 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b0b3ca4ecd41aaba9cf8e0f91fbf54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:28:59.366222 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a95d46a-1cc8-4e4c-bdcd-ee933094d149 service neutron] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:28:59.366497 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a95d46a-1cc8-4e4c-bdcd-ee933094d149 service neutron] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:28:59.366802 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a95d46a-1cc8-4e4c-bdcd-ee933094d149 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:28:59.368426 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-8a95d46a-1cc8-4e4c-bdcd-ee933094d149 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:28:59.381334 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a95d46a-1cc8-4e4c-bdcd-ee933094d149 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:28:59.382765 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a95d46a-1cc8-4e4c-bdcd-ee933094d149 service neutron] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:28:59.393668 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1236/2471] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:28:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:29:01.191795 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=54 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:29:02.760878 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85d18e2-8842-47f2-a259-d8f7fa899aad service neutron] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:29:02.762943 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-f85d18e2-8842-47f2-a259-d8f7fa899aad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:29:02.776357 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85d18e2-8842-47f2-a259-d8f7fa899aad service neutron] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:29:02.782480 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f55551a-41d6-4928-a9dd-cc9f80b17742 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db7eed561e99452289a662ad326cf919', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:29:02.783104 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f55551a-41d6-4928-a9dd-cc9f80b17742 service nova] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:29:02.783382 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f55551a-41d6-4928-a9dd-cc9f80b17742 service nova] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:29:02.783650 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f55551a-41d6-4928-a9dd-cc9f80b17742 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:29:02.785294 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-8f55551a-41d6-4928-a9dd-cc9f80b17742 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:29:02.845520 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f55551a-41d6-4928-a9dd-cc9f80b17742 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:29:02.847175 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f55551a-41d6-4928-a9dd-cc9f80b17742 service nova] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:29:02.856960 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1236/2472] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:29:02 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:29:09.389037 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=6 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:29:11.701590 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c4f7df-371d-4aab-8ad2-e5d3df80c823 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:29:11.702195 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c4f7df-371d-4aab-8ad2-e5d3df80c823 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:29:11.702339 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c4f7df-371d-4aab-8ad2-e5d3df80c823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:29:11.721596 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-e6c4f7df-371d-4aab-8ad2-e5d3df80c823 None None] MFA Rules not processed for user `c0a26034863a4590b4e2ec3a853a12b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:29:11.722800 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-e6c4f7df-371d-4aab-8ad2-e5d3df80c823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:29:11.729477 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1237/2473] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:29:11 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 22:29:12.028885 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f55551a-41d6-4928-a9dd-cc9f80b17742 service nova] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:29:12.037982 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f55551a-41d6-4928-a9dd-cc9f80b17742 service nova] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:29:12.042031 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6175435a-2a45-42ee-b64a-a3e05a6ee10f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b0b3ca4ecd41aaba9cf8e0f91fbf54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:29:12.042672 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6175435a-2a45-42ee-b64a-a3e05a6ee10f service neutron] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:29:12.042954 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6175435a-2a45-42ee-b64a-a3e05a6ee10f service neutron] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:29:12.043226 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6175435a-2a45-42ee-b64a-a3e05a6ee10f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:29:12.044973 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-6175435a-2a45-42ee-b64a-a3e05a6ee10f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:29:12.054405 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6175435a-2a45-42ee-b64a-a3e05a6ee10f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:29:12.055951 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6175435a-2a45-42ee-b64a-a3e05a6ee10f service neutron] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:29:12.064331 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1237/2474] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:29:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:29:14.271883 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c4f7df-371d-4aab-8ad2-e5d3df80c823 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:29:14.286219 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c4f7df-371d-4aab-8ad2-e5d3df80c823 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:29:14.293119 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d73a0e-0100-4592-859a-611d3ef2e704 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db7eed561e99452289a662ad326cf919', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:29:14.293739 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d73a0e-0100-4592-859a-611d3ef2e704 service nova] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:29:14.294024 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d73a0e-0100-4592-859a-611d3ef2e704 service nova] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:29:14.294299 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d73a0e-0100-4592-859a-611d3ef2e704 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:29:14.296189 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-81d73a0e-0100-4592-859a-611d3ef2e704 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:29:14.360614 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d73a0e-0100-4592-859a-611d3ef2e704 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:29:14.362207 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d73a0e-0100-4592-859a-611d3ef2e704 service nova] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:29:14.371790 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1238/2475] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:29:14 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:29:21.175480 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6175435a-2a45-42ee-b64a-a3e05a6ee10f service neutron] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:29:21.185441 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6175435a-2a45-42ee-b64a-a3e05a6ee10f service neutron] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:29:21.189376 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1993054-fd04-462b-999a-cfee6907e5b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b0b3ca4ecd41aaba9cf8e0f91fbf54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:29:21.190057 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1993054-fd04-462b-999a-cfee6907e5b5 service neutron] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:29:21.190407 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1993054-fd04-462b-999a-cfee6907e5b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:29:21.190880 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1993054-fd04-462b-999a-cfee6907e5b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:29:21.192734 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-e1993054-fd04-462b-999a-cfee6907e5b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:29:21.203632 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1993054-fd04-462b-999a-cfee6907e5b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:29:21.205067 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1993054-fd04-462b-999a-cfee6907e5b5 service neutron] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:29:21.213764 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1238/2476] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:29:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 20 22:29:23.974730 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2424f297-2b7a-4263-b77d-3f492dc24999 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:29:23.975231 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2424f297-2b7a-4263-b77d-3f492dc24999 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:29:23.975346 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2424f297-2b7a-4263-b77d-3f492dc24999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:29:23.995201 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-2424f297-2b7a-4263-b77d-3f492dc24999 None None] MFA Rules not processed for user `3eed1b62f00a4dbc98524c44147c3b72`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:29:23.996410 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-2424f297-2b7a-4263-b77d-3f492dc24999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:29:24.003451 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1239/2477] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:29:23 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:29:24.313918 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1993054-fd04-462b-999a-cfee6907e5b5 service neutron] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:29:24.322408 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1993054-fd04-462b-999a-cfee6907e5b5 service neutron] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:29:24.326114 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bd9970-b660-4f2c-8a7c-30d82dcc9a72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b0b3ca4ecd41aaba9cf8e0f91fbf54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:29:24.326738 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bd9970-b660-4f2c-8a7c-30d82dcc9a72 service neutron] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:29:24.327019 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bd9970-b660-4f2c-8a7c-30d82dcc9a72 service neutron] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:29:24.327292 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bd9970-b660-4f2c-8a7c-30d82dcc9a72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:29:24.328986 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-f1bd9970-b660-4f2c-8a7c-30d82dcc9a72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:29:24.338668 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bd9970-b660-4f2c-8a7c-30d82dcc9a72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:29:24.340107 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bd9970-b660-4f2c-8a7c-30d82dcc9a72 service neutron] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:29:24.348259 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1239/2478] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:29:24 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:29:24.723483 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2424f297-2b7a-4263-b77d-3f492dc24999 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:29:24.725526 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-2424f297-2b7a-4263-b77d-3f492dc24999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:29:24.831101 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2424f297-2b7a-4263-b77d-3f492dc24999 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:29:24.836550 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6668b7-705b-4acc-b487-14d92db4b119 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c79676ee86294dab92ba732e38d6fa74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:29:24.837173 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6668b7-705b-4acc-b487-14d92db4b119 service placement] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:29:24.837455 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6668b7-705b-4acc-b487-14d92db4b119 service placement] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:29:24.837728 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6668b7-705b-4acc-b487-14d92db4b119 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:29:24.840871 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-2a6668b7-705b-4acc-b487-14d92db4b119 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:29:24.853786 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6668b7-705b-4acc-b487-14d92db4b119 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:29:24.856045 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6668b7-705b-4acc-b487-14d92db4b119 service placement] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:29:24.866803 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1240/2479] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:29:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:29:34.344597 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=46 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:29:34.863108 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=66 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:29:36.686955 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bd9970-b660-4f2c-8a7c-30d82dcc9a72 service neutron] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:29:36.705571 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bd9970-b660-4f2c-8a7c-30d82dcc9a72 service neutron] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:29:36.713092 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99963ef0-21b0-4828-9b13-d9d4f7a3933f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db7eed561e99452289a662ad326cf919', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:29:36.713736 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99963ef0-21b0-4828-9b13-d9d4f7a3933f service nova] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:29:36.714231 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99963ef0-21b0-4828-9b13-d9d4f7a3933f service nova] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:29:36.714808 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99963ef0-21b0-4828-9b13-d9d4f7a3933f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:29:36.719447 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-99963ef0-21b0-4828-9b13-d9d4f7a3933f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:29:36.735191 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99963ef0-21b0-4828-9b13-d9d4f7a3933f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:29:36.736773 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99963ef0-21b0-4828-9b13-d9d4f7a3933f service nova] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:29:36.749671 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1240/2480] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:29:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:29:46.743117 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=6 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:29:54.859071 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6668b7-705b-4acc-b487-14d92db4b119 service placement] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:29:54.860452 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-2a6668b7-705b-4acc-b487-14d92db4b119 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:29:54.913730 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6668b7-705b-4acc-b487-14d92db4b119 service placement] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:29:54.917881 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e79147-ccb5-4469-b282-936243c5cca3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577c8b14c1f4279beac13b9ba11aba1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:29:54.918468 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e79147-ccb5-4469-b282-936243c5cca3 service cinder] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:29:54.918768 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e79147-ccb5-4469-b282-936243c5cca3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:29:54.919033 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e79147-ccb5-4469-b282-936243c5cca3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:29:54.920686 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-99e79147-ccb5-4469-b282-936243c5cca3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:29:54.931053 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e79147-ccb5-4469-b282-936243c5cca3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:29:54.932974 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e79147-ccb5-4469-b282-936243c5cca3 service cinder] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:29:54.941658 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1241/2481] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:29:54 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:30:01.024147 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99963ef0-21b0-4828-9b13-d9d4f7a3933f service nova] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:30:01.026213 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-99963ef0-21b0-4828-9b13-d9d4f7a3933f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:30:01.040100 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99963ef0-21b0-4828-9b13-d9d4f7a3933f service nova] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:30:01.045614 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2858cda-d043-44c2-8991-708759ee9bc2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db7eed561e99452289a662ad326cf919', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:30:01.046213 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2858cda-d043-44c2-8991-708759ee9bc2 service nova] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:30:01.046490 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2858cda-d043-44c2-8991-708759ee9bc2 service nova] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:30:01.046789 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2858cda-d043-44c2-8991-708759ee9bc2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:30:01.048479 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-c2858cda-d043-44c2-8991-708759ee9bc2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:30:01.060868 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2858cda-d043-44c2-8991-708759ee9bc2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:30:01.062608 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2858cda-d043-44c2-8991-708759ee9bc2 service nova] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:30:01.076336 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1241/2482] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:30:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:30:04.937642 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=26 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:30:11.069815 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=6 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:30:13.596372 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e79147-ccb5-4469-b282-936243c5cca3 service cinder] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:30:13.606293 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e79147-ccb5-4469-b282-936243c5cca3 service cinder] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:30:13.610894 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a883dbf2-c328-4ef6-972e-f9a6df14276b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b0b3ca4ecd41aaba9cf8e0f91fbf54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:30:13.611541 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a883dbf2-c328-4ef6-972e-f9a6df14276b service neutron] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:30:13.611816 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a883dbf2-c328-4ef6-972e-f9a6df14276b service neutron] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:30:13.612086 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a883dbf2-c328-4ef6-972e-f9a6df14276b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:30:13.613779 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-a883dbf2-c328-4ef6-972e-f9a6df14276b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:30:13.684454 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a883dbf2-c328-4ef6-972e-f9a6df14276b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:30:13.686006 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a883dbf2-c328-4ef6-972e-f9a6df14276b service neutron] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:30:13.695538 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1242/2483] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:30:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:30:17.031037 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2858cda-d043-44c2-8991-708759ee9bc2 service nova] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:30:17.053086 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2858cda-d043-44c2-8991-708759ee9bc2 service nova] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:30:17.064279 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52d8a10-b259-4960-88ae-525a173c6417 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c79676ee86294dab92ba732e38d6fa74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:30:17.065075 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52d8a10-b259-4960-88ae-525a173c6417 service placement] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:30:17.065366 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52d8a10-b259-4960-88ae-525a173c6417 service placement] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:30:17.065769 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52d8a10-b259-4960-88ae-525a173c6417 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:30:17.068125 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-f52d8a10-b259-4960-88ae-525a173c6417 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:30:17.105315 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52d8a10-b259-4960-88ae-525a173c6417 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:30:17.109423 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52d8a10-b259-4960-88ae-525a173c6417 service placement] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:30:17.131529 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a883dbf2-c328-4ef6-972e-f9a6df14276b service neutron] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:30:17.137031 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1242/2484] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:30:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:30:17.140174 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-a883dbf2-c328-4ef6-972e-f9a6df14276b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:30:17.165366 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a883dbf2-c328-4ef6-972e-f9a6df14276b service neutron] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:30:17.171556 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7ed5d1-adc3-4b5e-bff3-85f21bf33ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:30:17.172201 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7ed5d1-adc3-4b5e-bff3-85f21bf33ce6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:30:17.172478 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7ed5d1-adc3-4b5e-bff3-85f21bf33ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:30:17.172759 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7ed5d1-adc3-4b5e-bff3-85f21bf33ce6 admin admin] PATH_INFO: `/v3/users/fb0b83edd8754e659729e05787f3bf4d` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:30:17.173891 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7ed5d1-adc3-4b5e-bff3-85f21bf33ce6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb0b83edd8754e659729e05787f3bf4d)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:30:17.175834 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7ed5d1-adc3-4b5e-bff3-85f21bf33ce6 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:30:17.241601 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-ec7ed5d1-adc3-4b5e-bff3-85f21bf33ce6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb0b83edd8754e659729e05787f3bf4d'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:30:17.250391 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-ec7ed5d1-adc3-4b5e-bff3-85f21bf33ce6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb0b83edd8754e659729e05787f3bf4d'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:30:17.251079 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-ec7ed5d1-adc3-4b5e-bff3-85f21bf33ce6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb0b83edd8754e659729e05787f3bf4d'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:30:17.251730 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-ec7ed5d1-adc3-4b5e-bff3-85f21bf33ce6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb0b83edd8754e659729e05787f3bf4d'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:30:17.259498 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-ec7ed5d1-adc3-4b5e-bff3-85f21bf33ce6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb0b83edd8754e659729e05787f3bf4d'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:30:17.277089 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1243/2485] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 20 22:30:17 2022] DELETE /identity/v3/users/fb0b83edd8754e659729e05787f3bf4d => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 22:30:17.467997 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52d8a10-b259-4960-88ae-525a173c6417 service placement] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:30:17.481039 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52d8a10-b259-4960-88ae-525a173c6417 service placement] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:30:17.542515 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e6ddd4-3e15-4877-aaa8-a0230320974f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:30:17.543173 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e6ddd4-3e15-4877-aaa8-a0230320974f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:30:17.543453 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e6ddd4-3e15-4877-aaa8-a0230320974f admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:30:17.543728 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e6ddd4-3e15-4877-aaa8-a0230320974f admin admin] PATH_INFO: `/v3/projects/4708dc014c4348209f5ab0fb93f7d96d` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:30:17.544829 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e6ddd4-3e15-4877-aaa8-a0230320974f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4708dc014c4348209f5ab0fb93f7d96d)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:30:17.546753 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e6ddd4-3e15-4877-aaa8-a0230320974f admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:30:17.592694 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-47e6ddd4-3e15-4877-aaa8-a0230320974f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4708dc014c4348209f5ab0fb93f7d96d', 'request_id': 'req-47e6ddd4-3e15-4877-aaa8-a0230320974f'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:30:17.598715 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-47e6ddd4-3e15-4877-aaa8-a0230320974f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4708dc014c4348209f5ab0fb93f7d96d', 'request_id': 'req-47e6ddd4-3e15-4877-aaa8-a0230320974f'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:30:17.606275 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-47e6ddd4-3e15-4877-aaa8-a0230320974f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4708dc014c4348209f5ab0fb93f7d96d', 'request_id': 'req-47e6ddd4-3e15-4877-aaa8-a0230320974f'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:30:17.618965 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-47e6ddd4-3e15-4877-aaa8-a0230320974f admin admin] The token cache is being invalidate because project 4708dc014c4348209f5ab0fb93f7d96d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81307) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 22:30:17.619255 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-47e6ddd4-3e15-4877-aaa8-a0230320974f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:30:17.619903 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-47e6ddd4-3e15-4877-aaa8-a0230320974f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:30:17.621393 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1243/2486] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 20 22:30:17 2022] DELETE /identity/v3/projects/4708dc014c4348209f5ab0fb93f7d96d => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:30:17.626411 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7f75e8-581c-4787-821d-609e94f809fa None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:30:17.626741 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7f75e8-581c-4787-821d-609e94f809fa None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:30:17.627009 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7f75e8-581c-4787-821d-609e94f809fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:30:17.646210 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-8e7f75e8-581c-4787-821d-609e94f809fa None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:30:17.647444 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-8e7f75e8-581c-4787-821d-609e94f809fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:30:17.705080 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1244/2487] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:30:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:30:17.712863 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e85b7f-2013-44a7-86bc-0ba4bf9aceeb None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:30:17.713177 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e85b7f-2013-44a7-86bc-0ba4bf9aceeb None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:30:17.713481 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e85b7f-2013-44a7-86bc-0ba4bf9aceeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:30:17.733377 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-e1e85b7f-2013-44a7-86bc-0ba4bf9aceeb None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:30:17.734615 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-e1e85b7f-2013-44a7-86bc-0ba4bf9aceeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:30:17.742360 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1244/2488] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:30:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:30:17.747149 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7f75e8-581c-4787-821d-609e94f809fa None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:30:17.756655 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7f75e8-581c-4787-821d-609e94f809fa None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:30:17.761116 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b82256-a1ab-46b3-adc0-0af6c238c00f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:30:17.761704 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b82256-a1ab-46b3-adc0-0af6c238c00f admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:30:17.761981 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b82256-a1ab-46b3-adc0-0af6c238c00f admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:30:17.762252 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b82256-a1ab-46b3-adc0-0af6c238c00f admin admin] PATH_INFO: `/v3/domains` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:30:17.762932 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b82256-a1ab-46b3-adc0-0af6c238c00f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:30:17.763232 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b82256-a1ab-46b3-adc0-0af6c238c00f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:30:17.764811 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b82256-a1ab-46b3-adc0-0af6c238c00f admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:30:17.766227 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:30:17.778435 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1245/2489] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 20 22:30:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:30:17.782355 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e85b7f-2013-44a7-86bc-0ba4bf9aceeb None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:30:17.793312 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e85b7f-2013-44a7-86bc-0ba4bf9aceeb None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:30:17.804917 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499c6a11-0801-4fc3-a751-23720fa8eca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:30:17.805532 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c6a11-0801-4fc3-a751-23720fa8eca5 admin admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:30:17.805818 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c6a11-0801-4fc3-a751-23720fa8eca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:30:17.806092 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c6a11-0801-4fc3-a751-23720fa8eca5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:30:17.806770 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499c6a11-0801-4fc3-a751-23720fa8eca5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:30:17.809356 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499c6a11-0801-4fc3-a751-23720fa8eca5 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:30:17.836276 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1245/2490] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 20 22:30:17 2022] POST /identity/v3/projects => generated 375 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:30:17.841155 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b82256-a1ab-46b3-adc0-0af6c238c00f admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:30:17.851056 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b82256-a1ab-46b3-adc0-0af6c238c00f admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:30:17.905534 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2117e18-5e68-4fc1-b118-2812c8e04dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:30:17.906134 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2117e18-5e68-4fc1-b118-2812c8e04dd1 admin admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:30:17.906411 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2117e18-5e68-4fc1-b118-2812c8e04dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:30:17.906713 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2117e18-5e68-4fc1-b118-2812c8e04dd1 admin admin] PATH_INFO: `/v3/users` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:30:17.907343 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2117e18-5e68-4fc1-b118-2812c8e04dd1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:30:17.909240 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2117e18-5e68-4fc1-b118-2812c8e04dd1 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:30:17.932071 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1246/2491] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 20 22:30:17 2022] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:30:17.936153 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499c6a11-0801-4fc3-a751-23720fa8eca5 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:30:17.946194 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499c6a11-0801-4fc3-a751-23720fa8eca5 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:30:17.950719 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e42cc4-daef-40cd-a5d4-889c85e71e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:30:17.951331 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e42cc4-daef-40cd-a5d4-889c85e71e99 admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:30:17.951608 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e42cc4-daef-40cd-a5d4-889c85e71e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:30:17.951876 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e42cc4-daef-40cd-a5d4-889c85e71e99 admin admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:30:17.952508 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e42cc4-daef-40cd-a5d4-889c85e71e99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:30:17.954126 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e42cc4-daef-40cd-a5d4-889c85e71e99 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:30:17.964596 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1246/2492] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:30:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:30:17.968319 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2117e18-5e68-4fc1-b118-2812c8e04dd1 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:30:17.978866 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2117e18-5e68-4fc1-b118-2812c8e04dd1 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:30:17.983517 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de07215-c79b-45dd-bfb3-bd6f531c6aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:30:17.984102 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de07215-c79b-45dd-bfb3-bd6f531c6aaa admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:30:17.984382 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de07215-c79b-45dd-bfb3-bd6f531c6aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:30:17.984660 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de07215-c79b-45dd-bfb3-bd6f531c6aaa admin admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:30:17.985304 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de07215-c79b-45dd-bfb3-bd6f531c6aaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:30:17.986919 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de07215-c79b-45dd-bfb3-bd6f531c6aaa admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:30:17.999876 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1247/2493] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:30:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:30:18.001554 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e42cc4-daef-40cd-a5d4-889c85e71e99 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:30:18.011471 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e42cc4-daef-40cd-a5d4-889c85e71e99 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:30:18.016401 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1efc2a7-e020-4ba5-93da-93c0c1e514e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:30:18.016714 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1efc2a7-e020-4ba5-93da-93c0c1e514e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:30:18.016989 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1efc2a7-e020-4ba5-93da-93c0c1e514e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:30:18.017448 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1efc2a7-e020-4ba5-93da-93c0c1e514e0 admin admin] PATH_INFO: `/v3/projects/581312d7f31c40a58eece09a2a1207ba/users/f45b62d2b0e546f8988c45fc1c2fb083/roles/604444e7ad0d437dbd1f5a6e02b761f5` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:30:18.033912 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1efc2a7-e020-4ba5-93da-93c0c1e514e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=581312d7f31c40a58eece09a2a1207ba, user_id=f45b62d2b0e546f8988c45fc1c2fb083, role_id=604444e7ad0d437dbd1f5a6e02b761f5)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:30:18.037990 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1efc2a7-e020-4ba5-93da-93c0c1e514e0 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:30:18.053696 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1247/2494] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:30:18 2022] PUT /identity/v3/projects/581312d7f31c40a58eece09a2a1207ba/users/f45b62d2b0e546f8988c45fc1c2fb083/roles/604444e7ad0d437dbd1f5a6e02b761f5 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:30:18.064103 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2882e88b-40e7-4e7f-b8be-47d62b2c3095 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:30:18.064392 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2882e88b-40e7-4e7f-b8be-47d62b2c3095 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:30:18.064674 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2882e88b-40e7-4e7f-b8be-47d62b2c3095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:30:18.093135 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-2882e88b-40e7-4e7f-b8be-47d62b2c3095 None None] MFA Rules not processed for user `f45b62d2b0e546f8988c45fc1c2fb083`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:30:18.094354 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-2882e88b-40e7-4e7f-b8be-47d62b2c3095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:30:18.160221 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1248/2495] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:30:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:30:18.172335 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1efc2a7-e020-4ba5-93da-93c0c1e514e0 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:30:18.173987 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-e1efc2a7-e020-4ba5-93da-93c0c1e514e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:30:18.188281 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:30:18.246801 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1efc2a7-e020-4ba5-93da-93c0c1e514e0 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:30:18.252401 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89e83fb-1bfd-40e6-b141-5be371e5e568 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db7eed561e99452289a662ad326cf919', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:30:18.253002 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89e83fb-1bfd-40e6-b141-5be371e5e568 service nova] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:30:18.253283 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89e83fb-1bfd-40e6-b141-5be371e5e568 service nova] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:30:18.253562 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89e83fb-1bfd-40e6-b141-5be371e5e568 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:30:18.261997 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89e83fb-1bfd-40e6-b141-5be371e5e568 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:30:18.263623 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89e83fb-1bfd-40e6-b141-5be371e5e568 service nova] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:30:18.272223 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1248/2496] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:30:18 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:30:18.481471 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2882e88b-40e7-4e7f-b8be-47d62b2c3095 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:30:18.543283 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2882e88b-40e7-4e7f-b8be-47d62b2c3095 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:30:18.547756 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a19475d-f6a7-4589-99ef-a9fc2c590fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:30:18.548376 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a19475d-f6a7-4589-99ef-a9fc2c590fad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:30:18.548661 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a19475d-f6a7-4589-99ef-a9fc2c590fad admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:30:18.548934 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a19475d-f6a7-4589-99ef-a9fc2c590fad admin admin] PATH_INFO: `/v3/users/f45b62d2b0e546f8988c45fc1c2fb083` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:30:18.550039 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a19475d-f6a7-4589-99ef-a9fc2c590fad admin admin] RBAC: Authorizing `identity:delete_user(user_id=f45b62d2b0e546f8988c45fc1c2fb083)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:30:18.551980 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a19475d-f6a7-4589-99ef-a9fc2c590fad admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:30:18.554272 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:30:18.601133 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-4a19475d-f6a7-4589-99ef-a9fc2c590fad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f45b62d2b0e546f8988c45fc1c2fb083'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:30:18.610966 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-4a19475d-f6a7-4589-99ef-a9fc2c590fad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f45b62d2b0e546f8988c45fc1c2fb083'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:30:18.611784 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-4a19475d-f6a7-4589-99ef-a9fc2c590fad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f45b62d2b0e546f8988c45fc1c2fb083'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:30:18.612476 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-4a19475d-f6a7-4589-99ef-a9fc2c590fad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f45b62d2b0e546f8988c45fc1c2fb083'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:30:18.619864 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-4a19475d-f6a7-4589-99ef-a9fc2c590fad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f45b62d2b0e546f8988c45fc1c2fb083'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:30:18.636672 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1249/2497] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 20 22:30:18 2022] DELETE /identity/v3/users/f45b62d2b0e546f8988c45fc1c2fb083 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 22:30:18.641370 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deac87d-7278-4f1b-a26c-1fe514080b14 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:30:18.641689 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deac87d-7278-4f1b-a26c-1fe514080b14 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:30:18.641965 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deac87d-7278-4f1b-a26c-1fe514080b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:30:18.662379 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-2deac87d-7278-4f1b-a26c-1fe514080b14 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:30:18.663535 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-2deac87d-7278-4f1b-a26c-1fe514080b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:30:18.840402 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1249/2498] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:30:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:30:18.850160 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a19475d-f6a7-4589-99ef-a9fc2c590fad admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:30:18.851582 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-4a19475d-f6a7-4589-99ef-a9fc2c590fad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:30:18.912708 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a19475d-f6a7-4589-99ef-a9fc2c590fad admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:30:18.916767 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c20c74-b401-40f4-9703-a2577fe99535 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b0b3ca4ecd41aaba9cf8e0f91fbf54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:30:18.917372 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c20c74-b401-40f4-9703-a2577fe99535 service neutron] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:30:18.917652 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c20c74-b401-40f4-9703-a2577fe99535 service neutron] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:30:18.917924 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c20c74-b401-40f4-9703-a2577fe99535 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:30:18.926692 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c20c74-b401-40f4-9703-a2577fe99535 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:30:18.928112 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c20c74-b401-40f4-9703-a2577fe99535 service neutron] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:30:18.937334 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1250/2499] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:30:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:30:19.199546 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deac87d-7278-4f1b-a26c-1fe514080b14 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:30:19.201116 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-2deac87d-7278-4f1b-a26c-1fe514080b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:30:19.216567 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deac87d-7278-4f1b-a26c-1fe514080b14 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:30:19.221689 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345b5f86-33c0-4564-9801-70981389a0c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:30:19.222447 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b5f86-33c0-4564-9801-70981389a0c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:30:19.222941 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b5f86-33c0-4564-9801-70981389a0c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:30:19.223343 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b5f86-33c0-4564-9801-70981389a0c6 admin admin] PATH_INFO: `/v3/projects/581312d7f31c40a58eece09a2a1207ba` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:30:19.224967 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345b5f86-33c0-4564-9801-70981389a0c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=581312d7f31c40a58eece09a2a1207ba)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:30:19.227118 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345b5f86-33c0-4564-9801-70981389a0c6 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:30:19.277892 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-345b5f86-33c0-4564-9801-70981389a0c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '581312d7f31c40a58eece09a2a1207ba', 'request_id': 'req-345b5f86-33c0-4564-9801-70981389a0c6'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:30:19.284207 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-345b5f86-33c0-4564-9801-70981389a0c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '581312d7f31c40a58eece09a2a1207ba', 'request_id': 'req-345b5f86-33c0-4564-9801-70981389a0c6'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:30:19.292886 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-345b5f86-33c0-4564-9801-70981389a0c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '581312d7f31c40a58eece09a2a1207ba', 'request_id': 'req-345b5f86-33c0-4564-9801-70981389a0c6'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:30:19.307144 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-345b5f86-33c0-4564-9801-70981389a0c6 admin admin] The token cache is being invalidate because project 581312d7f31c40a58eece09a2a1207ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81307) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 22:30:19.307429 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-345b5f86-33c0-4564-9801-70981389a0c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:30:19.308065 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-345b5f86-33c0-4564-9801-70981389a0c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:30:19.309524 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1250/2500] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 20 22:30:19 2022] DELETE /identity/v3/projects/581312d7f31c40a58eece09a2a1207ba => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:30:19.314286 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a10dab-7bde-472c-8717-e3b376f4a525 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:30:19.314775 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a10dab-7bde-472c-8717-e3b376f4a525 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:30:19.315746 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a10dab-7bde-472c-8717-e3b376f4a525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:30:19.336746 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-64a10dab-7bde-472c-8717-e3b376f4a525 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:30:19.337981 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-64a10dab-7bde-472c-8717-e3b376f4a525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:30:19.397643 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1251/2501] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:30:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:30:19.408457 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad589b39-6d09-4c0c-8de9-ad6ec930ead8 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:30:19.408743 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad589b39-6d09-4c0c-8de9-ad6ec930ead8 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:30:19.409191 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad589b39-6d09-4c0c-8de9-ad6ec930ead8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:30:19.429104 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-ad589b39-6d09-4c0c-8de9-ad6ec930ead8 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:30:19.430350 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-ad589b39-6d09-4c0c-8de9-ad6ec930ead8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:30:19.438763 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1251/2502] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:30:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:30:19.442987 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a10dab-7bde-472c-8717-e3b376f4a525 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:30:19.453183 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a10dab-7bde-472c-8717-e3b376f4a525 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:30:19.457634 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf01752-d2b1-4146-b1a4-81263055b8d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:30:19.458224 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf01752-d2b1-4146-b1a4-81263055b8d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:30:19.458495 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf01752-d2b1-4146-b1a4-81263055b8d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:30:19.458789 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf01752-d2b1-4146-b1a4-81263055b8d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:30:19.459422 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf01752-d2b1-4146-b1a4-81263055b8d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:30:19.459716 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf01752-d2b1-4146-b1a4-81263055b8d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:30:19.461307 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf01752-d2b1-4146-b1a4-81263055b8d2 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:30:19.472315 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1252/2503] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 20 22:30:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:30:19.476356 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad589b39-6d09-4c0c-8de9-ad6ec930ead8 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:30:19.485555 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad589b39-6d09-4c0c-8de9-ad6ec930ead8 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:30:19.490149 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c664c2-f1fe-46b2-bf16-1ad70f40550e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:30:19.490771 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c664c2-f1fe-46b2-bf16-1ad70f40550e admin admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:30:19.491054 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c664c2-f1fe-46b2-bf16-1ad70f40550e admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:30:19.491326 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c664c2-f1fe-46b2-bf16-1ad70f40550e admin admin] PATH_INFO: `/v3/projects` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:30:19.491960 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c664c2-f1fe-46b2-bf16-1ad70f40550e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:30:19.494347 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c664c2-f1fe-46b2-bf16-1ad70f40550e admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:30:19.508687 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:30:19.522272 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1252/2504] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 20 22:30:19 2022] POST /identity/v3/projects => generated 399 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:30:19.526392 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf01752-d2b1-4146-b1a4-81263055b8d2 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:30:19.536675 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf01752-d2b1-4146-b1a4-81263055b8d2 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:30:19.544704 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:30:19.595222 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf599b7-0d52-40cc-8490-3d0b2794944a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:30:19.595827 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf599b7-0d52-40cc-8490-3d0b2794944a admin admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:30:19.596107 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf599b7-0d52-40cc-8490-3d0b2794944a admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:30:19.596381 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf599b7-0d52-40cc-8490-3d0b2794944a admin admin] PATH_INFO: `/v3/users` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:30:19.597017 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf599b7-0d52-40cc-8490-3d0b2794944a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:30:19.598963 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf599b7-0d52-40cc-8490-3d0b2794944a admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:30:19.620086 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1253/2505] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 20 22:30:19 2022] POST /identity/v3/users => generated 300 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:30:19.624179 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c664c2-f1fe-46b2-bf16-1ad70f40550e admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:30:19.634846 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c664c2-f1fe-46b2-bf16-1ad70f40550e admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:30:19.639640 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18e773a-959e-496b-840d-ac31c712936d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:30:19.640242 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18e773a-959e-496b-840d-ac31c712936d admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:30:19.640521 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18e773a-959e-496b-840d-ac31c712936d admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:30:19.640794 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18e773a-959e-496b-840d-ac31c712936d admin admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:30:19.641432 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18e773a-959e-496b-840d-ac31c712936d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:30:19.643083 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18e773a-959e-496b-840d-ac31c712936d admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:30:19.653143 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1253/2506] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:30:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:30:19.657277 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf599b7-0d52-40cc-8490-3d0b2794944a admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:30:19.667253 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf599b7-0d52-40cc-8490-3d0b2794944a admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:30:19.671875 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb61d26-81e0-4862-804b-1e59f9da534f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:30:19.672457 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb61d26-81e0-4862-804b-1e59f9da534f admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:30:19.672731 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb61d26-81e0-4862-804b-1e59f9da534f admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:30:19.672996 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb61d26-81e0-4862-804b-1e59f9da534f admin admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:30:19.673617 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb61d26-81e0-4862-804b-1e59f9da534f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:30:19.675214 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb61d26-81e0-4862-804b-1e59f9da534f admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:30:19.685897 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1254/2507] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:30:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:30:19.689659 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18e773a-959e-496b-840d-ac31c712936d admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:30:19.699916 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18e773a-959e-496b-840d-ac31c712936d admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:30:19.704598 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fc5456-18ce-4f17-8040-6e3ebe238940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:30:19.705231 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fc5456-18ce-4f17-8040-6e3ebe238940 admin admin] REQUEST_METHOD: `PUT` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:30:19.705508 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fc5456-18ce-4f17-8040-6e3ebe238940 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:30:19.705775 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fc5456-18ce-4f17-8040-6e3ebe238940 admin admin] PATH_INFO: `/v3/projects/c46516449cd84b2fb6ebca7f09d06117/users/ad55c32cd28c441cb8619121e790b550/roles/604444e7ad0d437dbd1f5a6e02b761f5` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:30:19.719733 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fc5456-18ce-4f17-8040-6e3ebe238940 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c46516449cd84b2fb6ebca7f09d06117, user_id=ad55c32cd28c441cb8619121e790b550, role_id=604444e7ad0d437dbd1f5a6e02b761f5)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:30:19.722317 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fc5456-18ce-4f17-8040-6e3ebe238940 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:30:19.735420 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1254/2508] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:30:19 2022] PUT /identity/v3/projects/c46516449cd84b2fb6ebca7f09d06117/users/ad55c32cd28c441cb8619121e790b550/roles/604444e7ad0d437dbd1f5a6e02b761f5 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:30:19.748005 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31505409-ac45-4264-9a21-29f9f35c4858 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:30:19.748283 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31505409-ac45-4264-9a21-29f9f35c4858 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:30:19.748553 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31505409-ac45-4264-9a21-29f9f35c4858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:30:19.775184 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-31505409-ac45-4264-9a21-29f9f35c4858 None None] MFA Rules not processed for user `ad55c32cd28c441cb8619121e790b550`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:30:19.776368 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-31505409-ac45-4264-9a21-29f9f35c4858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:30:19.838200 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1255/2509] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:30:19 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:30:19.842788 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fc5456-18ce-4f17-8040-6e3ebe238940 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:30:19.909643 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fc5456-18ce-4f17-8040-6e3ebe238940 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:30:19.914607 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efe2cb5-e502-4d2f-891e-a32e1fae0b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:30:19.915757 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efe2cb5-e502-4d2f-891e-a32e1fae0b59 admin admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:30:19.916039 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efe2cb5-e502-4d2f-891e-a32e1fae0b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:30:19.916336 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efe2cb5-e502-4d2f-891e-a32e1fae0b59 admin admin] PATH_INFO: `/v3/projects` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:30:19.916956 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efe2cb5-e502-4d2f-891e-a32e1fae0b59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:30:19.918888 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efe2cb5-e502-4d2f-891e-a32e1fae0b59 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:30:19.945378 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1255/2510] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 20 22:30:19 2022] POST /identity/v3/projects => generated 401 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:30:19.949196 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31505409-ac45-4264-9a21-29f9f35c4858 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:30:19.960370 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31505409-ac45-4264-9a21-29f9f35c4858 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:30:20.014782 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbba4768-b314-46f9-845d-aea9e88219fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:30:20.015392 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba4768-b314-46f9-845d-aea9e88219fc admin admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:30:20.015674 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba4768-b314-46f9-845d-aea9e88219fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:30:20.015949 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba4768-b314-46f9-845d-aea9e88219fc admin admin] PATH_INFO: `/v3/users` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:30:20.016585 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbba4768-b314-46f9-845d-aea9e88219fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:30:20.018525 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbba4768-b314-46f9-845d-aea9e88219fc admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:30:20.039352 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1256/2511] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 20 22:30:19 2022] POST /identity/v3/users => generated 307 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 20 22:30:20.043842 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efe2cb5-e502-4d2f-891e-a32e1fae0b59 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:30:20.053952 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efe2cb5-e502-4d2f-891e-a32e1fae0b59 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:30:20.059070 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5d9268-83f2-44d0-921a-4ac6db04ec8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:30:20.059656 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d9268-83f2-44d0-921a-4ac6db04ec8b admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:30:20.059933 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d9268-83f2-44d0-921a-4ac6db04ec8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:30:20.060207 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d9268-83f2-44d0-921a-4ac6db04ec8b admin admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:30:20.060835 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5d9268-83f2-44d0-921a-4ac6db04ec8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:30:20.062492 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5d9268-83f2-44d0-921a-4ac6db04ec8b admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:30:20.074703 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1256/2512] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:30:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:30:20.078829 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbba4768-b314-46f9-845d-aea9e88219fc admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:30:20.089268 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbba4768-b314-46f9-845d-aea9e88219fc admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:30:20.093885 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e1f885-d987-4c67-8ed8-670b7eb9cc71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:30:20.094550 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e1f885-d987-4c67-8ed8-670b7eb9cc71 admin admin] REQUEST_METHOD: `PUT` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:30:20.094835 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e1f885-d987-4c67-8ed8-670b7eb9cc71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:30:20.095111 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e1f885-d987-4c67-8ed8-670b7eb9cc71 admin admin] PATH_INFO: `/v3/projects/8f90ff89a3534621ad4a32c06c1795e7/users/1d4191add4b14874919c78df8b2faa56/roles/8a829170b29d42d6af589399e51edb0f` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:30:20.098136 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:30:20.111769 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e1f885-d987-4c67-8ed8-670b7eb9cc71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f90ff89a3534621ad4a32c06c1795e7, user_id=1d4191add4b14874919c78df8b2faa56, role_id=8a829170b29d42d6af589399e51edb0f)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:30:20.114398 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e1f885-d987-4c67-8ed8-670b7eb9cc71 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:30:20.127189 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1257/2513] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:30:20 2022] PUT /identity/v3/projects/8f90ff89a3534621ad4a32c06c1795e7/users/1d4191add4b14874919c78df8b2faa56/roles/8a829170b29d42d6af589399e51edb0f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 22:30:20.131093 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5d9268-83f2-44d0-921a-4ac6db04ec8b admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:30:20.140920 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5d9268-83f2-44d0-921a-4ac6db04ec8b admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:30:20.196599 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a2fb09-fd4e-40f3-a9ce-a21c73aabc86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:30:20.197132 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a2fb09-fd4e-40f3-a9ce-a21c73aabc86 admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:30:20.197407 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a2fb09-fd4e-40f3-a9ce-a21c73aabc86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:30:20.197675 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a2fb09-fd4e-40f3-a9ce-a21c73aabc86 admin admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:30:20.198306 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a2fb09-fd4e-40f3-a9ce-a21c73aabc86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:30:20.199933 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a2fb09-fd4e-40f3-a9ce-a21c73aabc86 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:30:20.209200 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1257/2514] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:30:20 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:30:20.213997 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e1f885-d987-4c67-8ed8-670b7eb9cc71 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:30:20.224097 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e1f885-d987-4c67-8ed8-670b7eb9cc71 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:30:20.229292 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5735a1-342a-4301-817b-f3ec5503aa86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:30:20.229936 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5735a1-342a-4301-817b-f3ec5503aa86 admin admin] REQUEST_METHOD: `PUT` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:30:20.230258 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5735a1-342a-4301-817b-f3ec5503aa86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:30:20.230556 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5735a1-342a-4301-817b-f3ec5503aa86 admin admin] PATH_INFO: `/v3/projects/8f90ff89a3534621ad4a32c06c1795e7/users/1d4191add4b14874919c78df8b2faa56/roles/8a829170b29d42d6af589399e51edb0f` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:30:20.232457 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5735a1-342a-4301-817b-f3ec5503aa86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f90ff89a3534621ad4a32c06c1795e7, user_id=1d4191add4b14874919c78df8b2faa56, role_id=8a829170b29d42d6af589399e51edb0f)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:30:20.235098 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5735a1-342a-4301-817b-f3ec5503aa86 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:30:20.244945 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1258/2515] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:30:20 2022] PUT /identity/v3/projects/8f90ff89a3534621ad4a32c06c1795e7/users/1d4191add4b14874919c78df8b2faa56/roles/8a829170b29d42d6af589399e51edb0f => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:30:20.256401 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e28bcf-5422-4ebe-b038-783913e6ac0d None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:30:20.256692 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e28bcf-5422-4ebe-b038-783913e6ac0d None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:30:20.256995 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e28bcf-5422-4ebe-b038-783913e6ac0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:30:20.284808 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-d9e28bcf-5422-4ebe-b038-783913e6ac0d None None] MFA Rules not processed for user `1d4191add4b14874919c78df8b2faa56`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:30:20.286014 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-d9e28bcf-5422-4ebe-b038-783913e6ac0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:30:20.304342 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:30:20.356351 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1258/2516] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:30:20 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:30:20.368095 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5735a1-342a-4301-817b-f3ec5503aa86 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:30:20.369915 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-cd5735a1-342a-4301-817b-f3ec5503aa86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:30:20.429498 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5735a1-342a-4301-817b-f3ec5503aa86 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:30:20.433226 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20516bc5-f411-4caf-83dc-61f3ce103984 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577c8b14c1f4279beac13b9ba11aba1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:30:20.433834 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20516bc5-f411-4caf-83dc-61f3ce103984 service cinder] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:30:20.434115 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20516bc5-f411-4caf-83dc-61f3ce103984 service cinder] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:30:20.434396 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20516bc5-f411-4caf-83dc-61f3ce103984 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:30:20.443678 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20516bc5-f411-4caf-83dc-61f3ce103984 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:30:20.445094 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20516bc5-f411-4caf-83dc-61f3ce103984 service cinder] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:30:20.455538 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1259/2517] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:30:20 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:30:20.538428 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e28bcf-5422-4ebe-b038-783913e6ac0d None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:30:20.548154 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e28bcf-5422-4ebe-b038-783913e6ac0d None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:30:20.551731 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e7fccc-326e-4eef-8ab9-283ab39b5946 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577c8b14c1f4279beac13b9ba11aba1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:30:20.552324 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e7fccc-326e-4eef-8ab9-283ab39b5946 service cinder] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:30:20.552605 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e7fccc-326e-4eef-8ab9-283ab39b5946 service cinder] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:30:20.552878 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e7fccc-326e-4eef-8ab9-283ab39b5946 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:30:20.611132 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e7fccc-326e-4eef-8ab9-283ab39b5946 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:30:20.612555 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e7fccc-326e-4eef-8ab9-283ab39b5946 service cinder] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:30:20.621244 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1259/2518] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:30:20 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:30:24.694341 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20516bc5-f411-4caf-83dc-61f3ce103984 service cinder] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:30:24.763247 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20516bc5-f411-4caf-83dc-61f3ce103984 service cinder] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:30:24.769932 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4e701c-76a3-4499-8509-83b82a6f5c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:30:24.770680 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4e701c-76a3-4499-8509-83b82a6f5c62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:30:24.771049 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4e701c-76a3-4499-8509-83b82a6f5c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:30:24.771415 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4e701c-76a3-4499-8509-83b82a6f5c62 admin admin] PATH_INFO: `/v3/users/ad55c32cd28c441cb8619121e790b550` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:30:24.772552 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4e701c-76a3-4499-8509-83b82a6f5c62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad55c32cd28c441cb8619121e790b550)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:30:24.774991 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4e701c-76a3-4499-8509-83b82a6f5c62 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:30:24.832300 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-8f4e701c-76a3-4499-8509-83b82a6f5c62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad55c32cd28c441cb8619121e790b550'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:30:24.848599 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-8f4e701c-76a3-4499-8509-83b82a6f5c62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad55c32cd28c441cb8619121e790b550'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:30:24.849418 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-8f4e701c-76a3-4499-8509-83b82a6f5c62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad55c32cd28c441cb8619121e790b550'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:30:24.850250 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-8f4e701c-76a3-4499-8509-83b82a6f5c62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad55c32cd28c441cb8619121e790b550'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:30:24.867821 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-8f4e701c-76a3-4499-8509-83b82a6f5c62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad55c32cd28c441cb8619121e790b550'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:30:24.879663 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:30:24.888610 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1260/2519] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 20 22:30:24 2022] DELETE /identity/v3/users/ad55c32cd28c441cb8619121e790b550 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:30:24.893077 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a4b20-6129-48cf-8e53-7dff2f40d024 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:30:24.893561 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a4b20-6129-48cf-8e53-7dff2f40d024 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:30:24.893658 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a4b20-6129-48cf-8e53-7dff2f40d024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:30:24.912697 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-567a4b20-6129-48cf-8e53-7dff2f40d024 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:30:24.913893 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-567a4b20-6129-48cf-8e53-7dff2f40d024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:30:24.972427 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1260/2520] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:30:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:30:24.983056 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4e701c-76a3-4499-8509-83b82a6f5c62 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:30:24.984437 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-8f4e701c-76a3-4499-8509-83b82a6f5c62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:30:25.041667 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4e701c-76a3-4499-8509-83b82a6f5c62 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:30:25.045301 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b828e037-3bf0-473f-8d9b-d45c5b71ec5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b0b3ca4ecd41aaba9cf8e0f91fbf54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:30:25.045899 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b828e037-3bf0-473f-8d9b-d45c5b71ec5e service neutron] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:30:25.046177 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b828e037-3bf0-473f-8d9b-d45c5b71ec5e service neutron] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:30:25.046449 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b828e037-3bf0-473f-8d9b-d45c5b71ec5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:30:25.055346 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b828e037-3bf0-473f-8d9b-d45c5b71ec5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:30:25.056692 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b828e037-3bf0-473f-8d9b-d45c5b71ec5e service neutron] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:30:25.066349 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1261/2521] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:30:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:30:25.375725 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567a4b20-6129-48cf-8e53-7dff2f40d024 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:30:25.377132 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-567a4b20-6129-48cf-8e53-7dff2f40d024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:30:25.393741 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567a4b20-6129-48cf-8e53-7dff2f40d024 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:30:25.398531 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb67c428-c819-4d8c-9143-9e78f2fde40f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:30:25.399186 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb67c428-c819-4d8c-9143-9e78f2fde40f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:30:25.399468 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb67c428-c819-4d8c-9143-9e78f2fde40f admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:30:25.399740 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb67c428-c819-4d8c-9143-9e78f2fde40f admin admin] PATH_INFO: `/v3/projects/c46516449cd84b2fb6ebca7f09d06117` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:30:25.400877 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb67c428-c819-4d8c-9143-9e78f2fde40f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c46516449cd84b2fb6ebca7f09d06117)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:30:25.402834 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb67c428-c819-4d8c-9143-9e78f2fde40f admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:30:25.445419 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3443984-c5fb-4869-8f0a-1ec79af7bcea None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:30:25.445827 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3443984-c5fb-4869-8f0a-1ec79af7bcea None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:30:25.446170 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3443984-c5fb-4869-8f0a-1ec79af7bcea None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:30:25.449040 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1262/2522] 10.222.0.33 () {54 vars in 921 bytes} [Tue Sep 20 22:30:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:30:25.456474 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce6a240-71e0-48de-83dd-b37a77508c0a None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:30:25.457027 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:30:25.457154 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce6a240-71e0-48de-83dd-b37a77508c0a None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:30:25.458112 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce6a240-71e0-48de-83dd-b37a77508c0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:30:25.458552 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-eb67c428-c819-4d8c-9143-9e78f2fde40f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c46516449cd84b2fb6ebca7f09d06117', 'request_id': 'req-eb67c428-c819-4d8c-9143-9e78f2fde40f'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:30:25.466461 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-eb67c428-c819-4d8c-9143-9e78f2fde40f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c46516449cd84b2fb6ebca7f09d06117', 'request_id': 'req-eb67c428-c819-4d8c-9143-9e78f2fde40f'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:30:25.476383 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-eb67c428-c819-4d8c-9143-9e78f2fde40f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c46516449cd84b2fb6ebca7f09d06117', 'request_id': 'req-eb67c428-c819-4d8c-9143-9e78f2fde40f'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:30:25.482105 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-6ce6a240-71e0-48de-83dd-b37a77508c0a None None] MFA Rules not processed for user `e9b0b3ca4ecd41aaba9cf8e0f91fbf54`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:30:25.483358 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-6ce6a240-71e0-48de-83dd-b37a77508c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:30:25.494001 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-eb67c428-c819-4d8c-9143-9e78f2fde40f admin admin] The token cache is being invalidate because project c46516449cd84b2fb6ebca7f09d06117 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81307) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 22:30:25.494301 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-eb67c428-c819-4d8c-9143-9e78f2fde40f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:30:25.495028 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-eb67c428-c819-4d8c-9143-9e78f2fde40f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:30:25.498570 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1261/2523] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 20 22:30:25 2022] DELETE /identity/v3/projects/c46516449cd84b2fb6ebca7f09d06117 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:30:25.501180 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb67c428-c819-4d8c-9143-9e78f2fde40f admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:30:25.504034 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-eb67c428-c819-4d8c-9143-9e78f2fde40f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:30:25.547684 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1263/2524] 10.222.0.33 () {58 vars in 1018 bytes} [Tue Sep 20 22:30:25 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:30:25.563693 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce6a240-71e0-48de-83dd-b37a77508c0a None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:30:25.565110 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-6ce6a240-71e0-48de-83dd-b37a77508c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:30:25.575807 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb67c428-c819-4d8c-9143-9e78f2fde40f admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:30:25.576843 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce6a240-71e0-48de-83dd-b37a77508c0a None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:30:25.581760 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e68812-9e50-41b3-900f-de8001d6d8d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b0b3ca4ecd41aaba9cf8e0f91fbf54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:30:25.582372 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e68812-9e50-41b3-900f-de8001d6d8d1 service neutron] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:30:25.582696 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e68812-9e50-41b3-900f-de8001d6d8d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:30:25.582972 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e68812-9e50-41b3-900f-de8001d6d8d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:30:25.584017 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb5f8e5-93fe-428c-8397-f30b58c3adf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:30:25.584929 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb5f8e5-93fe-428c-8397-f30b58c3adf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:30:25.585281 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb5f8e5-93fe-428c-8397-f30b58c3adf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:30:25.585628 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb5f8e5-93fe-428c-8397-f30b58c3adf3 admin admin] PATH_INFO: `/v3/users/1d4191add4b14874919c78df8b2faa56` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:30:25.586908 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb5f8e5-93fe-428c-8397-f30b58c3adf3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d4191add4b14874919c78df8b2faa56)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:30:25.588896 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb5f8e5-93fe-428c-8397-f30b58c3adf3 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:30:25.590856 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e68812-9e50-41b3-900f-de8001d6d8d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:30:25.592622 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e68812-9e50-41b3-900f-de8001d6d8d1 service neutron] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:30:25.602097 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1264/2525] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:30:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 20 22:30:25.640228 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-7eb5f8e5-93fe-428c-8397-f30b58c3adf3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d4191add4b14874919c78df8b2faa56'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:30:25.649235 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-7eb5f8e5-93fe-428c-8397-f30b58c3adf3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d4191add4b14874919c78df8b2faa56'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:30:25.649904 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-7eb5f8e5-93fe-428c-8397-f30b58c3adf3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d4191add4b14874919c78df8b2faa56'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:30:25.650544 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-7eb5f8e5-93fe-428c-8397-f30b58c3adf3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d4191add4b14874919c78df8b2faa56'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:30:25.657854 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-7eb5f8e5-93fe-428c-8397-f30b58c3adf3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d4191add4b14874919c78df8b2faa56'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:30:25.678945 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1262/2526] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 20 22:30:25 2022] DELETE /identity/v3/users/1d4191add4b14874919c78df8b2faa56 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:30:25.692668 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5569a109-69d4-4e6f-b0af-81b0361087a1 None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:30:25.693035 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5569a109-69d4-4e6f-b0af-81b0361087a1 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:30:25.693381 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5569a109-69d4-4e6f-b0af-81b0361087a1 None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:30:25.694934 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1265/2527] 10.222.0.33 () {54 vars in 921 bytes} [Tue Sep 20 22:30:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:30:25.701004 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f4c31-9609-44e8-94cd-351a691134fc None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:30:25.701349 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f4c31-9609-44e8-94cd-351a691134fc None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:30:25.701673 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f4c31-9609-44e8-94cd-351a691134fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:30:25.722211 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-c04f4c31-9609-44e8-94cd-351a691134fc None None] MFA Rules not processed for user `db7eed561e99452289a662ad326cf919`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:30:25.723758 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-c04f4c31-9609-44e8-94cd-351a691134fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:30:25.777587 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:30:25.799303 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1263/2528] 10.222.0.33 () {58 vars in 1018 bytes} [Tue Sep 20 22:30:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:30:25.810362 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5569a109-69d4-4e6f-b0af-81b0361087a1 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:30:25.812081 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-5569a109-69d4-4e6f-b0af-81b0361087a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:30:25.877053 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5569a109-69d4-4e6f-b0af-81b0361087a1 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:30:25.880854 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81383183-ba5c-473d-9b9a-b148369bf6e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b0b3ca4ecd41aaba9cf8e0f91fbf54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:30:25.881458 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81383183-ba5c-473d-9b9a-b148369bf6e4 service neutron] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:30:25.881745 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81383183-ba5c-473d-9b9a-b148369bf6e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:30:25.882019 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81383183-ba5c-473d-9b9a-b148369bf6e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:30:25.892295 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81383183-ba5c-473d-9b9a-b148369bf6e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:30:25.893856 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81383183-ba5c-473d-9b9a-b148369bf6e4 service neutron] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:30:25.904655 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1266/2529] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:30:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:30:25.973613 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04f4c31-9609-44e8-94cd-351a691134fc None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:30:25.975136 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-c04f4c31-9609-44e8-94cd-351a691134fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:30:26.048707 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04f4c31-9609-44e8-94cd-351a691134fc None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:30:26.053444 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b4cc05-84f3-4548-83e0-84a87a02c8b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:30:26.054199 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b4cc05-84f3-4548-83e0-84a87a02c8b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:30:26.054487 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b4cc05-84f3-4548-83e0-84a87a02c8b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:30:26.054842 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b4cc05-84f3-4548-83e0-84a87a02c8b1 admin admin] PATH_INFO: `/v3/projects/8f90ff89a3534621ad4a32c06c1795e7` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:30:26.056547 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b4cc05-84f3-4548-83e0-84a87a02c8b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f90ff89a3534621ad4a32c06c1795e7)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:30:26.058535 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b4cc05-84f3-4548-83e0-84a87a02c8b1 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:30:26.108505 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-97b4cc05-84f3-4548-83e0-84a87a02c8b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f90ff89a3534621ad4a32c06c1795e7', 'request_id': 'req-97b4cc05-84f3-4548-83e0-84a87a02c8b1'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:30:26.114653 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-97b4cc05-84f3-4548-83e0-84a87a02c8b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f90ff89a3534621ad4a32c06c1795e7', 'request_id': 'req-97b4cc05-84f3-4548-83e0-84a87a02c8b1'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:30:26.122564 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-97b4cc05-84f3-4548-83e0-84a87a02c8b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f90ff89a3534621ad4a32c06c1795e7', 'request_id': 'req-97b4cc05-84f3-4548-83e0-84a87a02c8b1'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:30:26.133416 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-97b4cc05-84f3-4548-83e0-84a87a02c8b1 admin admin] The token cache is being invalidate because project 8f90ff89a3534621ad4a32c06c1795e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81307) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 22:30:26.133706 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-97b4cc05-84f3-4548-83e0-84a87a02c8b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:30:26.134456 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-97b4cc05-84f3-4548-83e0-84a87a02c8b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:30:26.135939 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1264/2530] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 20 22:30:25 2022] DELETE /identity/v3/projects/8f90ff89a3534621ad4a32c06c1795e7 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:30:26.141302 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0482eaa7-874e-4695-a76c-5769e6561453 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:30:26.142624 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0482eaa7-874e-4695-a76c-5769e6561453 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:30:26.142624 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0482eaa7-874e-4695-a76c-5769e6561453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:30:26.172416 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-0482eaa7-874e-4695-a76c-5769e6561453 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:30:26.173742 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-0482eaa7-874e-4695-a76c-5769e6561453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:30:26.204934 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:30:26.236525 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1267/2531] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:30:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:30:26.244084 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8817200c-30ec-4551-8b48-9e6d26f9105a None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:30:26.244376 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8817200c-30ec-4551-8b48-9e6d26f9105a None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:30:26.244653 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8817200c-30ec-4551-8b48-9e6d26f9105a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:30:26.266873 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-8817200c-30ec-4551-8b48-9e6d26f9105a None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:30:26.268090 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-8817200c-30ec-4551-8b48-9e6d26f9105a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:30:26.277203 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1265/2532] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:30:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:30:26.281422 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0482eaa7-874e-4695-a76c-5769e6561453 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:30:26.292551 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0482eaa7-874e-4695-a76c-5769e6561453 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:30:26.297469 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22461853-5330-4ef9-89f4-82cac779b805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:30:26.298105 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22461853-5330-4ef9-89f4-82cac779b805 admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:30:26.298381 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22461853-5330-4ef9-89f4-82cac779b805 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:30:26.298691 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22461853-5330-4ef9-89f4-82cac779b805 admin admin] PATH_INFO: `/v3/domains` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:30:26.299339 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22461853-5330-4ef9-89f4-82cac779b805 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:30:26.299634 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22461853-5330-4ef9-89f4-82cac779b805 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:30:26.301221 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22461853-5330-4ef9-89f4-82cac779b805 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:30:26.313364 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1268/2533] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 20 22:30:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 22:30:26.317998 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8817200c-30ec-4551-8b48-9e6d26f9105a None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:30:26.327675 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8817200c-30ec-4551-8b48-9e6d26f9105a None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:30:26.332487 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7d1acb-6bc7-4620-a107-64d9d34b97cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:30:26.333091 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d1acb-6bc7-4620-a107-64d9d34b97cd admin admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:30:26.333368 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d1acb-6bc7-4620-a107-64d9d34b97cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:30:26.333638 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d1acb-6bc7-4620-a107-64d9d34b97cd admin admin] PATH_INFO: `/v3/projects` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:30:26.334278 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7d1acb-6bc7-4620-a107-64d9d34b97cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:30:26.336213 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7d1acb-6bc7-4620-a107-64d9d34b97cd admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:30:26.366560 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1266/2534] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 20 22:30:26 2022] POST /identity/v3/projects => generated 365 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:30:26.370007 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22461853-5330-4ef9-89f4-82cac779b805 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:30:26.379948 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22461853-5330-4ef9-89f4-82cac779b805 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:30:26.437191 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4255c0a6-2456-4fac-8c5b-eb5c9b4222fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:30:26.437803 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4255c0a6-2456-4fac-8c5b-eb5c9b4222fe admin admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:30:26.438229 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4255c0a6-2456-4fac-8c5b-eb5c9b4222fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:30:26.438523 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4255c0a6-2456-4fac-8c5b-eb5c9b4222fe admin admin] PATH_INFO: `/v3/users` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:30:26.439272 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4255c0a6-2456-4fac-8c5b-eb5c9b4222fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:30:26.441177 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4255c0a6-2456-4fac-8c5b-eb5c9b4222fe admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:30:26.465429 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1269/2535] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 20 22:30:26 2022] POST /identity/v3/users => generated 283 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:30:26.469280 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7d1acb-6bc7-4620-a107-64d9d34b97cd admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:30:26.479726 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7d1acb-6bc7-4620-a107-64d9d34b97cd admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:30:26.484654 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7440eb83-a420-4321-8015-bf5a0c5b612f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:30:26.485295 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7440eb83-a420-4321-8015-bf5a0c5b612f admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:30:26.485576 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7440eb83-a420-4321-8015-bf5a0c5b612f admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:30:26.485847 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7440eb83-a420-4321-8015-bf5a0c5b612f admin admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:30:26.486580 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7440eb83-a420-4321-8015-bf5a0c5b612f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:30:26.488255 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7440eb83-a420-4321-8015-bf5a0c5b612f admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:30:26.498393 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1267/2536] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:30:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:30:26.502718 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4255c0a6-2456-4fac-8c5b-eb5c9b4222fe admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:30:26.514198 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4255c0a6-2456-4fac-8c5b-eb5c9b4222fe admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:30:26.519893 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8535ae9e-88b9-4479-9d51-45c5e3ca046f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:30:26.520787 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8535ae9e-88b9-4479-9d51-45c5e3ca046f admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:30:26.521124 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8535ae9e-88b9-4479-9d51-45c5e3ca046f admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:30:26.521343 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8535ae9e-88b9-4479-9d51-45c5e3ca046f admin admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:30:26.522293 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8535ae9e-88b9-4479-9d51-45c5e3ca046f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:30:26.524200 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8535ae9e-88b9-4479-9d51-45c5e3ca046f admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:30:26.537054 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1270/2537] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:30:26 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:30:26.541468 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7440eb83-a420-4321-8015-bf5a0c5b612f admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:30:26.552990 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7440eb83-a420-4321-8015-bf5a0c5b612f admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:30:26.557773 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d55b7b2-f4b4-4a86-9756-747037d94334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:30:26.558434 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d55b7b2-f4b4-4a86-9756-747037d94334 admin admin] REQUEST_METHOD: `PUT` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:30:26.558748 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d55b7b2-f4b4-4a86-9756-747037d94334 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:30:26.559024 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d55b7b2-f4b4-4a86-9756-747037d94334 admin admin] PATH_INFO: `/v3/projects/43310d84bcdc4e87a24b18e91f477cf1/users/afab43f8dca647169b09a1aa23262860/roles/604444e7ad0d437dbd1f5a6e02b761f5` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:30:26.576900 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d55b7b2-f4b4-4a86-9756-747037d94334 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43310d84bcdc4e87a24b18e91f477cf1, user_id=afab43f8dca647169b09a1aa23262860, role_id=604444e7ad0d437dbd1f5a6e02b761f5)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:30:26.579639 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d55b7b2-f4b4-4a86-9756-747037d94334 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:30:26.593215 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1268/2538] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:30:26 2022] PUT /identity/v3/projects/43310d84bcdc4e87a24b18e91f477cf1/users/afab43f8dca647169b09a1aa23262860/roles/604444e7ad0d437dbd1f5a6e02b761f5 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 22:30:26.603517 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7077fbcf-8661-4ff6-9fd7-59f927ad1d7a None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:30:26.603802 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7077fbcf-8661-4ff6-9fd7-59f927ad1d7a None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:30:26.604138 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7077fbcf-8661-4ff6-9fd7-59f927ad1d7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:30:26.635151 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-7077fbcf-8661-4ff6-9fd7-59f927ad1d7a None None] MFA Rules not processed for user `afab43f8dca647169b09a1aa23262860`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:30:26.636541 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-7077fbcf-8661-4ff6-9fd7-59f927ad1d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:30:26.714099 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1271/2539] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:30:26 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:30:26.718902 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d55b7b2-f4b4-4a86-9756-747037d94334 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:30:26.734017 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:30:26.804103 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d55b7b2-f4b4-4a86-9756-747037d94334 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:30:26.804103 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7d7b95-cbb2-4937-9233-0a468f162ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:30:26.804103 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7d7b95-cbb2-4937-9233-0a468f162ac9 admin admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:30:26.804103 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7d7b95-cbb2-4937-9233-0a468f162ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:30:26.804517 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7d7b95-cbb2-4937-9233-0a468f162ac9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:30:26.804923 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7d7b95-cbb2-4937-9233-0a468f162ac9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:30:26.808504 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7d7b95-cbb2-4937-9233-0a468f162ac9 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:30:26.839715 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1269/2540] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 20 22:30:26 2022] POST /identity/v3/projects => generated 367 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 20 22:30:26.840948 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7077fbcf-8661-4ff6-9fd7-59f927ad1d7a None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:30:26.851664 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7077fbcf-8661-4ff6-9fd7-59f927ad1d7a None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:30:26.884938 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:30:26.917476 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2e23b6-f77c-4b5f-8b9e-2a065db14073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:30:26.918177 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2e23b6-f77c-4b5f-8b9e-2a065db14073 admin admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:30:26.918461 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2e23b6-f77c-4b5f-8b9e-2a065db14073 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:30:26.918773 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2e23b6-f77c-4b5f-8b9e-2a065db14073 admin admin] PATH_INFO: `/v3/users` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:30:26.919407 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2e23b6-f77c-4b5f-8b9e-2a065db14073 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:30:26.921299 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2e23b6-f77c-4b5f-8b9e-2a065db14073 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:30:26.949598 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1272/2541] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 20 22:30:26 2022] POST /identity/v3/users => generated 290 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:30:26.951054 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7d7b95-cbb2-4937-9233-0a468f162ac9 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:30:26.962546 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7d7b95-cbb2-4937-9233-0a468f162ac9 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:30:26.967592 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77c1ea6-1677-475c-90b9-81d895ccd36d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:30:26.968416 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77c1ea6-1677-475c-90b9-81d895ccd36d admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:30:26.968865 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77c1ea6-1677-475c-90b9-81d895ccd36d admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:30:26.969142 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77c1ea6-1677-475c-90b9-81d895ccd36d admin admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:30:26.969792 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77c1ea6-1677-475c-90b9-81d895ccd36d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:30:26.971429 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77c1ea6-1677-475c-90b9-81d895ccd36d admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:30:26.983360 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1270/2542] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:30:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:30:26.989305 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2e23b6-f77c-4b5f-8b9e-2a065db14073 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:30:27.002431 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2e23b6-f77c-4b5f-8b9e-2a065db14073 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:30:27.008113 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588d9b53-4075-41d6-9110-2a020b13e4f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:30:27.008898 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d9b53-4075-41d6-9110-2a020b13e4f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:30:27.009244 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d9b53-4075-41d6-9110-2a020b13e4f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:30:27.009589 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d9b53-4075-41d6-9110-2a020b13e4f1 admin admin] PATH_INFO: `/v3/projects/8df23f776cc44fc2a127b78c856bd6dc/users/4989fa8afda0438e82e0479bcd132ba0/roles/8a829170b29d42d6af589399e51edb0f` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:30:27.029270 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77c1ea6-1677-475c-90b9-81d895ccd36d admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:30:27.031796 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-e77c1ea6-1677-475c-90b9-81d895ccd36d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:30:27.038990 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588d9b53-4075-41d6-9110-2a020b13e4f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8df23f776cc44fc2a127b78c856bd6dc, user_id=4989fa8afda0438e82e0479bcd132ba0, role_id=8a829170b29d42d6af589399e51edb0f)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:30:27.042321 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588d9b53-4075-41d6-9110-2a020b13e4f1 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:30:27.061654 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1273/2543] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:30:26 2022] PUT /identity/v3/projects/8df23f776cc44fc2a127b78c856bd6dc/users/4989fa8afda0438e82e0479bcd132ba0/roles/8a829170b29d42d6af589399e51edb0f => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:30:27.064348 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588d9b53-4075-41d6-9110-2a020b13e4f1 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:30:27.116229 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77c1ea6-1677-475c-90b9-81d895ccd36d admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:30:27.136750 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588d9b53-4075-41d6-9110-2a020b13e4f1 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:30:27.141464 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b4caa7-ba34-48f2-96a7-46b934529b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:30:27.142063 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b4caa7-ba34-48f2-96a7-46b934529b1e admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:30:27.142339 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b4caa7-ba34-48f2-96a7-46b934529b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:30:27.142663 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b4caa7-ba34-48f2-96a7-46b934529b1e admin admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:30:27.143322 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b4caa7-ba34-48f2-96a7-46b934529b1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:30:27.144896 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b4caa7-ba34-48f2-96a7-46b934529b1e admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:30:27.156907 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1274/2544] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:30:27 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 20 22:30:27.160942 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b4caa7-ba34-48f2-96a7-46b934529b1e admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:30:27.171463 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b4caa7-ba34-48f2-96a7-46b934529b1e admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:30:27.176083 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877fca3e-b6af-4987-80d1-f7c350b05955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:30:27.176705 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877fca3e-b6af-4987-80d1-f7c350b05955 admin admin] REQUEST_METHOD: `PUT` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:30:27.176979 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877fca3e-b6af-4987-80d1-f7c350b05955 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:30:27.177249 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877fca3e-b6af-4987-80d1-f7c350b05955 admin admin] PATH_INFO: `/v3/projects/8df23f776cc44fc2a127b78c856bd6dc/users/4989fa8afda0438e82e0479bcd132ba0/roles/8a829170b29d42d6af589399e51edb0f` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:30:27.179207 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877fca3e-b6af-4987-80d1-f7c350b05955 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8df23f776cc44fc2a127b78c856bd6dc, user_id=4989fa8afda0438e82e0479bcd132ba0, role_id=8a829170b29d42d6af589399e51edb0f)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:30:27.181866 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877fca3e-b6af-4987-80d1-f7c350b05955 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:30:27.185255 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f010813-ee9d-4242-a0ea-43043465bf64 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db7eed561e99452289a662ad326cf919', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:30:27.185869 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f010813-ee9d-4242-a0ea-43043465bf64 service nova] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:30:27.186146 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f010813-ee9d-4242-a0ea-43043465bf64 service nova] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:30:27.186416 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f010813-ee9d-4242-a0ea-43043465bf64 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:30:27.188211 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-1f010813-ee9d-4242-a0ea-43043465bf64 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:30:27.191990 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1275/2545] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:30:27 2022] PUT /identity/v3/projects/8df23f776cc44fc2a127b78c856bd6dc/users/4989fa8afda0438e82e0479bcd132ba0/roles/8a829170b29d42d6af589399e51edb0f => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 22:30:27.200785 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f010813-ee9d-4242-a0ea-43043465bf64 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:30:27.202485 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f010813-ee9d-4242-a0ea-43043465bf64 service nova] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:30:27.203676 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f402c53-2f4e-4567-bd06-f679e8f4b174 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:30:27.203961 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f402c53-2f4e-4567-bd06-f679e8f4b174 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:30:27.204230 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f402c53-2f4e-4567-bd06-f679e8f4b174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:30:27.214776 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1271/2546] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:30:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:30:27.237735 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-1f402c53-2f4e-4567-bd06-f679e8f4b174 None None] MFA Rules not processed for user `4989fa8afda0438e82e0479bcd132ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:30:27.239046 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-1f402c53-2f4e-4567-bd06-f679e8f4b174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:30:27.312847 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1276/2547] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:30:27 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 22:30:27.324789 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f010813-ee9d-4242-a0ea-43043465bf64 service nova] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:30:27.326951 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-1f010813-ee9d-4242-a0ea-43043465bf64 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:30:27.341640 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:30:27.386343 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f010813-ee9d-4242-a0ea-43043465bf64 service nova] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:30:27.440993 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6be2f1-760d-4198-9ae2-78d6d33c166a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577c8b14c1f4279beac13b9ba11aba1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:30:27.441606 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6be2f1-760d-4198-9ae2-78d6d33c166a service cinder] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:30:27.441883 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6be2f1-760d-4198-9ae2-78d6d33c166a service cinder] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:30:27.442152 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6be2f1-760d-4198-9ae2-78d6d33c166a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:30:27.452672 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6be2f1-760d-4198-9ae2-78d6d33c166a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:30:27.454195 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6be2f1-760d-4198-9ae2-78d6d33c166a service cinder] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:30:27.464637 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1272/2548] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:30:27 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:30:27.552822 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f402c53-2f4e-4567-bd06-f679e8f4b174 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:30:27.559177 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:30:27.563550 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f402c53-2f4e-4567-bd06-f679e8f4b174 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:30:27.568368 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0162541b-64a6-4926-ab1d-4bbd135244f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577c8b14c1f4279beac13b9ba11aba1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:30:27.568986 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0162541b-64a6-4926-ab1d-4bbd135244f8 service cinder] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:30:27.569268 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0162541b-64a6-4926-ab1d-4bbd135244f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:30:27.569544 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0162541b-64a6-4926-ab1d-4bbd135244f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:30:27.628091 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0162541b-64a6-4926-ab1d-4bbd135244f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:30:27.629470 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0162541b-64a6-4926-ab1d-4bbd135244f8 service cinder] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:30:27.639208 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1277/2549] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:30:27 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:30:32.434088 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6be2f1-760d-4198-9ae2-78d6d33c166a service cinder] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:30:32.505154 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6be2f1-760d-4198-9ae2-78d6d33c166a service cinder] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:30:32.510171 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1925699-19d3-429b-b746-5191adbe411b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:30:32.510881 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1925699-19d3-429b-b746-5191adbe411b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:30:32.511159 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1925699-19d3-429b-b746-5191adbe411b admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:30:32.511476 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1925699-19d3-429b-b746-5191adbe411b admin admin] PATH_INFO: `/v3/users/afab43f8dca647169b09a1aa23262860` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:30:32.512667 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1925699-19d3-429b-b746-5191adbe411b admin admin] RBAC: Authorizing `identity:delete_user(user_id=afab43f8dca647169b09a1aa23262860)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:30:32.514752 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1925699-19d3-429b-b746-5191adbe411b admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:30:32.566637 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-c1925699-19d3-429b-b746-5191adbe411b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afab43f8dca647169b09a1aa23262860'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:30:32.574482 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-c1925699-19d3-429b-b746-5191adbe411b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afab43f8dca647169b09a1aa23262860'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:30:32.575174 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-c1925699-19d3-429b-b746-5191adbe411b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afab43f8dca647169b09a1aa23262860'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:30:32.575792 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-c1925699-19d3-429b-b746-5191adbe411b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afab43f8dca647169b09a1aa23262860'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:30:32.583691 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-c1925699-19d3-429b-b746-5191adbe411b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afab43f8dca647169b09a1aa23262860'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:30:32.591468 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:30:32.607879 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1273/2550] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 20 22:30:32 2022] DELETE /identity/v3/users/afab43f8dca647169b09a1aa23262860 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:30:32.612523 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facae24f-0b04-42ab-9358-6e6129017f81 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:30:32.613007 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facae24f-0b04-42ab-9358-6e6129017f81 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:30:32.613114 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facae24f-0b04-42ab-9358-6e6129017f81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:30:32.636962 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-facae24f-0b04-42ab-9358-6e6129017f81 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:30:32.638268 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-facae24f-0b04-42ab-9358-6e6129017f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:30:32.704822 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1278/2551] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:30:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:30:32.717892 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1925699-19d3-429b-b746-5191adbe411b admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:30:32.718154 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-c1925699-19d3-429b-b746-5191adbe411b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:30:32.791726 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1925699-19d3-429b-b746-5191adbe411b admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:30:32.796251 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ed50e8-5a4c-42a0-ab00-9f44805b39c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b0b3ca4ecd41aaba9cf8e0f91fbf54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:30:32.796930 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ed50e8-5a4c-42a0-ab00-9f44805b39c6 service neutron] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:30:32.801224 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ed50e8-5a4c-42a0-ab00-9f44805b39c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:30:32.801511 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ed50e8-5a4c-42a0-ab00-9f44805b39c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:30:32.816936 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ed50e8-5a4c-42a0-ab00-9f44805b39c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:30:32.818378 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ed50e8-5a4c-42a0-ab00-9f44805b39c6 service neutron] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:30:32.828381 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1274/2552] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:30:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:30:33.139644 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facae24f-0b04-42ab-9358-6e6129017f81 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:30:33.141350 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-facae24f-0b04-42ab-9358-6e6129017f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:30:33.162200 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facae24f-0b04-42ab-9358-6e6129017f81 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:30:33.169785 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e6cf33-be38-4c66-a4d0-57f3ba70d78f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:30:33.170728 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e6cf33-be38-4c66-a4d0-57f3ba70d78f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:30:33.171097 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e6cf33-be38-4c66-a4d0-57f3ba70d78f admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:30:33.171345 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e6cf33-be38-4c66-a4d0-57f3ba70d78f admin admin] PATH_INFO: `/v3/projects/43310d84bcdc4e87a24b18e91f477cf1` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:30:33.172537 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e6cf33-be38-4c66-a4d0-57f3ba70d78f admin admin] RBAC: Authorizing `identity:delete_project(project_id=43310d84bcdc4e87a24b18e91f477cf1)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:30:33.174490 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e6cf33-be38-4c66-a4d0-57f3ba70d78f admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:30:33.235458 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-34e6cf33-be38-4c66-a4d0-57f3ba70d78f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43310d84bcdc4e87a24b18e91f477cf1', 'request_id': 'req-34e6cf33-be38-4c66-a4d0-57f3ba70d78f'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:30:33.243107 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-34e6cf33-be38-4c66-a4d0-57f3ba70d78f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43310d84bcdc4e87a24b18e91f477cf1', 'request_id': 'req-34e6cf33-be38-4c66-a4d0-57f3ba70d78f'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:30:33.251557 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-34e6cf33-be38-4c66-a4d0-57f3ba70d78f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43310d84bcdc4e87a24b18e91f477cf1', 'request_id': 'req-34e6cf33-be38-4c66-a4d0-57f3ba70d78f'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:30:33.264222 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-34e6cf33-be38-4c66-a4d0-57f3ba70d78f admin admin] The token cache is being invalidate because project 43310d84bcdc4e87a24b18e91f477cf1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81306) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 22:30:33.264558 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-34e6cf33-be38-4c66-a4d0-57f3ba70d78f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:30:33.265216 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-34e6cf33-be38-4c66-a4d0-57f3ba70d78f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:30:33.266862 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1279/2553] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 20 22:30:33 2022] DELETE /identity/v3/projects/43310d84bcdc4e87a24b18e91f477cf1 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:30:33.270870 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ed50e8-5a4c-42a0-ab00-9f44805b39c6 service neutron] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:30:33.282473 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ed50e8-5a4c-42a0-ab00-9f44805b39c6 service neutron] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:30:33.353145 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82170403-b634-42ad-ab0f-4041dcbd7ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:30:33.353788 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82170403-b634-42ad-ab0f-4041dcbd7ae4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:30:33.354064 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82170403-b634-42ad-ab0f-4041dcbd7ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:30:33.354335 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82170403-b634-42ad-ab0f-4041dcbd7ae4 admin admin] PATH_INFO: `/v3/users/4989fa8afda0438e82e0479bcd132ba0` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:30:33.355577 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82170403-b634-42ad-ab0f-4041dcbd7ae4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4989fa8afda0438e82e0479bcd132ba0)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:30:33.357512 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82170403-b634-42ad-ab0f-4041dcbd7ae4 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:30:33.410217 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-82170403-b634-42ad-ab0f-4041dcbd7ae4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4989fa8afda0438e82e0479bcd132ba0'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:30:33.419395 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-82170403-b634-42ad-ab0f-4041dcbd7ae4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4989fa8afda0438e82e0479bcd132ba0'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:30:33.420144 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-82170403-b634-42ad-ab0f-4041dcbd7ae4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4989fa8afda0438e82e0479bcd132ba0'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:30:33.421057 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-82170403-b634-42ad-ab0f-4041dcbd7ae4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4989fa8afda0438e82e0479bcd132ba0'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:30:33.431048 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-82170403-b634-42ad-ab0f-4041dcbd7ae4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4989fa8afda0438e82e0479bcd132ba0'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:30:33.459502 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1275/2554] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 20 22:30:33 2022] DELETE /identity/v3/users/4989fa8afda0438e82e0479bcd132ba0 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:30:33.742419 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e6cf33-be38-4c66-a4d0-57f3ba70d78f admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:30:33.744031 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-34e6cf33-be38-4c66-a4d0-57f3ba70d78f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:30:33.761069 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e6cf33-be38-4c66-a4d0-57f3ba70d78f admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:30:33.799819 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:30:33.844985 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62debea1-2e60-4504-9c62-c9cbaac2d534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:30:33.845637 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62debea1-2e60-4504-9c62-c9cbaac2d534 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:30:33.845914 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62debea1-2e60-4504-9c62-c9cbaac2d534 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:30:33.846183 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62debea1-2e60-4504-9c62-c9cbaac2d534 admin admin] PATH_INFO: `/v3/projects/8df23f776cc44fc2a127b78c856bd6dc` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:30:33.847559 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62debea1-2e60-4504-9c62-c9cbaac2d534 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8df23f776cc44fc2a127b78c856bd6dc)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:30:33.849623 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62debea1-2e60-4504-9c62-c9cbaac2d534 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:30:33.901749 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-62debea1-2e60-4504-9c62-c9cbaac2d534 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8df23f776cc44fc2a127b78c856bd6dc', 'request_id': 'req-62debea1-2e60-4504-9c62-c9cbaac2d534'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:30:33.908264 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-62debea1-2e60-4504-9c62-c9cbaac2d534 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8df23f776cc44fc2a127b78c856bd6dc', 'request_id': 'req-62debea1-2e60-4504-9c62-c9cbaac2d534'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:30:33.920838 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-62debea1-2e60-4504-9c62-c9cbaac2d534 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8df23f776cc44fc2a127b78c856bd6dc', 'request_id': 'req-62debea1-2e60-4504-9c62-c9cbaac2d534'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:30:33.933359 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-62debea1-2e60-4504-9c62-c9cbaac2d534 admin admin] The token cache is being invalidate because project 8df23f776cc44fc2a127b78c856bd6dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81306) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 22:30:33.933998 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-62debea1-2e60-4504-9c62-c9cbaac2d534 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:30:33.934724 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-62debea1-2e60-4504-9c62-c9cbaac2d534 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:30:33.936319 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1280/2555] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 20 22:30:33 2022] DELETE /identity/v3/projects/8df23f776cc44fc2a127b78c856bd6dc => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:30:33.941489 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bc9814-715b-46a1-98c5-5e54bac588e2 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:30:33.942095 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bc9814-715b-46a1-98c5-5e54bac588e2 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:30:33.942095 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bc9814-715b-46a1-98c5-5e54bac588e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:30:33.966809 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-30bc9814-715b-46a1-98c5-5e54bac588e2 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:30:33.968030 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-30bc9814-715b-46a1-98c5-5e54bac588e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:30:33.976003 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:30:34.033834 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1276/2556] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:30:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 22:30:34.042003 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422d44a3-fa8b-47cb-b70d-93fd7a6d892f None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:30:34.042293 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422d44a3-fa8b-47cb-b70d-93fd7a6d892f None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:30:34.042606 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422d44a3-fa8b-47cb-b70d-93fd7a6d892f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:30:34.063209 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-422d44a3-fa8b-47cb-b70d-93fd7a6d892f None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:30:34.064418 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-422d44a3-fa8b-47cb-b70d-93fd7a6d892f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:30:34.074756 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1281/2557] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:30:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:30:34.079132 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bc9814-715b-46a1-98c5-5e54bac588e2 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:30:34.089515 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bc9814-715b-46a1-98c5-5e54bac588e2 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:30:34.094183 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1c5a7f-cc72-46a7-b0e5-3b523bcf5789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:30:34.094840 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c5a7f-cc72-46a7-b0e5-3b523bcf5789 admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:30:34.095155 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c5a7f-cc72-46a7-b0e5-3b523bcf5789 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:30:34.095458 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c5a7f-cc72-46a7-b0e5-3b523bcf5789 admin admin] PATH_INFO: `/v3/domains` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:30:34.096019 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1c5a7f-cc72-46a7-b0e5-3b523bcf5789 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:30:34.096331 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1c5a7f-cc72-46a7-b0e5-3b523bcf5789 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:30:34.097929 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1c5a7f-cc72-46a7-b0e5-3b523bcf5789 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:30:34.116397 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1277/2558] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 20 22:30:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:30:34.121121 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422d44a3-fa8b-47cb-b70d-93fd7a6d892f None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:30:34.130618 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422d44a3-fa8b-47cb-b70d-93fd7a6d892f None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:30:34.136136 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d334c5-1728-45bb-a275-9af56c207dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:30:34.136742 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d334c5-1728-45bb-a275-9af56c207dd1 admin admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:30:34.137015 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d334c5-1728-45bb-a275-9af56c207dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:30:34.137308 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d334c5-1728-45bb-a275-9af56c207dd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:30:34.137970 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d334c5-1728-45bb-a275-9af56c207dd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:30:34.140004 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d334c5-1728-45bb-a275-9af56c207dd1 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:30:34.173210 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1282/2559] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 20 22:30:34 2022] POST /identity/v3/projects => generated 371 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 20 22:30:34.177377 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1c5a7f-cc72-46a7-b0e5-3b523bcf5789 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:30:34.187807 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1c5a7f-cc72-46a7-b0e5-3b523bcf5789 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:30:34.246010 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d270026-13be-4c4d-8002-e322dcea140d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:30:34.246668 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d270026-13be-4c4d-8002-e322dcea140d admin admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:30:34.246948 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d270026-13be-4c4d-8002-e322dcea140d admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:30:34.247220 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d270026-13be-4c4d-8002-e322dcea140d admin admin] PATH_INFO: `/v3/users` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:30:34.247860 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d270026-13be-4c4d-8002-e322dcea140d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:30:34.249827 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d270026-13be-4c4d-8002-e322dcea140d admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:30:34.271132 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1278/2560] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 20 22:30:34 2022] POST /identity/v3/users => generated 286 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 20 22:30:34.275816 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d334c5-1728-45bb-a275-9af56c207dd1 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:30:34.288232 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d334c5-1728-45bb-a275-9af56c207dd1 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:30:34.293467 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be29d9c6-e1b0-45a2-a26d-7c1e304fffd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:30:34.294042 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be29d9c6-e1b0-45a2-a26d-7c1e304fffd8 admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:30:34.294316 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be29d9c6-e1b0-45a2-a26d-7c1e304fffd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:30:34.294616 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be29d9c6-e1b0-45a2-a26d-7c1e304fffd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:30:34.299046 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be29d9c6-e1b0-45a2-a26d-7c1e304fffd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:30:34.299046 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be29d9c6-e1b0-45a2-a26d-7c1e304fffd8 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:30:34.308756 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1283/2561] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:30:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 20 22:30:34.312801 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d270026-13be-4c4d-8002-e322dcea140d admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:30:34.323323 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d270026-13be-4c4d-8002-e322dcea140d admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:30:34.327952 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2407c6a-390a-432f-97ac-d89e983e6104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:30:34.328544 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2407c6a-390a-432f-97ac-d89e983e6104 admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:30:34.328822 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2407c6a-390a-432f-97ac-d89e983e6104 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:30:34.329091 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2407c6a-390a-432f-97ac-d89e983e6104 admin admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:30:34.329731 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2407c6a-390a-432f-97ac-d89e983e6104 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:30:34.331379 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2407c6a-390a-432f-97ac-d89e983e6104 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:30:34.342620 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1279/2562] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:30:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 20 22:30:34.346978 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be29d9c6-e1b0-45a2-a26d-7c1e304fffd8 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:30:34.357068 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be29d9c6-e1b0-45a2-a26d-7c1e304fffd8 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:30:34.361661 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a06d530-2610-47d3-a061-657e5e4627c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:30:34.362306 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a06d530-2610-47d3-a061-657e5e4627c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:30:34.362623 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a06d530-2610-47d3-a061-657e5e4627c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:30:34.362894 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a06d530-2610-47d3-a061-657e5e4627c7 admin admin] PATH_INFO: `/v3/projects/3b3acc723d7c445fa5f4652785baee16/users/2111ad84b844455d9bf4b7a2038e9ab0/roles/604444e7ad0d437dbd1f5a6e02b761f5` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:30:34.378177 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a06d530-2610-47d3-a061-657e5e4627c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b3acc723d7c445fa5f4652785baee16, user_id=2111ad84b844455d9bf4b7a2038e9ab0, role_id=604444e7ad0d437dbd1f5a6e02b761f5)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:30:34.380862 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a06d530-2610-47d3-a061-657e5e4627c7 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:30:34.395034 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1284/2563] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:30:34 2022] PUT /identity/v3/projects/3b3acc723d7c445fa5f4652785baee16/users/2111ad84b844455d9bf4b7a2038e9ab0/roles/604444e7ad0d437dbd1f5a6e02b761f5 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 22:30:34.406602 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990c4cd2-ec64-477e-8cad-3c770eb4f4ea None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:30:34.406907 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990c4cd2-ec64-477e-8cad-3c770eb4f4ea None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:30:34.407177 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990c4cd2-ec64-477e-8cad-3c770eb4f4ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:30:34.437358 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-990c4cd2-ec64-477e-8cad-3c770eb4f4ea None None] MFA Rules not processed for user `2111ad84b844455d9bf4b7a2038e9ab0`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:30:34.438603 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-990c4cd2-ec64-477e-8cad-3c770eb4f4ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:30:34.506822 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1280/2564] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:30:34 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:30:34.518901 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a06d530-2610-47d3-a061-657e5e4627c7 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:30:34.520629 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-9a06d530-2610-47d3-a061-657e5e4627c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:30:34.580075 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a06d530-2610-47d3-a061-657e5e4627c7 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:30:34.583705 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5a7141-b9e2-4a81-9182-64a3402a48af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577c8b14c1f4279beac13b9ba11aba1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:30:34.584305 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5a7141-b9e2-4a81-9182-64a3402a48af service cinder] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:30:34.584582 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5a7141-b9e2-4a81-9182-64a3402a48af service cinder] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:30:34.584851 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5a7141-b9e2-4a81-9182-64a3402a48af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:30:34.592201 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:30:34.594627 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5a7141-b9e2-4a81-9182-64a3402a48af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:30:34.596388 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5a7141-b9e2-4a81-9182-64a3402a48af service cinder] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:30:34.607086 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1285/2565] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:30:34 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:30:34.629618 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990c4cd2-ec64-477e-8cad-3c770eb4f4ea None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:30:34.639934 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:30:34.694886 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990c4cd2-ec64-477e-8cad-3c770eb4f4ea None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:30:34.700786 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd74a8a-b049-4449-96ff-2ce19a0e0d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:30:34.701568 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd74a8a-b049-4449-96ff-2ce19a0e0d5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:30:34.701849 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd74a8a-b049-4449-96ff-2ce19a0e0d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:30:34.702119 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd74a8a-b049-4449-96ff-2ce19a0e0d5e admin admin] PATH_INFO: `/v3/users/2111ad84b844455d9bf4b7a2038e9ab0` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:30:34.703296 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd74a8a-b049-4449-96ff-2ce19a0e0d5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2111ad84b844455d9bf4b7a2038e9ab0)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:30:34.705211 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd74a8a-b049-4449-96ff-2ce19a0e0d5e admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:30:34.754389 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-6dd74a8a-b049-4449-96ff-2ce19a0e0d5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2111ad84b844455d9bf4b7a2038e9ab0'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:30:34.763290 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-6dd74a8a-b049-4449-96ff-2ce19a0e0d5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2111ad84b844455d9bf4b7a2038e9ab0'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:30:34.764007 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-6dd74a8a-b049-4449-96ff-2ce19a0e0d5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2111ad84b844455d9bf4b7a2038e9ab0'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:30:34.764641 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-6dd74a8a-b049-4449-96ff-2ce19a0e0d5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2111ad84b844455d9bf4b7a2038e9ab0'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:30:34.772592 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-6dd74a8a-b049-4449-96ff-2ce19a0e0d5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2111ad84b844455d9bf4b7a2038e9ab0'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:30:34.791160 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1281/2566] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 20 22:30:34 2022] DELETE /identity/v3/users/2111ad84b844455d9bf4b7a2038e9ab0 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:30:34.795811 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4f40eb-5392-49f1-89f5-4371c9e864e4 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:30:34.796285 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4f40eb-5392-49f1-89f5-4371c9e864e4 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:30:34.796381 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4f40eb-5392-49f1-89f5-4371c9e864e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:30:34.816948 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-0e4f40eb-5392-49f1-89f5-4371c9e864e4 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:30:34.818151 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-0e4f40eb-5392-49f1-89f5-4371c9e864e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:30:34.883898 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1286/2567] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:30:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 22:30:34.893753 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd74a8a-b049-4449-96ff-2ce19a0e0d5e admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:30:34.895205 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-6dd74a8a-b049-4449-96ff-2ce19a0e0d5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:30:34.954851 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd74a8a-b049-4449-96ff-2ce19a0e0d5e admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:30:34.958632 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebef5c9-d159-4046-a467-5c6b962ae327 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b0b3ca4ecd41aaba9cf8e0f91fbf54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:30:34.959238 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebef5c9-d159-4046-a467-5c6b962ae327 service neutron] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:30:34.959521 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebef5c9-d159-4046-a467-5c6b962ae327 service neutron] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:30:34.959786 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebef5c9-d159-4046-a467-5c6b962ae327 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:30:34.969452 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebef5c9-d159-4046-a467-5c6b962ae327 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:30:34.970941 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebef5c9-d159-4046-a467-5c6b962ae327 service neutron] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:30:34.981015 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1282/2568] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:30:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:30:35.277971 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4f40eb-5392-49f1-89f5-4371c9e864e4 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:30:35.279932 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-0e4f40eb-5392-49f1-89f5-4371c9e864e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:30:35.306838 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4f40eb-5392-49f1-89f5-4371c9e864e4 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:30:35.316882 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6bf496-6d68-46b3-b225-048412036966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:30:35.317535 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6bf496-6d68-46b3-b225-048412036966 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:30:35.317969 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6bf496-6d68-46b3-b225-048412036966 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:30:35.318247 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6bf496-6d68-46b3-b225-048412036966 admin admin] PATH_INFO: `/v3/projects/3b3acc723d7c445fa5f4652785baee16` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:30:35.319524 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6bf496-6d68-46b3-b225-048412036966 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b3acc723d7c445fa5f4652785baee16)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:30:35.321332 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6bf496-6d68-46b3-b225-048412036966 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:30:35.375202 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-ba6bf496-6d68-46b3-b225-048412036966 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b3acc723d7c445fa5f4652785baee16', 'request_id': 'req-ba6bf496-6d68-46b3-b225-048412036966'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:30:35.381642 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-ba6bf496-6d68-46b3-b225-048412036966 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b3acc723d7c445fa5f4652785baee16', 'request_id': 'req-ba6bf496-6d68-46b3-b225-048412036966'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:30:35.390625 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-ba6bf496-6d68-46b3-b225-048412036966 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b3acc723d7c445fa5f4652785baee16', 'request_id': 'req-ba6bf496-6d68-46b3-b225-048412036966'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:30:35.403161 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-ba6bf496-6d68-46b3-b225-048412036966 admin admin] The token cache is being invalidate because project 3b3acc723d7c445fa5f4652785baee16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81306) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 22:30:35.403462 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-ba6bf496-6d68-46b3-b225-048412036966 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:30:35.404107 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-ba6bf496-6d68-46b3-b225-048412036966 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:30:35.405687 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1287/2569] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 20 22:30:35 2022] DELETE /identity/v3/projects/3b3acc723d7c445fa5f4652785baee16 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:30:35.410437 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab99a76-1eb3-46ed-addf-93ceacac79fa None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:30:35.413197 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab99a76-1eb3-46ed-addf-93ceacac79fa None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:30:35.413481 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab99a76-1eb3-46ed-addf-93ceacac79fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:30:35.433830 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-5ab99a76-1eb3-46ed-addf-93ceacac79fa None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:30:35.435203 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-5ab99a76-1eb3-46ed-addf-93ceacac79fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:30:35.465499 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:30:35.503213 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1283/2570] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:30:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:30:35.511576 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cf9401-97ae-4597-8b26-a66a33695cd4 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:30:35.511860 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cf9401-97ae-4597-8b26-a66a33695cd4 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:30:35.512136 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cf9401-97ae-4597-8b26-a66a33695cd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:30:35.533264 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-08cf9401-97ae-4597-8b26-a66a33695cd4 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:30:35.534480 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-08cf9401-97ae-4597-8b26-a66a33695cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:30:35.545930 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1288/2571] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:30:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:30:35.550907 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab99a76-1eb3-46ed-addf-93ceacac79fa None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:30:35.561396 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab99a76-1eb3-46ed-addf-93ceacac79fa None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:30:35.566901 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dd7c6a-d6c0-4d97-8bff-c83e4967122c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:30:35.567549 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dd7c6a-d6c0-4d97-8bff-c83e4967122c admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:30:35.567859 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dd7c6a-d6c0-4d97-8bff-c83e4967122c admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:30:35.568130 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dd7c6a-d6c0-4d97-8bff-c83e4967122c admin admin] PATH_INFO: `/v3/domains` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:30:35.568782 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dd7c6a-d6c0-4d97-8bff-c83e4967122c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:30:35.569080 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dd7c6a-d6c0-4d97-8bff-c83e4967122c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:30:35.571251 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dd7c6a-d6c0-4d97-8bff-c83e4967122c admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:30:35.583613 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1284/2572] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 20 22:30:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:30:35.588673 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cf9401-97ae-4597-8b26-a66a33695cd4 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:30:35.598107 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cf9401-97ae-4597-8b26-a66a33695cd4 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:30:35.603471 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835b1e59-a055-48c1-8c6a-4bf430ec47aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:30:35.604081 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835b1e59-a055-48c1-8c6a-4bf430ec47aa admin admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:30:35.604360 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835b1e59-a055-48c1-8c6a-4bf430ec47aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:30:35.604632 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835b1e59-a055-48c1-8c6a-4bf430ec47aa admin admin] PATH_INFO: `/v3/projects` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:30:35.605283 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835b1e59-a055-48c1-8c6a-4bf430ec47aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:30:35.607220 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835b1e59-a055-48c1-8c6a-4bf430ec47aa admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:30:35.635651 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1289/2573] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 20 22:30:35 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:30:35.640065 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dd7c6a-d6c0-4d97-8bff-c83e4967122c admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:30:35.651156 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dd7c6a-d6c0-4d97-8bff-c83e4967122c admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:30:35.709770 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365bed29-f5d8-41f9-b0b0-35769d485bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:30:35.710415 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365bed29-f5d8-41f9-b0b0-35769d485bf3 admin admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:30:35.710803 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365bed29-f5d8-41f9-b0b0-35769d485bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:30:35.711075 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365bed29-f5d8-41f9-b0b0-35769d485bf3 admin admin] PATH_INFO: `/v3/users` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:30:35.712274 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365bed29-f5d8-41f9-b0b0-35769d485bf3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:30:35.714264 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365bed29-f5d8-41f9-b0b0-35769d485bf3 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:30:35.738944 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1285/2574] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 20 22:30:35 2022] POST /identity/v3/users => generated 287 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 20 22:30:35.740486 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835b1e59-a055-48c1-8c6a-4bf430ec47aa admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:30:35.751255 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835b1e59-a055-48c1-8c6a-4bf430ec47aa admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:30:35.755874 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523be2f7-21ab-410f-bec0-af32ad6699ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:30:35.756465 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523be2f7-21ab-410f-bec0-af32ad6699ac admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:30:35.756739 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523be2f7-21ab-410f-bec0-af32ad6699ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:30:35.757005 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523be2f7-21ab-410f-bec0-af32ad6699ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:30:35.757641 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523be2f7-21ab-410f-bec0-af32ad6699ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:30:35.759771 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523be2f7-21ab-410f-bec0-af32ad6699ac admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:30:35.770227 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1290/2575] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:30:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:30:35.775242 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365bed29-f5d8-41f9-b0b0-35769d485bf3 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:30:35.785645 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365bed29-f5d8-41f9-b0b0-35769d485bf3 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:30:35.790589 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046d7614-f51f-450b-b13d-c7cc8c5f9a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:30:35.791188 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046d7614-f51f-450b-b13d-c7cc8c5f9a85 admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:30:35.791466 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046d7614-f51f-450b-b13d-c7cc8c5f9a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:30:35.791736 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046d7614-f51f-450b-b13d-c7cc8c5f9a85 admin admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:30:35.792400 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046d7614-f51f-450b-b13d-c7cc8c5f9a85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:30:35.793990 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046d7614-f51f-450b-b13d-c7cc8c5f9a85 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:30:35.806838 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1286/2576] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:30:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:30:35.811237 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523be2f7-21ab-410f-bec0-af32ad6699ac admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:30:35.827597 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523be2f7-21ab-410f-bec0-af32ad6699ac admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:30:35.832461 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c18802-d2f5-4c1f-b325-adfded9a4d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:30:35.833121 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c18802-d2f5-4c1f-b325-adfded9a4d2f admin admin] REQUEST_METHOD: `PUT` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:30:35.833397 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c18802-d2f5-4c1f-b325-adfded9a4d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:30:35.833664 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c18802-d2f5-4c1f-b325-adfded9a4d2f admin admin] PATH_INFO: `/v3/projects/d2bd85404a664c0dac9b3929d47ff977/users/2433d0d9dbc84126805472bf05fdee1a/roles/604444e7ad0d437dbd1f5a6e02b761f5` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:30:35.848814 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c18802-d2f5-4c1f-b325-adfded9a4d2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2bd85404a664c0dac9b3929d47ff977, user_id=2433d0d9dbc84126805472bf05fdee1a, role_id=604444e7ad0d437dbd1f5a6e02b761f5)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:30:35.851498 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c18802-d2f5-4c1f-b325-adfded9a4d2f admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:30:35.865486 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1291/2577] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:30:35 2022] PUT /identity/v3/projects/d2bd85404a664c0dac9b3929d47ff977/users/2433d0d9dbc84126805472bf05fdee1a/roles/604444e7ad0d437dbd1f5a6e02b761f5 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:30:35.876307 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9dd4f1-12d5-4036-9190-03988524f243 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:30:35.876589 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9dd4f1-12d5-4036-9190-03988524f243 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:30:35.876859 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9dd4f1-12d5-4036-9190-03988524f243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:30:35.906153 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-dd9dd4f1-12d5-4036-9190-03988524f243 None None] MFA Rules not processed for user `2433d0d9dbc84126805472bf05fdee1a`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:30:35.907341 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-dd9dd4f1-12d5-4036-9190-03988524f243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:30:35.974865 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1287/2578] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:30:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:30:35.987640 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c18802-d2f5-4c1f-b325-adfded9a4d2f admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:30:35.989340 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-29c18802-d2f5-4c1f-b325-adfded9a4d2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:30:36.010734 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:30:36.060644 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c18802-d2f5-4c1f-b325-adfded9a4d2f admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:30:36.065038 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdeb549-f44a-4fb5-ab74-f5f7c2c65ce8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577c8b14c1f4279beac13b9ba11aba1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:30:36.065661 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdeb549-f44a-4fb5-ab74-f5f7c2c65ce8 service cinder] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:30:36.065954 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdeb549-f44a-4fb5-ab74-f5f7c2c65ce8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:30:36.066192 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdeb549-f44a-4fb5-ab74-f5f7c2c65ce8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:30:36.075900 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdeb549-f44a-4fb5-ab74-f5f7c2c65ce8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:30:36.077317 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdeb549-f44a-4fb5-ab74-f5f7c2c65ce8 service cinder] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:30:36.086883 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1292/2579] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:30:35 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:30:39.211663 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9dd4f1-12d5-4036-9190-03988524f243 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:30:39.241239 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:30:39.277763 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9dd4f1-12d5-4036-9190-03988524f243 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:30:39.282528 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9a43fc-4415-4d26-81a8-24dc693e91c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:30:39.283169 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9a43fc-4415-4d26-81a8-24dc693e91c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:30:39.283452 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9a43fc-4415-4d26-81a8-24dc693e91c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:30:39.283725 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9a43fc-4415-4d26-81a8-24dc693e91c5 admin admin] PATH_INFO: `/v3/users/2433d0d9dbc84126805472bf05fdee1a` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:30:39.284836 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9a43fc-4415-4d26-81a8-24dc693e91c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2433d0d9dbc84126805472bf05fdee1a)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:30:39.287058 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9a43fc-4415-4d26-81a8-24dc693e91c5 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:30:39.333566 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-fc9a43fc-4415-4d26-81a8-24dc693e91c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2433d0d9dbc84126805472bf05fdee1a'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:30:39.341541 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-fc9a43fc-4415-4d26-81a8-24dc693e91c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2433d0d9dbc84126805472bf05fdee1a'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:30:39.342156 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-fc9a43fc-4415-4d26-81a8-24dc693e91c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2433d0d9dbc84126805472bf05fdee1a'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:30:39.342796 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-fc9a43fc-4415-4d26-81a8-24dc693e91c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2433d0d9dbc84126805472bf05fdee1a'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:30:39.355506 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-fc9a43fc-4415-4d26-81a8-24dc693e91c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2433d0d9dbc84126805472bf05fdee1a'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:30:39.375752 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1288/2580] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 20 22:30:39 2022] DELETE /identity/v3/users/2433d0d9dbc84126805472bf05fdee1a => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:30:39.380225 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d7f4cc-6c49-49fc-a371-ba6951d57f3a None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:30:39.380656 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d7f4cc-6c49-49fc-a371-ba6951d57f3a None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:30:39.380884 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d7f4cc-6c49-49fc-a371-ba6951d57f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:30:39.400822 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-57d7f4cc-6c49-49fc-a371-ba6951d57f3a None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:30:39.402022 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-57d7f4cc-6c49-49fc-a371-ba6951d57f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:30:39.460942 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1293/2581] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:30:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:30:39.474057 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9a43fc-4415-4d26-81a8-24dc693e91c5 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:30:39.475553 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-fc9a43fc-4415-4d26-81a8-24dc693e91c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:30:39.536066 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9a43fc-4415-4d26-81a8-24dc693e91c5 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:30:39.540516 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98cbb57-ba90-4fb1-ade4-7324a72ea382 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b0b3ca4ecd41aaba9cf8e0f91fbf54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:30:39.541415 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98cbb57-ba90-4fb1-ade4-7324a72ea382 service neutron] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:30:39.541699 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98cbb57-ba90-4fb1-ade4-7324a72ea382 service neutron] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:30:39.542121 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98cbb57-ba90-4fb1-ade4-7324a72ea382 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:30:39.552930 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98cbb57-ba90-4fb1-ade4-7324a72ea382 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:30:39.554359 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98cbb57-ba90-4fb1-ade4-7324a72ea382 service neutron] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:30:39.565444 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1289/2582] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:30:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:30:39.886172 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d7f4cc-6c49-49fc-a371-ba6951d57f3a None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:30:39.888599 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-57d7f4cc-6c49-49fc-a371-ba6951d57f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:30:39.913649 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d7f4cc-6c49-49fc-a371-ba6951d57f3a None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:30:39.920330 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de761d9-60a7-445a-8bc7-1c05cd3a1d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:30:39.920974 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de761d9-60a7-445a-8bc7-1c05cd3a1d67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:30:39.921253 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de761d9-60a7-445a-8bc7-1c05cd3a1d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:30:39.921530 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de761d9-60a7-445a-8bc7-1c05cd3a1d67 admin admin] PATH_INFO: `/v3/projects/d2bd85404a664c0dac9b3929d47ff977` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:30:39.923289 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de761d9-60a7-445a-8bc7-1c05cd3a1d67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2bd85404a664c0dac9b3929d47ff977)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:30:39.926030 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de761d9-60a7-445a-8bc7-1c05cd3a1d67 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:30:39.987162 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-1de761d9-60a7-445a-8bc7-1c05cd3a1d67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2bd85404a664c0dac9b3929d47ff977', 'request_id': 'req-1de761d9-60a7-445a-8bc7-1c05cd3a1d67'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:30:39.993357 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-1de761d9-60a7-445a-8bc7-1c05cd3a1d67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2bd85404a664c0dac9b3929d47ff977', 'request_id': 'req-1de761d9-60a7-445a-8bc7-1c05cd3a1d67'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:30:40.000609 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-1de761d9-60a7-445a-8bc7-1c05cd3a1d67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2bd85404a664c0dac9b3929d47ff977', 'request_id': 'req-1de761d9-60a7-445a-8bc7-1c05cd3a1d67'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:30:40.011255 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-1de761d9-60a7-445a-8bc7-1c05cd3a1d67 admin admin] The token cache is being invalidate because project d2bd85404a664c0dac9b3929d47ff977 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81306) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 22:30:40.011535 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-1de761d9-60a7-445a-8bc7-1c05cd3a1d67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:30:40.012149 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-1de761d9-60a7-445a-8bc7-1c05cd3a1d67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:30:40.013618 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1294/2583] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 20 22:30:39 2022] DELETE /identity/v3/projects/d2bd85404a664c0dac9b3929d47ff977 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:30:40.018498 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3934cf-471d-427d-a56f-a2750aab192a None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:30:40.018868 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3934cf-471d-427d-a56f-a2750aab192a None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:30:40.019194 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3934cf-471d-427d-a56f-a2750aab192a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:30:40.039119 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-bc3934cf-471d-427d-a56f-a2750aab192a None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:30:40.040343 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-bc3934cf-471d-427d-a56f-a2750aab192a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:30:40.083328 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:30:40.102357 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1290/2584] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:30:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:30:40.111262 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7eb37c-11c7-4800-9edf-dde25f81d3d9 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:30:40.111543 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7eb37c-11c7-4800-9edf-dde25f81d3d9 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:30:40.111814 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7eb37c-11c7-4800-9edf-dde25f81d3d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:30:40.131026 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-8c7eb37c-11c7-4800-9edf-dde25f81d3d9 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:30:40.132207 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-8c7eb37c-11c7-4800-9edf-dde25f81d3d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:30:40.140326 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1295/2585] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:30:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:30:40.144372 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3934cf-471d-427d-a56f-a2750aab192a None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:30:40.154658 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3934cf-471d-427d-a56f-a2750aab192a None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:30:40.159201 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54833be4-7ded-4520-9cde-292da08c5a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:30:40.159795 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54833be4-7ded-4520-9cde-292da08c5a17 admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:30:40.160075 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54833be4-7ded-4520-9cde-292da08c5a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:30:40.160352 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54833be4-7ded-4520-9cde-292da08c5a17 admin admin] PATH_INFO: `/v3/domains` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:30:40.160992 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54833be4-7ded-4520-9cde-292da08c5a17 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:30:40.161293 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54833be4-7ded-4520-9cde-292da08c5a17 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:30:40.163196 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54833be4-7ded-4520-9cde-292da08c5a17 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:30:40.174448 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1291/2586] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 20 22:30:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:30:40.178613 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7eb37c-11c7-4800-9edf-dde25f81d3d9 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:30:40.187555 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7eb37c-11c7-4800-9edf-dde25f81d3d9 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:30:40.192200 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c1acc7-b70d-4cd2-913a-49ff9a12a39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:30:40.192787 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c1acc7-b70d-4cd2-913a-49ff9a12a39a admin admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:30:40.193064 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c1acc7-b70d-4cd2-913a-49ff9a12a39a admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:30:40.193333 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c1acc7-b70d-4cd2-913a-49ff9a12a39a admin admin] PATH_INFO: `/v3/projects` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:30:40.193965 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c1acc7-b70d-4cd2-913a-49ff9a12a39a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:30:40.196393 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c1acc7-b70d-4cd2-913a-49ff9a12a39a admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:30:40.223288 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1296/2587] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 20 22:30:40 2022] POST /identity/v3/projects => generated 369 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 20 22:30:40.227385 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54833be4-7ded-4520-9cde-292da08c5a17 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:30:40.237121 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54833be4-7ded-4520-9cde-292da08c5a17 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:30:40.292730 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5009f11d-2fef-4120-af41-cc87bd771536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:30:40.293350 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5009f11d-2fef-4120-af41-cc87bd771536 admin admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:30:40.293635 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5009f11d-2fef-4120-af41-cc87bd771536 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:30:40.293910 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5009f11d-2fef-4120-af41-cc87bd771536 admin admin] PATH_INFO: `/v3/users` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:30:40.294572 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5009f11d-2fef-4120-af41-cc87bd771536 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:30:40.296504 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5009f11d-2fef-4120-af41-cc87bd771536 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:30:40.318038 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1292/2588] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 20 22:30:40 2022] POST /identity/v3/users => generated 285 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:30:40.322717 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c1acc7-b70d-4cd2-913a-49ff9a12a39a admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:30:40.332779 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c1acc7-b70d-4cd2-913a-49ff9a12a39a admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:30:40.337270 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347e7aa1-105d-4e26-bf89-b30a003808f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:30:40.337856 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e7aa1-105d-4e26-bf89-b30a003808f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:30:40.338129 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e7aa1-105d-4e26-bf89-b30a003808f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:30:40.338395 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e7aa1-105d-4e26-bf89-b30a003808f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:30:40.339062 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347e7aa1-105d-4e26-bf89-b30a003808f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:30:40.340662 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347e7aa1-105d-4e26-bf89-b30a003808f8 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:30:40.350727 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1297/2589] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:30:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:30:40.354567 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5009f11d-2fef-4120-af41-cc87bd771536 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:30:40.365276 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5009f11d-2fef-4120-af41-cc87bd771536 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:30:40.370493 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1208eabb-b131-43ff-ab18-9b7756775cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:30:40.371116 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1208eabb-b131-43ff-ab18-9b7756775cd6 admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:30:40.371399 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1208eabb-b131-43ff-ab18-9b7756775cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:30:40.371703 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1208eabb-b131-43ff-ab18-9b7756775cd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:30:40.372344 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1208eabb-b131-43ff-ab18-9b7756775cd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:30:40.374151 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1208eabb-b131-43ff-ab18-9b7756775cd6 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:30:40.386594 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1293/2590] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:30:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:30:40.390859 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347e7aa1-105d-4e26-bf89-b30a003808f8 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:30:40.396121 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:30:40.402865 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347e7aa1-105d-4e26-bf89-b30a003808f8 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:30:40.408339 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90729bef-d913-4e37-ad08-d2c36d6275ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:30:40.408984 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90729bef-d913-4e37-ad08-d2c36d6275ca admin admin] REQUEST_METHOD: `PUT` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:30:40.409259 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90729bef-d913-4e37-ad08-d2c36d6275ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:30:40.409525 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90729bef-d913-4e37-ad08-d2c36d6275ca admin admin] PATH_INFO: `/v3/projects/25f6b675d33249898ca5d887759e8ed3/users/1ddf46200bad4a98891db3e60d2633f8/roles/604444e7ad0d437dbd1f5a6e02b761f5` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:30:40.424117 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90729bef-d913-4e37-ad08-d2c36d6275ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=25f6b675d33249898ca5d887759e8ed3, user_id=1ddf46200bad4a98891db3e60d2633f8, role_id=604444e7ad0d437dbd1f5a6e02b761f5)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:30:40.426804 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90729bef-d913-4e37-ad08-d2c36d6275ca admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:30:40.440106 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1298/2591] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:30:40 2022] PUT /identity/v3/projects/25f6b675d33249898ca5d887759e8ed3/users/1ddf46200bad4a98891db3e60d2633f8/roles/604444e7ad0d437dbd1f5a6e02b761f5 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 22:30:40.450736 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0886e4d4-ea7f-4e1a-82d0-1dac2b0f77eb None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:30:40.451022 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0886e4d4-ea7f-4e1a-82d0-1dac2b0f77eb None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:30:40.451343 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0886e4d4-ea7f-4e1a-82d0-1dac2b0f77eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:30:40.479572 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-0886e4d4-ea7f-4e1a-82d0-1dac2b0f77eb None None] MFA Rules not processed for user `1ddf46200bad4a98891db3e60d2633f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:30:40.480792 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-0886e4d4-ea7f-4e1a-82d0-1dac2b0f77eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:30:40.543641 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1294/2592] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:30:40 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:30:40.555940 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90729bef-d913-4e37-ad08-d2c36d6275ca admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:30:40.557671 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-90729bef-d913-4e37-ad08-d2c36d6275ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:30:40.614578 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90729bef-d913-4e37-ad08-d2c36d6275ca admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:30:40.618699 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7151dd-b60f-411c-8508-53b8e2d56a42 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbecfbbf24fd425ca99499fd44d8c7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:30:40.619298 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7151dd-b60f-411c-8508-53b8e2d56a42 service glance] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:30:40.619577 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7151dd-b60f-411c-8508-53b8e2d56a42 service glance] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:30:40.619848 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7151dd-b60f-411c-8508-53b8e2d56a42 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:30:40.627993 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7151dd-b60f-411c-8508-53b8e2d56a42 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:30:40.629414 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7151dd-b60f-411c-8508-53b8e2d56a42 service glance] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:30:40.638671 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1299/2593] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:30:40 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:30:50.540798 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=78,keystone:INSERT=3 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:30:50.635507 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=35,keystone:INSERT=1 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:30:51.806011 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27083634-825b-4d4e-acf5-e5765fe6cc54 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:30:51.806472 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27083634-825b-4d4e-acf5-e5765fe6cc54 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:30:51.806769 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27083634-825b-4d4e-acf5-e5765fe6cc54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:30:51.826885 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-27083634-825b-4d4e-acf5-e5765fe6cc54 None None] MFA Rules not processed for user `c0a26034863a4590b4e2ec3a853a12b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:30:51.828098 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-27083634-825b-4d4e-acf5-e5765fe6cc54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:30:51.890600 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1295/2594] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:30:51 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:31:01.881494 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=25 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:31:08.615254 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7151dd-b60f-411c-8508-53b8e2d56a42 service glance] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:31:08.676994 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7151dd-b60f-411c-8508-53b8e2d56a42 service glance] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:31:08.681446 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c304e5-94ec-4eeb-b468-4aa851a5a00d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:31:08.682069 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c304e5-94ec-4eeb-b468-4aa851a5a00d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:31:08.682988 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c304e5-94ec-4eeb-b468-4aa851a5a00d admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:31:08.683261 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c304e5-94ec-4eeb-b468-4aa851a5a00d admin admin] PATH_INFO: `/v3/users/1ddf46200bad4a98891db3e60d2633f8` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:31:08.684357 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c304e5-94ec-4eeb-b468-4aa851a5a00d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ddf46200bad4a98891db3e60d2633f8)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:31:08.686246 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c304e5-94ec-4eeb-b468-4aa851a5a00d admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:31:08.730330 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-b7c304e5-94ec-4eeb-b468-4aa851a5a00d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ddf46200bad4a98891db3e60d2633f8'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:31:08.736652 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-b7c304e5-94ec-4eeb-b468-4aa851a5a00d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ddf46200bad4a98891db3e60d2633f8'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:31:08.737256 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-b7c304e5-94ec-4eeb-b468-4aa851a5a00d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ddf46200bad4a98891db3e60d2633f8'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:31:08.737865 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-b7c304e5-94ec-4eeb-b468-4aa851a5a00d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ddf46200bad4a98891db3e60d2633f8'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:31:08.744679 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-b7c304e5-94ec-4eeb-b468-4aa851a5a00d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ddf46200bad4a98891db3e60d2633f8'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:31:08.761149 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1300/2595] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 20 22:31:08 2022] DELETE /identity/v3/users/1ddf46200bad4a98891db3e60d2633f8 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:31:08.765782 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9662234-33d9-4d37-811c-60704ab756fd None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:31:08.766257 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9662234-33d9-4d37-811c-60704ab756fd None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:31:08.766379 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9662234-33d9-4d37-811c-60704ab756fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:31:08.785047 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-f9662234-33d9-4d37-811c-60704ab756fd None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:31:08.786484 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-f9662234-33d9-4d37-811c-60704ab756fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:31:08.844276 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1296/2596] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:31:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:31:08.855231 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c304e5-94ec-4eeb-b468-4aa851a5a00d admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:31:08.856638 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-b7c304e5-94ec-4eeb-b468-4aa851a5a00d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:31:08.914635 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c304e5-94ec-4eeb-b468-4aa851a5a00d admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:31:08.919063 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0e13d4-809f-4ae6-83a9-687493b88147 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b0b3ca4ecd41aaba9cf8e0f91fbf54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:31:08.919685 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e13d4-809f-4ae6-83a9-687493b88147 service neutron] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:31:08.919961 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e13d4-809f-4ae6-83a9-687493b88147 service neutron] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:31:08.920230 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e13d4-809f-4ae6-83a9-687493b88147 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:31:08.929223 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0e13d4-809f-4ae6-83a9-687493b88147 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:31:08.930694 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0e13d4-809f-4ae6-83a9-687493b88147 service neutron] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:31:08.940104 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1301/2597] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:31:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 20 22:31:09.210554 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9662234-33d9-4d37-811c-60704ab756fd None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:31:09.211989 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-f9662234-33d9-4d37-811c-60704ab756fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:31:09.224158 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9662234-33d9-4d37-811c-60704ab756fd None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:31:09.228754 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fa251e-eb4e-4ff1-9e64-dbaca3516f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:31:09.229375 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fa251e-eb4e-4ff1-9e64-dbaca3516f77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:31:09.229652 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fa251e-eb4e-4ff1-9e64-dbaca3516f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:31:09.229990 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fa251e-eb4e-4ff1-9e64-dbaca3516f77 admin admin] PATH_INFO: `/v3/projects/25f6b675d33249898ca5d887759e8ed3` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:31:09.231116 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fa251e-eb4e-4ff1-9e64-dbaca3516f77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25f6b675d33249898ca5d887759e8ed3)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:31:09.232997 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fa251e-eb4e-4ff1-9e64-dbaca3516f77 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:31:09.280120 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-03fa251e-eb4e-4ff1-9e64-dbaca3516f77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25f6b675d33249898ca5d887759e8ed3', 'request_id': 'req-03fa251e-eb4e-4ff1-9e64-dbaca3516f77'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:31:09.286351 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-03fa251e-eb4e-4ff1-9e64-dbaca3516f77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25f6b675d33249898ca5d887759e8ed3', 'request_id': 'req-03fa251e-eb4e-4ff1-9e64-dbaca3516f77'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:31:09.295709 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-03fa251e-eb4e-4ff1-9e64-dbaca3516f77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25f6b675d33249898ca5d887759e8ed3', 'request_id': 'req-03fa251e-eb4e-4ff1-9e64-dbaca3516f77'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:31:09.306521 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-03fa251e-eb4e-4ff1-9e64-dbaca3516f77 admin admin] The token cache is being invalidate because project 25f6b675d33249898ca5d887759e8ed3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81307) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 22:31:09.306819 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-03fa251e-eb4e-4ff1-9e64-dbaca3516f77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:31:09.308079 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-03fa251e-eb4e-4ff1-9e64-dbaca3516f77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:31:09.309557 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1297/2598] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 20 22:31:09 2022] DELETE /identity/v3/projects/25f6b675d33249898ca5d887759e8ed3 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 22:31:09.314469 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcf1488-3e1c-49f9-97cd-ecfda97c2800 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:31:09.314786 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcf1488-3e1c-49f9-97cd-ecfda97c2800 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:31:09.315062 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcf1488-3e1c-49f9-97cd-ecfda97c2800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:31:09.334016 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-cfcf1488-3e1c-49f9-97cd-ecfda97c2800 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:31:09.335258 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-cfcf1488-3e1c-49f9-97cd-ecfda97c2800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:31:09.352795 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:31:09.397949 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1302/2599] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:31:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 22:31:09.405807 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf657d5-7955-4a9d-a2d2-8777709c110f None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:31:09.406102 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf657d5-7955-4a9d-a2d2-8777709c110f None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:31:09.406380 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf657d5-7955-4a9d-a2d2-8777709c110f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:31:09.426777 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-4bf657d5-7955-4a9d-a2d2-8777709c110f None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:31:09.427996 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-4bf657d5-7955-4a9d-a2d2-8777709c110f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:31:09.436381 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1298/2600] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:31:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:31:09.440532 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcf1488-3e1c-49f9-97cd-ecfda97c2800 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:31:09.450071 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcf1488-3e1c-49f9-97cd-ecfda97c2800 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:31:09.454556 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8186ee-dd7f-4270-8139-0671655a66f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:31:09.455148 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8186ee-dd7f-4270-8139-0671655a66f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:31:09.455429 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8186ee-dd7f-4270-8139-0671655a66f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:31:09.455698 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8186ee-dd7f-4270-8139-0671655a66f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:31:09.456337 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8186ee-dd7f-4270-8139-0671655a66f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:31:09.456638 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8186ee-dd7f-4270-8139-0671655a66f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:31:09.458218 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8186ee-dd7f-4270-8139-0671655a66f3 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:31:09.470350 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1303/2601] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 20 22:31:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 22:31:09.474448 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf657d5-7955-4a9d-a2d2-8777709c110f None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:31:09.484153 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf657d5-7955-4a9d-a2d2-8777709c110f None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:31:09.488789 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f36de0f-0263-40a7-ae29-06c2ea7a88ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:31:09.489382 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f36de0f-0263-40a7-ae29-06c2ea7a88ca admin admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:31:09.489662 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f36de0f-0263-40a7-ae29-06c2ea7a88ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:31:09.489931 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f36de0f-0263-40a7-ae29-06c2ea7a88ca admin admin] PATH_INFO: `/v3/projects` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:31:09.490591 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f36de0f-0263-40a7-ae29-06c2ea7a88ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:31:09.492479 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f36de0f-0263-40a7-ae29-06c2ea7a88ca admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:31:09.526888 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1299/2602] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 20 22:31:09 2022] POST /identity/v3/projects => generated 389 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:31:09.531206 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8186ee-dd7f-4270-8139-0671655a66f3 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:31:09.542638 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8186ee-dd7f-4270-8139-0671655a66f3 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:31:09.597499 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c21d60f-db95-4167-8ec0-ec38dda23da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:31:09.598091 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c21d60f-db95-4167-8ec0-ec38dda23da7 admin admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:31:09.598370 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c21d60f-db95-4167-8ec0-ec38dda23da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:31:09.598673 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c21d60f-db95-4167-8ec0-ec38dda23da7 admin admin] PATH_INFO: `/v3/users` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:31:09.599290 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c21d60f-db95-4167-8ec0-ec38dda23da7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:31:09.601231 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c21d60f-db95-4167-8ec0-ec38dda23da7 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:31:09.621810 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1304/2603] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 20 22:31:09 2022] POST /identity/v3/users => generated 295 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:31:09.626089 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f36de0f-0263-40a7-ae29-06c2ea7a88ca admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:31:09.636259 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f36de0f-0263-40a7-ae29-06c2ea7a88ca admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:31:09.640687 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c1acaf-c091-40eb-9bb4-01f378128e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:31:09.641275 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c1acaf-c091-40eb-9bb4-01f378128e1f admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:31:09.641581 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c1acaf-c091-40eb-9bb4-01f378128e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:31:09.641856 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c1acaf-c091-40eb-9bb4-01f378128e1f admin admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:31:09.642484 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c1acaf-c091-40eb-9bb4-01f378128e1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:31:09.644190 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c1acaf-c091-40eb-9bb4-01f378128e1f admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:31:09.654343 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1300/2604] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:31:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:31:09.658034 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c21d60f-db95-4167-8ec0-ec38dda23da7 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:31:09.668724 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c21d60f-db95-4167-8ec0-ec38dda23da7 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:31:09.673295 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f143db9-4aba-4ba0-835c-cc9e4b26d6c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:31:09.673881 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f143db9-4aba-4ba0-835c-cc9e4b26d6c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:31:09.674158 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f143db9-4aba-4ba0-835c-cc9e4b26d6c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:31:09.674436 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f143db9-4aba-4ba0-835c-cc9e4b26d6c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:31:09.675103 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f143db9-4aba-4ba0-835c-cc9e4b26d6c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:31:09.676663 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f143db9-4aba-4ba0-835c-cc9e4b26d6c9 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:31:09.691016 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1305/2605] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:31:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:31:09.695021 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c1acaf-c091-40eb-9bb4-01f378128e1f admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:31:09.705053 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c1acaf-c091-40eb-9bb4-01f378128e1f admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:31:09.710170 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdcca1a-b402-4ed8-9e46-ca0af637fe5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:31:09.710858 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdcca1a-b402-4ed8-9e46-ca0af637fe5a admin admin] REQUEST_METHOD: `PUT` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:31:09.711145 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdcca1a-b402-4ed8-9e46-ca0af637fe5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:31:09.711414 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdcca1a-b402-4ed8-9e46-ca0af637fe5a admin admin] PATH_INFO: `/v3/projects/7f28423f8ba84b6891eb8031660ea752/users/a4068b9c0ea745b091eb251639304465/roles/604444e7ad0d437dbd1f5a6e02b761f5` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:31:09.726647 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdcca1a-b402-4ed8-9e46-ca0af637fe5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f28423f8ba84b6891eb8031660ea752, user_id=a4068b9c0ea745b091eb251639304465, role_id=604444e7ad0d437dbd1f5a6e02b761f5)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:31:09.729292 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdcca1a-b402-4ed8-9e46-ca0af637fe5a admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:31:09.745138 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1301/2606] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:31:09 2022] PUT /identity/v3/projects/7f28423f8ba84b6891eb8031660ea752/users/a4068b9c0ea745b091eb251639304465/roles/604444e7ad0d437dbd1f5a6e02b761f5 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 22:31:09.813038 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061357c5-39cc-4647-b36d-233a0726cdb5 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:31:09.813358 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061357c5-39cc-4647-b36d-233a0726cdb5 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:31:09.813633 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061357c5-39cc-4647-b36d-233a0726cdb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:31:09.846809 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-061357c5-39cc-4647-b36d-233a0726cdb5 None None] MFA Rules not processed for user `a4068b9c0ea745b091eb251639304465`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:31:09.848024 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-061357c5-39cc-4647-b36d-233a0726cdb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:31:09.915531 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1306/2607] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:31:09 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:31:09.926263 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdcca1a-b402-4ed8-9e46-ca0af637fe5a admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:31:09.928030 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-4bdcca1a-b402-4ed8-9e46-ca0af637fe5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:31:09.949732 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:31:09.986058 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdcca1a-b402-4ed8-9e46-ca0af637fe5a admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:31:09.989711 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd7ba1f-da71-4aec-bdaa-85c5ec1a8c45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577c8b14c1f4279beac13b9ba11aba1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:31:09.990317 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd7ba1f-da71-4aec-bdaa-85c5ec1a8c45 service cinder] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:31:09.990629 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd7ba1f-da71-4aec-bdaa-85c5ec1a8c45 service cinder] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:31:09.990907 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd7ba1f-da71-4aec-bdaa-85c5ec1a8c45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:31:09.999062 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd7ba1f-da71-4aec-bdaa-85c5ec1a8c45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:31:10.000481 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd7ba1f-da71-4aec-bdaa-85c5ec1a8c45 service cinder] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:31:10.009166 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1302/2608] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:31:09 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:31:16.524761 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a35bfa-36ab-43ea-bee4-7cbc813c1097 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:31:16.525254 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a35bfa-36ab-43ea-bee4-7cbc813c1097 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:31:16.525352 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a35bfa-36ab-43ea-bee4-7cbc813c1097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:31:16.546080 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-56a35bfa-36ab-43ea-bee4-7cbc813c1097 None None] MFA Rules not processed for user `e916748fdee84c34af034e75a919b986`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:31:16.547316 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-56a35bfa-36ab-43ea-bee4-7cbc813c1097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:31:16.559439 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:31:16.605644 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1307/2609] 10.222.0.33 () {58 vars in 1009 bytes} [Tue Sep 20 22:31:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:31:16.651606 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd7ba1f-da71-4aec-bdaa-85c5ec1a8c45 service cinder] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:31:16.653677 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-5dd7ba1f-da71-4aec-bdaa-85c5ec1a8c45 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:31:16.724370 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd7ba1f-da71-4aec-bdaa-85c5ec1a8c45 service cinder] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:31:16.731155 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5fe102-d0a5-4d76-be13-5cb7ce777569 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '257983500d7b430c8f0377b2aa743ae0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:31:16.731155 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5fe102-d0a5-4d76-be13-5cb7ce777569 service swift] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:31:16.731155 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5fe102-d0a5-4d76-be13-5cb7ce777569 service swift] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:31:16.731155 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5fe102-d0a5-4d76-be13-5cb7ce777569 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:31:16.741348 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5fe102-d0a5-4d76-be13-5cb7ce777569 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:31:16.742966 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5fe102-d0a5-4d76-be13-5cb7ce777569 service swift] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:31:16.751729 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1303/2610] 10.222.0.33 () {60 vars in 1384 bytes} [Tue Sep 20 22:31:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 20 22:31:20.117205 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a35bfa-36ab-43ea-bee4-7cbc813c1097 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:31:20.188494 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a35bfa-36ab-43ea-bee4-7cbc813c1097 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:31:20.193155 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f691f9b0-da60-40a2-ba78-eebc1f9981f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:31:20.193795 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f691f9b0-da60-40a2-ba78-eebc1f9981f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:31:20.194077 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f691f9b0-da60-40a2-ba78-eebc1f9981f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:31:20.194351 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f691f9b0-da60-40a2-ba78-eebc1f9981f2 admin admin] PATH_INFO: `/v3/users/a4068b9c0ea745b091eb251639304465` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:31:20.195799 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f691f9b0-da60-40a2-ba78-eebc1f9981f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4068b9c0ea745b091eb251639304465)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:31:20.197761 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f691f9b0-da60-40a2-ba78-eebc1f9981f2 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:31:20.266186 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-f691f9b0-da60-40a2-ba78-eebc1f9981f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4068b9c0ea745b091eb251639304465'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:31:20.282551 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-f691f9b0-da60-40a2-ba78-eebc1f9981f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4068b9c0ea745b091eb251639304465'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:31:20.282551 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-f691f9b0-da60-40a2-ba78-eebc1f9981f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4068b9c0ea745b091eb251639304465'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:31:20.282551 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-f691f9b0-da60-40a2-ba78-eebc1f9981f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4068b9c0ea745b091eb251639304465'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:31:20.295585 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-f691f9b0-da60-40a2-ba78-eebc1f9981f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4068b9c0ea745b091eb251639304465'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:31:20.317728 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1308/2611] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 20 22:31:20 2022] DELETE /identity/v3/users/a4068b9c0ea745b091eb251639304465 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:31:20.323856 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ff610f-fdbc-48fc-9cf2-fbf75f704184 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:31:20.325023 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ff610f-fdbc-48fc-9cf2-fbf75f704184 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:31:20.325153 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ff610f-fdbc-48fc-9cf2-fbf75f704184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:31:20.348323 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-02ff610f-fdbc-48fc-9cf2-fbf75f704184 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:31:20.349613 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-02ff610f-fdbc-48fc-9cf2-fbf75f704184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:31:20.425992 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1304/2612] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:31:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:31:20.445369 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f691f9b0-da60-40a2-ba78-eebc1f9981f2 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:31:20.447088 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-f691f9b0-da60-40a2-ba78-eebc1f9981f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:31:20.502714 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:31:20.526566 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f691f9b0-da60-40a2-ba78-eebc1f9981f2 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:31:20.536061 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716af7e3-b248-4c97-b7c2-adad1b2bbd42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b0b3ca4ecd41aaba9cf8e0f91fbf54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:31:20.536705 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716af7e3-b248-4c97-b7c2-adad1b2bbd42 service neutron] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:31:20.537158 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716af7e3-b248-4c97-b7c2-adad1b2bbd42 service neutron] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:31:20.537558 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716af7e3-b248-4c97-b7c2-adad1b2bbd42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:31:20.556370 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716af7e3-b248-4c97-b7c2-adad1b2bbd42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:31:20.563309 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716af7e3-b248-4c97-b7c2-adad1b2bbd42 service neutron] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:31:20.575842 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1309/2613] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:31:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:31:20.906184 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ff610f-fdbc-48fc-9cf2-fbf75f704184 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:31:20.907720 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-02ff610f-fdbc-48fc-9cf2-fbf75f704184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:31:20.943662 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ff610f-fdbc-48fc-9cf2-fbf75f704184 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:31:20.955111 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817678a6-4a16-4e77-8b76-99595e029a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:31:20.955895 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817678a6-4a16-4e77-8b76-99595e029a8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:31:20.956270 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817678a6-4a16-4e77-8b76-99595e029a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:31:20.956645 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817678a6-4a16-4e77-8b76-99595e029a8f admin admin] PATH_INFO: `/v3/projects/7f28423f8ba84b6891eb8031660ea752` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:31:20.957991 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817678a6-4a16-4e77-8b76-99595e029a8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f28423f8ba84b6891eb8031660ea752)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:31:20.960802 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817678a6-4a16-4e77-8b76-99595e029a8f admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:31:21.024365 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:31:21.025980 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-817678a6-4a16-4e77-8b76-99595e029a8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f28423f8ba84b6891eb8031660ea752', 'request_id': 'req-817678a6-4a16-4e77-8b76-99595e029a8f'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:31:21.034153 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-817678a6-4a16-4e77-8b76-99595e029a8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f28423f8ba84b6891eb8031660ea752', 'request_id': 'req-817678a6-4a16-4e77-8b76-99595e029a8f'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:31:21.044428 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-817678a6-4a16-4e77-8b76-99595e029a8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f28423f8ba84b6891eb8031660ea752', 'request_id': 'req-817678a6-4a16-4e77-8b76-99595e029a8f'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:31:21.058393 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-817678a6-4a16-4e77-8b76-99595e029a8f admin admin] The token cache is being invalidate because project 7f28423f8ba84b6891eb8031660ea752 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81307) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 22:31:21.059521 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-817678a6-4a16-4e77-8b76-99595e029a8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:31:21.060243 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-817678a6-4a16-4e77-8b76-99595e029a8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:31:21.061810 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1305/2614] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 20 22:31:20 2022] DELETE /identity/v3/projects/7f28423f8ba84b6891eb8031660ea752 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:31:30.569033 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=7 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:31:31.054478 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=7,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:31:32.170573 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f3dc3f-971d-4e9e-a90c-e1c15f174896 None None] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:31:32.171089 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f3dc3f-971d-4e9e-a90c-e1c15f174896 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:31:32.171302 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f3dc3f-971d-4e9e-a90c-e1c15f174896 None None] PATH_INFO: `/` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:31:32.172743 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1310/2615] 10.222.0.33 () {54 vars in 921 bytes} [Tue Sep 20 22:31:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 22:31:32.177523 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16244af3-8610-48c7-929e-21b9532a7058 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:31:32.177943 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16244af3-8610-48c7-929e-21b9532a7058 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:31:32.178167 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16244af3-8610-48c7-929e-21b9532a7058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:31:32.198062 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-16244af3-8610-48c7-929e-21b9532a7058 None None] MFA Rules not processed for user `db7eed561e99452289a662ad326cf919`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:31:32.199854 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-16244af3-8610-48c7-929e-21b9532a7058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:31:32.267294 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1306/2616] 10.222.0.33 () {58 vars in 1018 bytes} [Tue Sep 20 22:31:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:31:32.279338 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f3dc3f-971d-4e9e-a90c-e1c15f174896 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:31:32.281117 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-d2f3dc3f-971d-4e9e-a90c-e1c15f174896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:31:32.346587 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f3dc3f-971d-4e9e-a90c-e1c15f174896 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:31:32.350040 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac39732c-e5ba-4e8c-8a46-49f7f5683c2a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbecfbbf24fd425ca99499fd44d8c7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:31:32.350666 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac39732c-e5ba-4e8c-8a46-49f7f5683c2a service glance] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:31:32.350946 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac39732c-e5ba-4e8c-8a46-49f7f5683c2a service glance] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:31:32.351212 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac39732c-e5ba-4e8c-8a46-49f7f5683c2a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:31:32.361482 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac39732c-e5ba-4e8c-8a46-49f7f5683c2a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:31:32.362916 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac39732c-e5ba-4e8c-8a46-49f7f5683c2a service glance] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:31:32.374019 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1311/2617] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:31:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 20 22:31:34.184297 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7163e3f-b92c-48fe-8e8f-e801d44ef2f9 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:31:34.184769 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7163e3f-b92c-48fe-8e8f-e801d44ef2f9 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:31:34.184881 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7163e3f-b92c-48fe-8e8f-e801d44ef2f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:31:34.206979 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-f7163e3f-b92c-48fe-8e8f-e801d44ef2f9 None None] MFA Rules not processed for user `e916748fdee84c34af034e75a919b986`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:31:34.208225 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-f7163e3f-b92c-48fe-8e8f-e801d44ef2f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:31:34.262693 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1307/2618] 10.222.0.33 () {58 vars in 1009 bytes} [Tue Sep 20 22:31:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:31:34.274751 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac39732c-e5ba-4e8c-8a46-49f7f5683c2a service glance] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:31:34.276162 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-ac39732c-e5ba-4e8c-8a46-49f7f5683c2a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:31:34.344996 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac39732c-e5ba-4e8c-8a46-49f7f5683c2a service glance] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:31:34.349965 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ebb205-92b5-4694-9108-aa8f91531187 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '257983500d7b430c8f0377b2aa743ae0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:31:34.350594 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ebb205-92b5-4694-9108-aa8f91531187 service swift] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:31:34.350882 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ebb205-92b5-4694-9108-aa8f91531187 service swift] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:31:34.351157 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ebb205-92b5-4694-9108-aa8f91531187 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:31:34.359046 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ebb205-92b5-4694-9108-aa8f91531187 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:31:34.360619 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ebb205-92b5-4694-9108-aa8f91531187 service swift] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:31:34.368600 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1312/2619] 10.222.0.33 () {60 vars in 1384 bytes} [Tue Sep 20 22:31:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 20 22:31:44.255509 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=56 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:31:44.365302 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=58 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:31:55.533673 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1038b7-eb5c-46b6-9b75-853d8a3e0da2 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:31:55.534396 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1038b7-eb5c-46b6-9b75-853d8a3e0da2 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:31:55.534500 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1038b7-eb5c-46b6-9b75-853d8a3e0da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:31:55.572849 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-ca1038b7-eb5c-46b6-9b75-853d8a3e0da2 None None] MFA Rules not processed for user `e916748fdee84c34af034e75a919b986`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:31:55.574090 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-ca1038b7-eb5c-46b6-9b75-853d8a3e0da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:31:55.610309 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1308/2620] 10.222.0.33 () {58 vars in 967 bytes} [Tue Sep 20 22:31:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:31:55.623021 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ebb205-92b5-4694-9108-aa8f91531187 service swift] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:31:55.664734 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ebb205-92b5-4694-9108-aa8f91531187 service swift] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:31:55.669732 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531c1a4d-ad96-4a71-8745-976841ace63a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '257983500d7b430c8f0377b2aa743ae0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:31:55.670322 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c1a4d-ad96-4a71-8745-976841ace63a service swift] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:31:55.670640 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c1a4d-ad96-4a71-8745-976841ace63a service swift] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:31:55.670921 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c1a4d-ad96-4a71-8745-976841ace63a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:31:55.678750 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531c1a4d-ad96-4a71-8745-976841ace63a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:31:55.680314 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531c1a4d-ad96-4a71-8745-976841ace63a service swift] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:31:55.688129 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1313/2621] 10.222.0.33 () {60 vars in 1384 bytes} [Tue Sep 20 22:31:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 20 22:32:01.537106 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1038b7-eb5c-46b6-9b75-853d8a3e0da2 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:32:01.538544 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-ca1038b7-eb5c-46b6-9b75-853d8a3e0da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:32:01.630798 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1038b7-eb5c-46b6-9b75-853d8a3e0da2 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:32:01.635977 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e67a0d2-8aef-455d-9c6e-ae880fecdef7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c79676ee86294dab92ba732e38d6fa74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:32:01.636586 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e67a0d2-8aef-455d-9c6e-ae880fecdef7 service placement] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:32:01.636867 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e67a0d2-8aef-455d-9c6e-ae880fecdef7 service placement] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:32:01.637137 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e67a0d2-8aef-455d-9c6e-ae880fecdef7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:32:01.638902 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-1e67a0d2-8aef-455d-9c6e-ae880fecdef7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:32:01.650073 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e67a0d2-8aef-455d-9c6e-ae880fecdef7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:32:01.651695 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e67a0d2-8aef-455d-9c6e-ae880fecdef7 service placement] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:32:01.661633 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1309/2622] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:32:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:32:05.684995 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=20 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:32:11.657242 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=64 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:32:18.052813 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531c1a4d-ad96-4a71-8745-976841ace63a service swift] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:32:18.054217 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-531c1a4d-ad96-4a71-8745-976841ace63a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:32:18.130593 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531c1a4d-ad96-4a71-8745-976841ace63a service swift] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:32:18.134126 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5dc8d5-2d7d-4db6-95e1-333f94b99947 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b0b3ca4ecd41aaba9cf8e0f91fbf54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:32:18.134762 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5dc8d5-2d7d-4db6-95e1-333f94b99947 service neutron] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:32:18.135046 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5dc8d5-2d7d-4db6-95e1-333f94b99947 service neutron] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:32:18.135319 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5dc8d5-2d7d-4db6-95e1-333f94b99947 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:32:18.137520 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-3e5dc8d5-2d7d-4db6-95e1-333f94b99947 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:32:18.194962 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5dc8d5-2d7d-4db6-95e1-333f94b99947 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:32:18.196381 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5dc8d5-2d7d-4db6-95e1-333f94b99947 service neutron] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:32:18.205595 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1314/2623] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:32:18 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:32:23.046738 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e67a0d2-8aef-455d-9c6e-ae880fecdef7 service placement] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:32:23.056129 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e67a0d2-8aef-455d-9c6e-ae880fecdef7 service placement] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:32:23.059638 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76674a8-a39a-4398-ad07-68e63a287247 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b0b3ca4ecd41aaba9cf8e0f91fbf54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:32:23.060227 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76674a8-a39a-4398-ad07-68e63a287247 service neutron] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:32:23.060503 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76674a8-a39a-4398-ad07-68e63a287247 service neutron] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:32:23.060776 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76674a8-a39a-4398-ad07-68e63a287247 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:32:23.062458 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-c76674a8-a39a-4398-ad07-68e63a287247 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:32:23.146180 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76674a8-a39a-4398-ad07-68e63a287247 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:32:23.147661 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76674a8-a39a-4398-ad07-68e63a287247 service neutron] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:32:23.166659 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1310/2624] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:32:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:32:28.201569 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=57 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:32:29.481148 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5dc8d5-2d7d-4db6-95e1-333f94b99947 service neutron] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:32:29.482892 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-3e5dc8d5-2d7d-4db6-95e1-333f94b99947 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:32:29.504336 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5dc8d5-2d7d-4db6-95e1-333f94b99947 service neutron] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:32:29.509135 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749f6dc4-d1df-43d3-9e62-faa25ab0b9f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:32:29.509790 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f6dc4-d1df-43d3-9e62-faa25ab0b9f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:32:29.510073 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f6dc4-d1df-43d3-9e62-faa25ab0b9f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:32:29.510348 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f6dc4-d1df-43d3-9e62-faa25ab0b9f0 admin admin] PATH_INFO: `/v3/users/7e15004ee2804ad8ba06cbcff3c7cc40` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:32:29.512045 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749f6dc4-d1df-43d3-9e62-faa25ab0b9f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e15004ee2804ad8ba06cbcff3c7cc40)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:32:29.514017 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749f6dc4-d1df-43d3-9e62-faa25ab0b9f0 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:32:29.561932 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-749f6dc4-d1df-43d3-9e62-faa25ab0b9f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e15004ee2804ad8ba06cbcff3c7cc40'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:32:29.568601 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-749f6dc4-d1df-43d3-9e62-faa25ab0b9f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e15004ee2804ad8ba06cbcff3c7cc40'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:32:29.569365 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-749f6dc4-d1df-43d3-9e62-faa25ab0b9f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e15004ee2804ad8ba06cbcff3c7cc40'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:32:29.569988 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-749f6dc4-d1df-43d3-9e62-faa25ab0b9f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e15004ee2804ad8ba06cbcff3c7cc40'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:32:29.577084 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-749f6dc4-d1df-43d3-9e62-faa25ab0b9f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e15004ee2804ad8ba06cbcff3c7cc40'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:32:29.594607 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1315/2625] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 20 22:32:29 2022] DELETE /identity/v3/users/7e15004ee2804ad8ba06cbcff3c7cc40 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:32:29.767645 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76674a8-a39a-4398-ad07-68e63a287247 service neutron] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:32:29.778959 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76674a8-a39a-4398-ad07-68e63a287247 service neutron] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:32:29.836919 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2370e537-8863-4579-8a32-7fea548002c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:32:29.837551 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2370e537-8863-4579-8a32-7fea548002c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:32:29.837832 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2370e537-8863-4579-8a32-7fea548002c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:32:29.838105 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2370e537-8863-4579-8a32-7fea548002c7 admin admin] PATH_INFO: `/v3/projects/02d66bbe851040a6a33b6715fdb648d6` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:32:29.839763 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2370e537-8863-4579-8a32-7fea548002c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02d66bbe851040a6a33b6715fdb648d6)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:32:29.841672 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2370e537-8863-4579-8a32-7fea548002c7 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:32:29.888206 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-2370e537-8863-4579-8a32-7fea548002c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02d66bbe851040a6a33b6715fdb648d6', 'request_id': 'req-2370e537-8863-4579-8a32-7fea548002c7'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:32:29.894501 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-2370e537-8863-4579-8a32-7fea548002c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02d66bbe851040a6a33b6715fdb648d6', 'request_id': 'req-2370e537-8863-4579-8a32-7fea548002c7'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:32:29.902535 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-2370e537-8863-4579-8a32-7fea548002c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02d66bbe851040a6a33b6715fdb648d6', 'request_id': 'req-2370e537-8863-4579-8a32-7fea548002c7'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:32:29.907216 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:32:29.914588 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-2370e537-8863-4579-8a32-7fea548002c7 admin admin] The token cache is being invalidate because project 02d66bbe851040a6a33b6715fdb648d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81307) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 22:32:29.915023 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-2370e537-8863-4579-8a32-7fea548002c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:32:29.915758 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-2370e537-8863-4579-8a32-7fea548002c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:32:29.918217 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1311/2626] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 20 22:32:29 2022] DELETE /identity/v3/projects/02d66bbe851040a6a33b6715fdb648d6 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:32:29.922387 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749f6dc4-d1df-43d3-9e62-faa25ab0b9f0 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:32:29.923823 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-749f6dc4-d1df-43d3-9e62-faa25ab0b9f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:32:29.936642 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749f6dc4-d1df-43d3-9e62-faa25ab0b9f0 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:32:29.992174 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38338c0c-f3d8-4fdf-bcf6-219083a0a351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:32:29.992736 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38338c0c-f3d8-4fdf-bcf6-219083a0a351 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:32:29.993018 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38338c0c-f3d8-4fdf-bcf6-219083a0a351 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:32:29.993295 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38338c0c-f3d8-4fdf-bcf6-219083a0a351 admin admin] PATH_INFO: `/v3/users/b5a7ed7822c14c0c9934ab8b824e0046` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:32:29.994455 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38338c0c-f3d8-4fdf-bcf6-219083a0a351 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5a7ed7822c14c0c9934ab8b824e0046)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:32:29.996721 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38338c0c-f3d8-4fdf-bcf6-219083a0a351 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:32:30.042517 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-38338c0c-f3d8-4fdf-bcf6-219083a0a351 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5a7ed7822c14c0c9934ab8b824e0046'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:32:30.049747 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-38338c0c-f3d8-4fdf-bcf6-219083a0a351 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5a7ed7822c14c0c9934ab8b824e0046'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:32:30.050358 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-38338c0c-f3d8-4fdf-bcf6-219083a0a351 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5a7ed7822c14c0c9934ab8b824e0046'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:32:30.051003 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-38338c0c-f3d8-4fdf-bcf6-219083a0a351 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5a7ed7822c14c0c9934ab8b824e0046'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:32:30.057935 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-38338c0c-f3d8-4fdf-bcf6-219083a0a351 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5a7ed7822c14c0c9934ab8b824e0046'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:32:30.065609 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:32:30.077344 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1316/2627] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 20 22:32:29 2022] DELETE /identity/v3/users/b5a7ed7822c14c0c9934ab8b824e0046 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:32:30.246498 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2370e537-8863-4579-8a32-7fea548002c7 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:32:30.248077 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-2370e537-8863-4579-8a32-7fea548002c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:32:30.261845 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2370e537-8863-4579-8a32-7fea548002c7 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:32:30.318792 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d925bcf1-8d6c-47f9-8c43-7e7b2550bc13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:32:30.319431 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d925bcf1-8d6c-47f9-8c43-7e7b2550bc13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:32:30.319711 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d925bcf1-8d6c-47f9-8c43-7e7b2550bc13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:32:30.319984 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d925bcf1-8d6c-47f9-8c43-7e7b2550bc13 admin admin] PATH_INFO: `/v3/projects/819eeeffab00402c9b528aca9a1a29d8` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:32:30.321090 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d925bcf1-8d6c-47f9-8c43-7e7b2550bc13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=819eeeffab00402c9b528aca9a1a29d8)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:32:30.323026 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d925bcf1-8d6c-47f9-8c43-7e7b2550bc13 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:32:30.367699 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-d925bcf1-8d6c-47f9-8c43-7e7b2550bc13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '819eeeffab00402c9b528aca9a1a29d8', 'request_id': 'req-d925bcf1-8d6c-47f9-8c43-7e7b2550bc13'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:32:30.374282 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-d925bcf1-8d6c-47f9-8c43-7e7b2550bc13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '819eeeffab00402c9b528aca9a1a29d8', 'request_id': 'req-d925bcf1-8d6c-47f9-8c43-7e7b2550bc13'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:32:30.381604 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-d925bcf1-8d6c-47f9-8c43-7e7b2550bc13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '819eeeffab00402c9b528aca9a1a29d8', 'request_id': 'req-d925bcf1-8d6c-47f9-8c43-7e7b2550bc13'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:32:30.392675 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-d925bcf1-8d6c-47f9-8c43-7e7b2550bc13 admin admin] The token cache is being invalidate because project 819eeeffab00402c9b528aca9a1a29d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81307) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 22:32:30.392961 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-d925bcf1-8d6c-47f9-8c43-7e7b2550bc13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:32:30.393591 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-d925bcf1-8d6c-47f9-8c43-7e7b2550bc13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:32:30.395091 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1312/2628] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 20 22:32:30 2022] DELETE /identity/v3/projects/819eeeffab00402c9b528aca9a1a29d8 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:32:40.076555 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=3,keystone:DELETE=1 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:32:40.389412 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=53,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:32:49.739584 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38338c0c-f3d8-4fdf-bcf6-219083a0a351 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:32:49.740972 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-38338c0c-f3d8-4fdf-bcf6-219083a0a351 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:32:49.796582 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38338c0c-f3d8-4fdf-bcf6-219083a0a351 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:32:49.842547 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f2bafa-9d75-4f86-81a7-32e375845bd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b0b3ca4ecd41aaba9cf8e0f91fbf54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:32:49.843153 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f2bafa-9d75-4f86-81a7-32e375845bd1 service neutron] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:32:49.843429 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f2bafa-9d75-4f86-81a7-32e375845bd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:32:49.843697 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f2bafa-9d75-4f86-81a7-32e375845bd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:32:49.845383 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-94f2bafa-9d75-4f86-81a7-32e375845bd1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:32:49.905844 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f2bafa-9d75-4f86-81a7-32e375845bd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:32:49.907278 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f2bafa-9d75-4f86-81a7-32e375845bd1 service neutron] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:32:49.917245 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1317/2629] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:32:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:32:53.018091 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d925bcf1-8d6c-47f9-8c43-7e7b2550bc13 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:32:53.020883 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-d925bcf1-8d6c-47f9-8c43-7e7b2550bc13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:32:53.048199 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d925bcf1-8d6c-47f9-8c43-7e7b2550bc13 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:32:53.054468 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe36f2e9-088c-4146-94ac-28df94db61fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:32:53.056083 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe36f2e9-088c-4146-94ac-28df94db61fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:32:53.056402 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe36f2e9-088c-4146-94ac-28df94db61fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:32:53.056875 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe36f2e9-088c-4146-94ac-28df94db61fb admin admin] PATH_INFO: `/v3/users/c0a26034863a4590b4e2ec3a853a12b5` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:32:53.061300 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe36f2e9-088c-4146-94ac-28df94db61fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0a26034863a4590b4e2ec3a853a12b5)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:32:53.064693 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe36f2e9-088c-4146-94ac-28df94db61fb admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:32:53.129765 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-fe36f2e9-088c-4146-94ac-28df94db61fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0a26034863a4590b4e2ec3a853a12b5'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:32:53.140978 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-fe36f2e9-088c-4146-94ac-28df94db61fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0a26034863a4590b4e2ec3a853a12b5'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:32:53.141673 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-fe36f2e9-088c-4146-94ac-28df94db61fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0a26034863a4590b4e2ec3a853a12b5'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:32:53.142355 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-fe36f2e9-088c-4146-94ac-28df94db61fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0a26034863a4590b4e2ec3a853a12b5'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:32:53.151079 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-fe36f2e9-088c-4146-94ac-28df94db61fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0a26034863a4590b4e2ec3a853a12b5'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:32:53.173308 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1313/2630] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 20 22:32:53 2022] DELETE /identity/v3/users/c0a26034863a4590b4e2ec3a853a12b5 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:32:53.363527 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f2bafa-9d75-4f86-81a7-32e375845bd1 service neutron] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:32:53.378006 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f2bafa-9d75-4f86-81a7-32e375845bd1 service neutron] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:32:53.436411 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15115317-8d97-490e-b12c-f764931f2a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:32:53.436962 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15115317-8d97-490e-b12c-f764931f2a82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:32:53.437237 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15115317-8d97-490e-b12c-f764931f2a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:32:53.437508 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15115317-8d97-490e-b12c-f764931f2a82 admin admin] PATH_INFO: `/v3/projects/3b746b5c9b7548ab8fb16dca0ef7f227` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:32:53.438631 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15115317-8d97-490e-b12c-f764931f2a82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b746b5c9b7548ab8fb16dca0ef7f227)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:32:53.440506 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15115317-8d97-490e-b12c-f764931f2a82 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:32:53.448186 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:32:53.486218 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-15115317-8d97-490e-b12c-f764931f2a82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b746b5c9b7548ab8fb16dca0ef7f227', 'request_id': 'req-15115317-8d97-490e-b12c-f764931f2a82'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:32:53.492175 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-15115317-8d97-490e-b12c-f764931f2a82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b746b5c9b7548ab8fb16dca0ef7f227', 'request_id': 'req-15115317-8d97-490e-b12c-f764931f2a82'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:32:53.499868 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-15115317-8d97-490e-b12c-f764931f2a82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b746b5c9b7548ab8fb16dca0ef7f227', 'request_id': 'req-15115317-8d97-490e-b12c-f764931f2a82'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:32:53.510305 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-15115317-8d97-490e-b12c-f764931f2a82 admin admin] The token cache is being invalidate because project 3b746b5c9b7548ab8fb16dca0ef7f227 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81306) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 22:32:53.510630 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-15115317-8d97-490e-b12c-f764931f2a82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:32:53.511256 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-15115317-8d97-490e-b12c-f764931f2a82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:32:53.512736 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1318/2631] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 20 22:32:53 2022] DELETE /identity/v3/projects/3b746b5c9b7548ab8fb16dca0ef7f227 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 22:32:53.518558 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c54c824-1fd7-4002-93b6-bc8e31d6e25a None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:32:53.518875 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c54c824-1fd7-4002-93b6-bc8e31d6e25a None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:32:53.519147 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c54c824-1fd7-4002-93b6-bc8e31d6e25a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:32:53.578035 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-6c54c824-1fd7-4002-93b6-bc8e31d6e25a None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:32:53.579282 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-6c54c824-1fd7-4002-93b6-bc8e31d6e25a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:32:53.635323 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1314/2632] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:32:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:32:53.643881 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4960a51b-d756-467a-935b-3d075edaef3d None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:32:53.644169 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4960a51b-d756-467a-935b-3d075edaef3d None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:32:53.644447 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4960a51b-d756-467a-935b-3d075edaef3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:32:53.663991 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-4960a51b-d756-467a-935b-3d075edaef3d None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:32:53.665185 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-4960a51b-d756-467a-935b-3d075edaef3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:32:53.672997 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1319/2633] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:32:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:32:53.677098 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c54c824-1fd7-4002-93b6-bc8e31d6e25a None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:32:53.687114 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c54c824-1fd7-4002-93b6-bc8e31d6e25a None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:32:53.691560 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6136209-89c7-408e-b66d-9b6807af4c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:32:53.692144 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6136209-89c7-408e-b66d-9b6807af4c5f admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:32:53.692421 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6136209-89c7-408e-b66d-9b6807af4c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:32:53.692687 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6136209-89c7-408e-b66d-9b6807af4c5f admin admin] PATH_INFO: `/v3/domains` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:32:53.693324 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6136209-89c7-408e-b66d-9b6807af4c5f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:32:53.693622 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6136209-89c7-408e-b66d-9b6807af4c5f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:32:53.695251 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6136209-89c7-408e-b66d-9b6807af4c5f admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:32:53.707253 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1315/2634] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 20 22:32:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:32:53.711383 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4960a51b-d756-467a-935b-3d075edaef3d None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:32:53.720339 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4960a51b-d756-467a-935b-3d075edaef3d None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:32:53.724916 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7ad90f-2958-4abc-9097-b9d00502f86f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:32:53.725497 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ad90f-2958-4abc-9097-b9d00502f86f admin admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:32:53.725777 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ad90f-2958-4abc-9097-b9d00502f86f admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:32:53.726048 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ad90f-2958-4abc-9097-b9d00502f86f admin admin] PATH_INFO: `/v3/projects` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:32:53.726698 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7ad90f-2958-4abc-9097-b9d00502f86f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:32:53.728569 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7ad90f-2958-4abc-9097-b9d00502f86f admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:32:53.756802 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1320/2635] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 20 22:32:53 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:32:53.760968 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6136209-89c7-408e-b66d-9b6807af4c5f admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:32:53.771518 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6136209-89c7-408e-b66d-9b6807af4c5f admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:32:53.796956 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:32:53.829863 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea19549-ade3-4907-b612-a01dfae3bb45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:32:53.830462 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea19549-ade3-4907-b612-a01dfae3bb45 admin admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:32:53.830773 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea19549-ade3-4907-b612-a01dfae3bb45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:32:53.831049 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea19549-ade3-4907-b612-a01dfae3bb45 admin admin] PATH_INFO: `/v3/users` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:32:53.831676 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea19549-ade3-4907-b612-a01dfae3bb45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:32:53.833588 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea19549-ade3-4907-b612-a01dfae3bb45 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:32:53.853827 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1316/2636] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 20 22:32:53 2022] POST /identity/v3/users => generated 287 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:32:53.858451 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7ad90f-2958-4abc-9097-b9d00502f86f admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:32:53.868553 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7ad90f-2958-4abc-9097-b9d00502f86f admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:32:53.873772 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193db22d-c72f-48f6-9377-73a64689e9c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:32:53.874366 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193db22d-c72f-48f6-9377-73a64689e9c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:32:53.874684 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193db22d-c72f-48f6-9377-73a64689e9c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:32:53.874959 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193db22d-c72f-48f6-9377-73a64689e9c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:32:53.875597 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193db22d-c72f-48f6-9377-73a64689e9c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:32:53.877178 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193db22d-c72f-48f6-9377-73a64689e9c8 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:32:53.887046 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1321/2637] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:32:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:32:53.890821 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea19549-ade3-4907-b612-a01dfae3bb45 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:32:53.900721 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea19549-ade3-4907-b612-a01dfae3bb45 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:32:53.905515 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a46439b-23fd-4226-b5fa-b861d2d3f115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:32:53.906104 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a46439b-23fd-4226-b5fa-b861d2d3f115 admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:32:53.906379 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a46439b-23fd-4226-b5fa-b861d2d3f115 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:32:53.906677 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a46439b-23fd-4226-b5fa-b861d2d3f115 admin admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:32:53.907630 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a46439b-23fd-4226-b5fa-b861d2d3f115 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:32:53.909212 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a46439b-23fd-4226-b5fa-b861d2d3f115 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:32:53.919030 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1317/2638] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:32:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:32:53.923467 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193db22d-c72f-48f6-9377-73a64689e9c8 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:32:53.933121 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193db22d-c72f-48f6-9377-73a64689e9c8 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:32:53.938329 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e18ee69-4d67-491b-a430-90f2a6fd670c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:32:53.938940 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e18ee69-4d67-491b-a430-90f2a6fd670c admin admin] REQUEST_METHOD: `PUT` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:32:53.939217 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e18ee69-4d67-491b-a430-90f2a6fd670c admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:32:53.939485 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e18ee69-4d67-491b-a430-90f2a6fd670c admin admin] PATH_INFO: `/v3/projects/19d092458f554199876015cc7a3c1188/users/5d650a1f0b354ab0b6957ff3085f806b/roles/604444e7ad0d437dbd1f5a6e02b761f5` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:32:53.953552 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e18ee69-4d67-491b-a430-90f2a6fd670c admin admin] RBAC: Authorizing `identity:create_grant(project_id=19d092458f554199876015cc7a3c1188, user_id=5d650a1f0b354ab0b6957ff3085f806b, role_id=604444e7ad0d437dbd1f5a6e02b761f5)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:32:53.956226 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e18ee69-4d67-491b-a430-90f2a6fd670c admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:32:53.968644 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1322/2639] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:32:53 2022] PUT /identity/v3/projects/19d092458f554199876015cc7a3c1188/users/5d650a1f0b354ab0b6957ff3085f806b/roles/604444e7ad0d437dbd1f5a6e02b761f5 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 22:32:53.978727 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68ad826-5d93-473a-b0e6-c7c149e68b64 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:32:53.979014 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68ad826-5d93-473a-b0e6-c7c149e68b64 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:32:53.979287 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68ad826-5d93-473a-b0e6-c7c149e68b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:32:54.007494 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-e68ad826-5d93-473a-b0e6-c7c149e68b64 None None] MFA Rules not processed for user `5d650a1f0b354ab0b6957ff3085f806b`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:32:54.008694 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-e68ad826-5d93-473a-b0e6-c7c149e68b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:32:54.071279 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1318/2640] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:32:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:32:54.075850 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e18ee69-4d67-491b-a430-90f2a6fd670c admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:32:54.136861 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e18ee69-4d67-491b-a430-90f2a6fd670c admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:32:54.141535 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd82b7dd-fada-4d99-811a-ea851b624bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:32:54.142134 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd82b7dd-fada-4d99-811a-ea851b624bf1 admin admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:32:54.142418 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd82b7dd-fada-4d99-811a-ea851b624bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:32:54.142719 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd82b7dd-fada-4d99-811a-ea851b624bf1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:32:54.143353 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd82b7dd-fada-4d99-811a-ea851b624bf1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:32:54.145234 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd82b7dd-fada-4d99-811a-ea851b624bf1 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:32:54.171613 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1323/2641] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 20 22:32:54 2022] POST /identity/v3/projects => generated 371 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:32:54.175798 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68ad826-5d93-473a-b0e6-c7c149e68b64 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:32:54.186818 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68ad826-5d93-473a-b0e6-c7c149e68b64 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:32:54.241924 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be1c749-62c1-43bf-a5fd-822253020cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:32:54.242454 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be1c749-62c1-43bf-a5fd-822253020cab admin admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:32:54.242766 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be1c749-62c1-43bf-a5fd-822253020cab admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:32:54.243042 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be1c749-62c1-43bf-a5fd-822253020cab admin admin] PATH_INFO: `/v3/users` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:32:54.243674 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be1c749-62c1-43bf-a5fd-822253020cab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:32:54.245587 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be1c749-62c1-43bf-a5fd-822253020cab admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:32:54.270851 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1319/2642] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 20 22:32:54 2022] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:32:54.272198 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd82b7dd-fada-4d99-811a-ea851b624bf1 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:32:54.283494 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd82b7dd-fada-4d99-811a-ea851b624bf1 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:32:54.288107 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9623359-c6d2-4cde-b895-2aeb290c087e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:32:54.288696 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9623359-c6d2-4cde-b895-2aeb290c087e admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:32:54.288973 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9623359-c6d2-4cde-b895-2aeb290c087e admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:32:54.289246 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9623359-c6d2-4cde-b895-2aeb290c087e admin admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:32:54.290028 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9623359-c6d2-4cde-b895-2aeb290c087e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:32:54.291699 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9623359-c6d2-4cde-b895-2aeb290c087e admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:32:54.304604 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1324/2643] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:32:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:32:54.308901 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be1c749-62c1-43bf-a5fd-822253020cab admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:32:54.319126 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be1c749-62c1-43bf-a5fd-822253020cab admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:32:54.324249 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fa0d36-7621-48b0-8cec-255d674a9058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:32:54.324924 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa0d36-7621-48b0-8cec-255d674a9058 admin admin] REQUEST_METHOD: `PUT` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:32:54.325202 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa0d36-7621-48b0-8cec-255d674a9058 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:32:54.325473 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa0d36-7621-48b0-8cec-255d674a9058 admin admin] PATH_INFO: `/v3/projects/cad2c6914ed649f6b538e02bfe9ef63e/users/0cc212c9d7754492ace97a81abf3183b/roles/8a829170b29d42d6af589399e51edb0f` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:32:54.341628 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fa0d36-7621-48b0-8cec-255d674a9058 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cad2c6914ed649f6b538e02bfe9ef63e, user_id=0cc212c9d7754492ace97a81abf3183b, role_id=8a829170b29d42d6af589399e51edb0f)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:32:54.344877 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fa0d36-7621-48b0-8cec-255d674a9058 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:32:54.359075 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1320/2644] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:32:54 2022] PUT /identity/v3/projects/cad2c6914ed649f6b538e02bfe9ef63e/users/0cc212c9d7754492ace97a81abf3183b/roles/8a829170b29d42d6af589399e51edb0f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:32:54.363072 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9623359-c6d2-4cde-b895-2aeb290c087e admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:32:54.374577 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9623359-c6d2-4cde-b895-2aeb290c087e admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:32:54.379200 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:32:54.437250 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9daa235-ef6f-4d68-ad8e-dfd95ef095fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:32:54.437858 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9daa235-ef6f-4d68-ad8e-dfd95ef095fc admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:32:54.438140 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9daa235-ef6f-4d68-ad8e-dfd95ef095fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:32:54.438417 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9daa235-ef6f-4d68-ad8e-dfd95ef095fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:32:54.439107 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9daa235-ef6f-4d68-ad8e-dfd95ef095fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:32:54.440694 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9daa235-ef6f-4d68-ad8e-dfd95ef095fc admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:32:54.450391 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1325/2645] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:32:54 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:32:54.454551 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fa0d36-7621-48b0-8cec-255d674a9058 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:32:54.459969 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:32:54.466210 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fa0d36-7621-48b0-8cec-255d674a9058 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:32:54.471731 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74cfd2c-ba35-40aa-9e40-806ee8077111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:32:54.472398 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74cfd2c-ba35-40aa-9e40-806ee8077111 admin admin] REQUEST_METHOD: `PUT` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:32:54.472675 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74cfd2c-ba35-40aa-9e40-806ee8077111 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:32:54.472942 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74cfd2c-ba35-40aa-9e40-806ee8077111 admin admin] PATH_INFO: `/v3/projects/cad2c6914ed649f6b538e02bfe9ef63e/users/0cc212c9d7754492ace97a81abf3183b/roles/8a829170b29d42d6af589399e51edb0f` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:32:54.474859 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74cfd2c-ba35-40aa-9e40-806ee8077111 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cad2c6914ed649f6b538e02bfe9ef63e, user_id=0cc212c9d7754492ace97a81abf3183b, role_id=8a829170b29d42d6af589399e51edb0f)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:32:54.477506 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74cfd2c-ba35-40aa-9e40-806ee8077111 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:32:54.488148 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1321/2646] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:32:54 2022] PUT /identity/v3/projects/cad2c6914ed649f6b538e02bfe9ef63e/users/0cc212c9d7754492ace97a81abf3183b/roles/8a829170b29d42d6af589399e51edb0f => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:32:54.499548 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089dc688-f16a-4206-9fb6-4928075e91ef None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:32:54.499801 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089dc688-f16a-4206-9fb6-4928075e91ef None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:32:54.500080 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089dc688-f16a-4206-9fb6-4928075e91ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:32:54.527489 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-089dc688-f16a-4206-9fb6-4928075e91ef None None] MFA Rules not processed for user `0cc212c9d7754492ace97a81abf3183b`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:32:54.528731 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-089dc688-f16a-4206-9fb6-4928075e91ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:32:54.596642 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1326/2647] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:32:54 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:32:54.608465 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74cfd2c-ba35-40aa-9e40-806ee8077111 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:32:54.610155 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-b74cfd2c-ba35-40aa-9e40-806ee8077111 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:32:54.686745 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74cfd2c-ba35-40aa-9e40-806ee8077111 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:32:54.690357 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a81d35-7fca-4c79-a7ee-d56b916ac470 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577c8b14c1f4279beac13b9ba11aba1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:32:54.690995 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a81d35-7fca-4c79-a7ee-d56b916ac470 service cinder] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:32:54.691272 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a81d35-7fca-4c79-a7ee-d56b916ac470 service cinder] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:32:54.691543 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a81d35-7fca-4c79-a7ee-d56b916ac470 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:32:54.700807 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a81d35-7fca-4c79-a7ee-d56b916ac470 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:32:54.702784 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a81d35-7fca-4c79-a7ee-d56b916ac470 service cinder] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:32:54.712520 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1322/2648] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:32:54 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:32:54.788842 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089dc688-f16a-4206-9fb6-4928075e91ef None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:32:54.798596 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089dc688-f16a-4206-9fb6-4928075e91ef None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:32:54.802138 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d7d1bf-328f-4ea1-bbfa-0f135af813e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577c8b14c1f4279beac13b9ba11aba1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:32:54.802760 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d7d1bf-328f-4ea1-bbfa-0f135af813e6 service cinder] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:32:54.803037 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d7d1bf-328f-4ea1-bbfa-0f135af813e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:32:54.803301 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d7d1bf-328f-4ea1-bbfa-0f135af813e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:32:54.860374 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d7d1bf-328f-4ea1-bbfa-0f135af813e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:32:54.861797 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d7d1bf-328f-4ea1-bbfa-0f135af813e6 service cinder] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:32:54.870799 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1327/2649] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:32:54 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:32:59.630123 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a81d35-7fca-4c79-a7ee-d56b916ac470 service cinder] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:32:59.631528 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-64a81d35-7fca-4c79-a7ee-d56b916ac470 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:32:59.689421 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a81d35-7fca-4c79-a7ee-d56b916ac470 service cinder] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:32:59.693010 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90af0882-9237-40f5-928d-454e61e1c59e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b0b3ca4ecd41aaba9cf8e0f91fbf54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:32:59.693608 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90af0882-9237-40f5-928d-454e61e1c59e service neutron] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:32:59.693882 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90af0882-9237-40f5-928d-454e61e1c59e service neutron] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:32:59.694145 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90af0882-9237-40f5-928d-454e61e1c59e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:32:59.695852 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-90af0882-9237-40f5-928d-454e61e1c59e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:32:59.757130 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90af0882-9237-40f5-928d-454e61e1c59e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:32:59.758600 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90af0882-9237-40f5-928d-454e61e1c59e service neutron] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:32:59.769830 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1323/2650] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:32:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:33:02.886724 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d7d1bf-328f-4ea1-bbfa-0f135af813e6 service cinder] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:33:02.888176 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-a7d7d1bf-328f-4ea1-bbfa-0f135af813e6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:33:02.903159 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d7d1bf-328f-4ea1-bbfa-0f135af813e6 service cinder] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:33:02.908458 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efc6180-e46e-4131-94ff-44f6641c70a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:33:02.909074 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efc6180-e46e-4131-94ff-44f6641c70a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:02.909351 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efc6180-e46e-4131-94ff-44f6641c70a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:02.909617 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efc6180-e46e-4131-94ff-44f6641c70a7 admin admin] PATH_INFO: `/v3/users/3eed1b62f00a4dbc98524c44147c3b72` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:02.910770 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efc6180-e46e-4131-94ff-44f6641c70a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3eed1b62f00a4dbc98524c44147c3b72)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:33:02.912657 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efc6180-e46e-4131-94ff-44f6641c70a7 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:33:02.939830 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:33:02.966965 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-6efc6180-e46e-4131-94ff-44f6641c70a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3eed1b62f00a4dbc98524c44147c3b72'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:33:02.974575 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-6efc6180-e46e-4131-94ff-44f6641c70a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3eed1b62f00a4dbc98524c44147c3b72'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:33:02.975178 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-6efc6180-e46e-4131-94ff-44f6641c70a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3eed1b62f00a4dbc98524c44147c3b72'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:33:02.975769 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-6efc6180-e46e-4131-94ff-44f6641c70a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3eed1b62f00a4dbc98524c44147c3b72'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:33:02.982440 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-6efc6180-e46e-4131-94ff-44f6641c70a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3eed1b62f00a4dbc98524c44147c3b72'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:33:02.999887 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1328/2651] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 20 22:33:02 2022] DELETE /identity/v3/users/3eed1b62f00a4dbc98524c44147c3b72 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:33:03.200860 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90af0882-9237-40f5-928d-454e61e1c59e service neutron] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:33:03.219364 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90af0882-9237-40f5-928d-454e61e1c59e service neutron] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:33:03.242856 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:33:03.291968 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cf17e8-7a79-4a62-9dfb-3912d3e1b2be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:33:03.293098 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cf17e8-7a79-4a62-9dfb-3912d3e1b2be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:03.293592 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cf17e8-7a79-4a62-9dfb-3912d3e1b2be admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:03.294055 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cf17e8-7a79-4a62-9dfb-3912d3e1b2be admin admin] PATH_INFO: `/v3/projects/6f8903954d88410db9298a159c3e8cc1` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:03.295978 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cf17e8-7a79-4a62-9dfb-3912d3e1b2be admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f8903954d88410db9298a159c3e8cc1)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:33:03.298354 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cf17e8-7a79-4a62-9dfb-3912d3e1b2be admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:33:03.354337 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-81cf17e8-7a79-4a62-9dfb-3912d3e1b2be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f8903954d88410db9298a159c3e8cc1', 'request_id': 'req-81cf17e8-7a79-4a62-9dfb-3912d3e1b2be'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:33:03.361371 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-81cf17e8-7a79-4a62-9dfb-3912d3e1b2be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f8903954d88410db9298a159c3e8cc1', 'request_id': 'req-81cf17e8-7a79-4a62-9dfb-3912d3e1b2be'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:33:03.371594 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-81cf17e8-7a79-4a62-9dfb-3912d3e1b2be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f8903954d88410db9298a159c3e8cc1', 'request_id': 'req-81cf17e8-7a79-4a62-9dfb-3912d3e1b2be'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:33:03.383309 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-81cf17e8-7a79-4a62-9dfb-3912d3e1b2be admin admin] The token cache is being invalidate because project 6f8903954d88410db9298a159c3e8cc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81307) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 22:33:03.383605 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-81cf17e8-7a79-4a62-9dfb-3912d3e1b2be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:33:03.384256 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-81cf17e8-7a79-4a62-9dfb-3912d3e1b2be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:33:03.385740 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1324/2652] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 20 22:33:03 2022] DELETE /identity/v3/projects/6f8903954d88410db9298a159c3e8cc1 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:33:03.391690 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c751216b-841f-4d56-a1ad-6e61fa375914 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:03.391983 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c751216b-841f-4d56-a1ad-6e61fa375914 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:03.392260 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c751216b-841f-4d56-a1ad-6e61fa375914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:03.412422 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-c751216b-841f-4d56-a1ad-6e61fa375914 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:33:03.413634 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-c751216b-841f-4d56-a1ad-6e61fa375914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:33:03.475802 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1329/2653] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:33:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:33:03.483866 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a25bde6-2c79-4bff-b21a-6037f8e11cf4 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:03.484146 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a25bde6-2c79-4bff-b21a-6037f8e11cf4 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:03.484418 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a25bde6-2c79-4bff-b21a-6037f8e11cf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:03.505292 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-2a25bde6-2c79-4bff-b21a-6037f8e11cf4 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:33:03.506608 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-2a25bde6-2c79-4bff-b21a-6037f8e11cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:33:03.514662 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1325/2654] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:33:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:33:03.519713 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c751216b-841f-4d56-a1ad-6e61fa375914 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:33:03.529990 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c751216b-841f-4d56-a1ad-6e61fa375914 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:33:03.536400 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7c2400-f5b0-47d5-82b1-89665324fdb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:33:03.537498 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7c2400-f5b0-47d5-82b1-89665324fdb3 admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:03.537980 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7c2400-f5b0-47d5-82b1-89665324fdb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:03.538523 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7c2400-f5b0-47d5-82b1-89665324fdb3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:03.539755 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7c2400-f5b0-47d5-82b1-89665324fdb3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:33:03.540253 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7c2400-f5b0-47d5-82b1-89665324fdb3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:33:03.542647 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7c2400-f5b0-47d5-82b1-89665324fdb3 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:33:03.556753 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1330/2655] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 20 22:33:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:33:03.561048 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a25bde6-2c79-4bff-b21a-6037f8e11cf4 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:33:03.571527 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a25bde6-2c79-4bff-b21a-6037f8e11cf4 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:33:03.576227 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0edb15-d520-4efc-9018-71793737b2f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:33:03.576972 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0edb15-d520-4efc-9018-71793737b2f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:03.577253 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0edb15-d520-4efc-9018-71793737b2f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:03.577524 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0edb15-d520-4efc-9018-71793737b2f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:03.578157 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0edb15-d520-4efc-9018-71793737b2f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:33:03.580086 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0edb15-d520-4efc-9018-71793737b2f4 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:33:03.607628 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1326/2656] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 20 22:33:03 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:33:03.613390 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7c2400-f5b0-47d5-82b1-89665324fdb3 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:33:03.623803 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7c2400-f5b0-47d5-82b1-89665324fdb3 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:33:03.681361 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a5ec77-2b8d-42f8-82fb-1cc99f9ba059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:33:03.681963 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a5ec77-2b8d-42f8-82fb-1cc99f9ba059 admin admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:03.682247 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a5ec77-2b8d-42f8-82fb-1cc99f9ba059 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:03.682548 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a5ec77-2b8d-42f8-82fb-1cc99f9ba059 admin admin] PATH_INFO: `/v3/users` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:03.683187 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a5ec77-2b8d-42f8-82fb-1cc99f9ba059 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:33:03.685097 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a5ec77-2b8d-42f8-82fb-1cc99f9ba059 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:33:03.706795 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1331/2657] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 20 22:33:03 2022] POST /identity/v3/users => generated 289 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:33:03.711144 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0edb15-d520-4efc-9018-71793737b2f4 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:33:03.721287 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0edb15-d520-4efc-9018-71793737b2f4 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:33:03.725868 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13baa41-ca71-47e7-b3de-97d8f80bcad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:33:03.726459 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13baa41-ca71-47e7-b3de-97d8f80bcad8 admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:03.726772 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13baa41-ca71-47e7-b3de-97d8f80bcad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:03.727046 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13baa41-ca71-47e7-b3de-97d8f80bcad8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:03.727686 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13baa41-ca71-47e7-b3de-97d8f80bcad8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:33:03.729463 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13baa41-ca71-47e7-b3de-97d8f80bcad8 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:33:03.739877 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1327/2658] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:33:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:33:03.743750 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a5ec77-2b8d-42f8-82fb-1cc99f9ba059 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:33:03.754120 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a5ec77-2b8d-42f8-82fb-1cc99f9ba059 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:33:03.758761 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad01d4e7-8f16-4712-866b-5505e8e3e096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:33:03.759356 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad01d4e7-8f16-4712-866b-5505e8e3e096 admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:03.759636 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad01d4e7-8f16-4712-866b-5505e8e3e096 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:03.759909 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad01d4e7-8f16-4712-866b-5505e8e3e096 admin admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:03.760542 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad01d4e7-8f16-4712-866b-5505e8e3e096 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:33:03.762104 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad01d4e7-8f16-4712-866b-5505e8e3e096 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:33:03.772956 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1332/2659] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:33:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:33:03.776875 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13baa41-ca71-47e7-b3de-97d8f80bcad8 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:33:03.786966 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13baa41-ca71-47e7-b3de-97d8f80bcad8 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:33:03.791683 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907df470-c6f5-45e9-87c9-d9b5fec10280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:33:03.792317 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907df470-c6f5-45e9-87c9-d9b5fec10280 admin admin] REQUEST_METHOD: `PUT` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:03.792598 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907df470-c6f5-45e9-87c9-d9b5fec10280 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:03.792868 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907df470-c6f5-45e9-87c9-d9b5fec10280 admin admin] PATH_INFO: `/v3/projects/68665d087cc54f2b90524c3d60502328/users/ae68b69c55854f1badadd69711d839ee/roles/604444e7ad0d437dbd1f5a6e02b761f5` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:03.807896 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907df470-c6f5-45e9-87c9-d9b5fec10280 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68665d087cc54f2b90524c3d60502328, user_id=ae68b69c55854f1badadd69711d839ee, role_id=604444e7ad0d437dbd1f5a6e02b761f5)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:33:03.810468 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907df470-c6f5-45e9-87c9-d9b5fec10280 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:33:03.824493 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1328/2660] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:33:03 2022] PUT /identity/v3/projects/68665d087cc54f2b90524c3d60502328/users/ae68b69c55854f1badadd69711d839ee/roles/604444e7ad0d437dbd1f5a6e02b761f5 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 22:33:03.834678 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531e4454-2782-4179-a81e-0350bf043782 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:03.834981 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531e4454-2782-4179-a81e-0350bf043782 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:03.835238 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531e4454-2782-4179-a81e-0350bf043782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:03.844048 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:33:03.855713 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-531e4454-2782-4179-a81e-0350bf043782 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:33:03.856918 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-531e4454-2782-4179-a81e-0350bf043782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:33:03.915384 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1333/2661] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:33:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:33:03.924972 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907df470-c6f5-45e9-87c9-d9b5fec10280 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:33:03.926702 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-907df470-c6f5-45e9-87c9-d9b5fec10280 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:33:03.977736 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:33:03.981533 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907df470-c6f5-45e9-87c9-d9b5fec10280 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:33:03.987298 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18becfbd-2784-43c2-bff4-145d7a64ce8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b0b3ca4ecd41aaba9cf8e0f91fbf54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:33:03.988024 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18becfbd-2784-43c2-bff4-145d7a64ce8d service neutron] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:03.988340 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18becfbd-2784-43c2-bff4-145d7a64ce8d service neutron] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:03.988641 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18becfbd-2784-43c2-bff4-145d7a64ce8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:03.997903 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18becfbd-2784-43c2-bff4-145d7a64ce8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:33:03.999344 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18becfbd-2784-43c2-bff4-145d7a64ce8d service neutron] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:33:04.008525 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1329/2662] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:33:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:33:08.009409 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed7a2d-e8a4-4fb0-9e50-4db22650f5b9 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:08.009914 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed7a2d-e8a4-4fb0-9e50-4db22650f5b9 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:08.010042 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed7a2d-e8a4-4fb0-9e50-4db22650f5b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:08.038573 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-34ed7a2d-e8a4-4fb0-9e50-4db22650f5b9 None None] MFA Rules not processed for user `ae68b69c55854f1badadd69711d839ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:33:08.039810 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-34ed7a2d-e8a4-4fb0-9e50-4db22650f5b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:33:08.109398 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1334/2663] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:33:08 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 22:33:08.124641 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18becfbd-2784-43c2-bff4-145d7a64ce8d service neutron] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:33:08.126099 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-18becfbd-2784-43c2-bff4-145d7a64ce8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:33:08.226930 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18becfbd-2784-43c2-bff4-145d7a64ce8d service neutron] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:33:08.232779 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84564fc-6363-4b9c-ba10-0b2b24f95641 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db7eed561e99452289a662ad326cf919', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:33:08.233403 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84564fc-6363-4b9c-ba10-0b2b24f95641 service nova] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:08.233684 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84564fc-6363-4b9c-ba10-0b2b24f95641 service nova] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:08.233960 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84564fc-6363-4b9c-ba10-0b2b24f95641 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:08.249484 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84564fc-6363-4b9c-ba10-0b2b24f95641 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:33:08.251224 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84564fc-6363-4b9c-ba10-0b2b24f95641 service nova] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:33:08.261320 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1330/2664] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:33:08 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:33:10.541282 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded40921-43b9-4a8f-80b0-aa5b4bd8e186 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:10.541807 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded40921-43b9-4a8f-80b0-aa5b4bd8e186 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:10.541807 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded40921-43b9-4a8f-80b0-aa5b4bd8e186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:10.560741 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-ded40921-43b9-4a8f-80b0-aa5b4bd8e186 None None] MFA Rules not processed for user `ae68b69c55854f1badadd69711d839ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:33:10.561949 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-ded40921-43b9-4a8f-80b0-aa5b4bd8e186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:33:10.568970 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1335/2665] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:33:10 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:33:18.257198 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=47 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:33:20.555207 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=60 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:33:24.516923 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84564fc-6363-4b9c-ba10-0b2b24f95641 service nova] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:33:24.518393 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-e84564fc-6363-4b9c-ba10-0b2b24f95641 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:33:24.533747 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84564fc-6363-4b9c-ba10-0b2b24f95641 service nova] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:33:24.541591 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990c4bbd-aedf-4b42-996e-e258f494b5c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:33:24.542249 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990c4bbd-aedf-4b42-996e-e258f494b5c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:24.542573 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990c4bbd-aedf-4b42-996e-e258f494b5c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:24.542815 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990c4bbd-aedf-4b42-996e-e258f494b5c1 admin admin] PATH_INFO: `/v3/users/5d650a1f0b354ab0b6957ff3085f806b` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:24.543987 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990c4bbd-aedf-4b42-996e-e258f494b5c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d650a1f0b354ab0b6957ff3085f806b)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:33:24.546187 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990c4bbd-aedf-4b42-996e-e258f494b5c1 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:33:24.616079 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-990c4bbd-aedf-4b42-996e-e258f494b5c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d650a1f0b354ab0b6957ff3085f806b'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:33:24.625648 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-990c4bbd-aedf-4b42-996e-e258f494b5c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d650a1f0b354ab0b6957ff3085f806b'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:33:24.626399 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-990c4bbd-aedf-4b42-996e-e258f494b5c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d650a1f0b354ab0b6957ff3085f806b'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:33:24.627087 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-990c4bbd-aedf-4b42-996e-e258f494b5c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d650a1f0b354ab0b6957ff3085f806b'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:33:24.637313 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-990c4bbd-aedf-4b42-996e-e258f494b5c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d650a1f0b354ab0b6957ff3085f806b'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:33:24.660400 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1331/2666] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 20 22:33:24 2022] DELETE /identity/v3/users/5d650a1f0b354ab0b6957ff3085f806b => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:33:24.665105 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ff1b1b-30d1-4caa-807e-798fe8060214 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:24.665685 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ff1b1b-30d1-4caa-807e-798fe8060214 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:24.665685 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ff1b1b-30d1-4caa-807e-798fe8060214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:24.687069 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-32ff1b1b-30d1-4caa-807e-798fe8060214 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:33:24.689001 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-32ff1b1b-30d1-4caa-807e-798fe8060214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:33:24.756561 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1336/2667] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:33:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 22:33:24.767341 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990c4bbd-aedf-4b42-996e-e258f494b5c1 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:33:24.768968 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-990c4bbd-aedf-4b42-996e-e258f494b5c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:33:24.842108 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990c4bbd-aedf-4b42-996e-e258f494b5c1 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:33:24.846019 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c42083-3bac-4a67-8d65-97078448fcb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b0b3ca4ecd41aaba9cf8e0f91fbf54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:33:24.846779 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c42083-3bac-4a67-8d65-97078448fcb2 service neutron] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:24.847669 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c42083-3bac-4a67-8d65-97078448fcb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:24.848062 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c42083-3bac-4a67-8d65-97078448fcb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:24.858762 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c42083-3bac-4a67-8d65-97078448fcb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:33:24.860203 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c42083-3bac-4a67-8d65-97078448fcb2 service neutron] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:33:24.871244 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1332/2668] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:33:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:33:25.259594 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ff1b1b-30d1-4caa-807e-798fe8060214 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:33:25.261298 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-32ff1b1b-30d1-4caa-807e-798fe8060214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:33:25.273555 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ff1b1b-30d1-4caa-807e-798fe8060214 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:33:25.280625 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8c7713-77e6-4533-b802-8319556a05b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:33:25.281728 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8c7713-77e6-4533-b802-8319556a05b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:25.282073 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8c7713-77e6-4533-b802-8319556a05b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:25.282415 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8c7713-77e6-4533-b802-8319556a05b9 admin admin] PATH_INFO: `/v3/projects/19d092458f554199876015cc7a3c1188` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:25.283575 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8c7713-77e6-4533-b802-8319556a05b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19d092458f554199876015cc7a3c1188)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:33:25.285566 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8c7713-77e6-4533-b802-8319556a05b9 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:33:25.349839 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-ad8c7713-77e6-4533-b802-8319556a05b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19d092458f554199876015cc7a3c1188', 'request_id': 'req-ad8c7713-77e6-4533-b802-8319556a05b9'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:33:25.356456 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-ad8c7713-77e6-4533-b802-8319556a05b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19d092458f554199876015cc7a3c1188', 'request_id': 'req-ad8c7713-77e6-4533-b802-8319556a05b9'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:33:25.365141 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-ad8c7713-77e6-4533-b802-8319556a05b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19d092458f554199876015cc7a3c1188', 'request_id': 'req-ad8c7713-77e6-4533-b802-8319556a05b9'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:33:25.376885 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-ad8c7713-77e6-4533-b802-8319556a05b9 admin admin] The token cache is being invalidate because project 19d092458f554199876015cc7a3c1188 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81306) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 22:33:25.377171 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-ad8c7713-77e6-4533-b802-8319556a05b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:33:25.377853 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-ad8c7713-77e6-4533-b802-8319556a05b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:33:25.380017 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1337/2669] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 20 22:33:25 2022] DELETE /identity/v3/projects/19d092458f554199876015cc7a3c1188 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:33:25.383983 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c42083-3bac-4a67-8d65-97078448fcb2 service neutron] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:33:25.394029 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c42083-3bac-4a67-8d65-97078448fcb2 service neutron] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:33:25.452778 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b908cf-79cd-473b-bbe9-c89af0e1e089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:33:25.453324 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b908cf-79cd-473b-bbe9-c89af0e1e089 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:25.453604 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b908cf-79cd-473b-bbe9-c89af0e1e089 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:25.453874 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b908cf-79cd-473b-bbe9-c89af0e1e089 admin admin] PATH_INFO: `/v3/users/0cc212c9d7754492ace97a81abf3183b` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:25.455024 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b908cf-79cd-473b-bbe9-c89af0e1e089 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cc212c9d7754492ace97a81abf3183b)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:33:25.457029 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b908cf-79cd-473b-bbe9-c89af0e1e089 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:33:25.472618 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:33:25.505839 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-e9b908cf-79cd-473b-bbe9-c89af0e1e089 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cc212c9d7754492ace97a81abf3183b'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:33:25.513125 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-e9b908cf-79cd-473b-bbe9-c89af0e1e089 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cc212c9d7754492ace97a81abf3183b'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:33:25.513761 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-e9b908cf-79cd-473b-bbe9-c89af0e1e089 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cc212c9d7754492ace97a81abf3183b'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:33:25.514361 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-e9b908cf-79cd-473b-bbe9-c89af0e1e089 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cc212c9d7754492ace97a81abf3183b'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:33:25.521319 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-e9b908cf-79cd-473b-bbe9-c89af0e1e089 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cc212c9d7754492ace97a81abf3183b'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:33:25.543833 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1333/2670] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 20 22:33:25 2022] DELETE /identity/v3/users/0cc212c9d7754492ace97a81abf3183b => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:33:25.815863 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8c7713-77e6-4533-b802-8319556a05b9 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:33:25.817435 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-ad8c7713-77e6-4533-b802-8319556a05b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:33:25.830957 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8c7713-77e6-4533-b802-8319556a05b9 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:33:25.891279 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1d25a8-155c-44ea-94fa-bf4d4e1ced39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:33:25.891946 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1d25a8-155c-44ea-94fa-bf4d4e1ced39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:25.892231 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1d25a8-155c-44ea-94fa-bf4d4e1ced39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:25.892508 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1d25a8-155c-44ea-94fa-bf4d4e1ced39 admin admin] PATH_INFO: `/v3/projects/cad2c6914ed649f6b538e02bfe9ef63e` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:25.893637 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1d25a8-155c-44ea-94fa-bf4d4e1ced39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cad2c6914ed649f6b538e02bfe9ef63e)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:33:25.895642 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1d25a8-155c-44ea-94fa-bf4d4e1ced39 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:33:25.926400 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:33:25.943586 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-0b1d25a8-155c-44ea-94fa-bf4d4e1ced39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cad2c6914ed649f6b538e02bfe9ef63e', 'request_id': 'req-0b1d25a8-155c-44ea-94fa-bf4d4e1ced39'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:33:25.949598 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-0b1d25a8-155c-44ea-94fa-bf4d4e1ced39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cad2c6914ed649f6b538e02bfe9ef63e', 'request_id': 'req-0b1d25a8-155c-44ea-94fa-bf4d4e1ced39'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:33:25.957328 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-0b1d25a8-155c-44ea-94fa-bf4d4e1ced39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cad2c6914ed649f6b538e02bfe9ef63e', 'request_id': 'req-0b1d25a8-155c-44ea-94fa-bf4d4e1ced39'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:33:25.967824 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-0b1d25a8-155c-44ea-94fa-bf4d4e1ced39 admin admin] The token cache is being invalidate because project cad2c6914ed649f6b538e02bfe9ef63e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81306) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 22:33:25.968111 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-0b1d25a8-155c-44ea-94fa-bf4d4e1ced39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:33:25.968748 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-0b1d25a8-155c-44ea-94fa-bf4d4e1ced39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:33:25.970206 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1338/2671] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 20 22:33:25 2022] DELETE /identity/v3/projects/cad2c6914ed649f6b538e02bfe9ef63e => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:33:25.975809 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f434a631-e0bd-459a-a066-16a1f4b6b551 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:25.976102 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f434a631-e0bd-459a-a066-16a1f4b6b551 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:25.976411 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f434a631-e0bd-459a-a066-16a1f4b6b551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:25.995725 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-f434a631-e0bd-459a-a066-16a1f4b6b551 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:33:25.996929 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-f434a631-e0bd-459a-a066-16a1f4b6b551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:33:26.055091 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1334/2672] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:33:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:33:26.062955 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c84731b-f1e7-4741-8655-b857b7a3b54f None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:26.063255 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c84731b-f1e7-4741-8655-b857b7a3b54f None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:26.063524 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c84731b-f1e7-4741-8655-b857b7a3b54f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:26.083537 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-2c84731b-f1e7-4741-8655-b857b7a3b54f None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:33:26.084741 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-2c84731b-f1e7-4741-8655-b857b7a3b54f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:33:26.093168 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1339/2673] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:33:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:33:26.098102 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f434a631-e0bd-459a-a066-16a1f4b6b551 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:33:26.107746 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f434a631-e0bd-459a-a066-16a1f4b6b551 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:33:26.112348 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe1581e-6d01-44e7-afb6-26cad45c144d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:33:26.112982 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe1581e-6d01-44e7-afb6-26cad45c144d admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:26.113266 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe1581e-6d01-44e7-afb6-26cad45c144d admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:26.113541 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe1581e-6d01-44e7-afb6-26cad45c144d admin admin] PATH_INFO: `/v3/domains` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:26.114181 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe1581e-6d01-44e7-afb6-26cad45c144d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:33:26.114533 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe1581e-6d01-44e7-afb6-26cad45c144d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:33:26.116150 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe1581e-6d01-44e7-afb6-26cad45c144d admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:33:26.127676 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1335/2674] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 20 22:33:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:33:26.131773 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c84731b-f1e7-4741-8655-b857b7a3b54f None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:33:26.140793 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c84731b-f1e7-4741-8655-b857b7a3b54f None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:33:26.145889 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19f4870-77ab-40f4-8f26-70180ac69587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:33:26.146475 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19f4870-77ab-40f4-8f26-70180ac69587 admin admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:26.146791 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19f4870-77ab-40f4-8f26-70180ac69587 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:26.147062 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19f4870-77ab-40f4-8f26-70180ac69587 admin admin] PATH_INFO: `/v3/projects` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:26.147720 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19f4870-77ab-40f4-8f26-70180ac69587 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:33:26.149597 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19f4870-77ab-40f4-8f26-70180ac69587 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:33:26.176705 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1340/2675] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 20 22:33:26 2022] POST /identity/v3/projects => generated 367 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:33:26.180798 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe1581e-6d01-44e7-afb6-26cad45c144d admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:33:26.190758 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe1581e-6d01-44e7-afb6-26cad45c144d admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:33:26.246089 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92411c57-b728-4926-a66c-01b79174ffd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:33:26.246641 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92411c57-b728-4926-a66c-01b79174ffd3 admin admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:26.246922 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92411c57-b728-4926-a66c-01b79174ffd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:26.247192 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92411c57-b728-4926-a66c-01b79174ffd3 admin admin] PATH_INFO: `/v3/users` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:26.247819 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92411c57-b728-4926-a66c-01b79174ffd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:33:26.249715 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92411c57-b728-4926-a66c-01b79174ffd3 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:33:26.271220 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1336/2676] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 20 22:33:26 2022] POST /identity/v3/users => generated 284 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:33:26.275327 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19f4870-77ab-40f4-8f26-70180ac69587 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:33:26.286359 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19f4870-77ab-40f4-8f26-70180ac69587 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:33:26.291045 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2510e3d5-782d-4974-81bd-36109d9f80b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:33:26.291643 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2510e3d5-782d-4974-81bd-36109d9f80b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:26.291924 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2510e3d5-782d-4974-81bd-36109d9f80b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:26.292197 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2510e3d5-782d-4974-81bd-36109d9f80b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:26.292838 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2510e3d5-782d-4974-81bd-36109d9f80b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:33:26.294434 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2510e3d5-782d-4974-81bd-36109d9f80b0 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:33:26.305290 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1341/2677] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:33:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:33:26.309232 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92411c57-b728-4926-a66c-01b79174ffd3 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:33:26.319607 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92411c57-b728-4926-a66c-01b79174ffd3 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:33:26.324203 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf3363e-a562-48ae-a4ae-4a35216fa7e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:33:26.324796 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf3363e-a562-48ae-a4ae-4a35216fa7e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:26.325076 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf3363e-a562-48ae-a4ae-4a35216fa7e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:26.325347 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf3363e-a562-48ae-a4ae-4a35216fa7e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:26.325990 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf3363e-a562-48ae-a4ae-4a35216fa7e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:33:26.327668 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf3363e-a562-48ae-a4ae-4a35216fa7e2 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:33:26.333420 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:33:26.339760 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1337/2678] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:33:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:33:26.343547 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2510e3d5-782d-4974-81bd-36109d9f80b0 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:33:26.353594 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2510e3d5-782d-4974-81bd-36109d9f80b0 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:33:26.358339 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc075d18-5ad5-47a1-a8d6-659a95771ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:33:26.359102 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc075d18-5ad5-47a1-a8d6-659a95771ef5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:26.359411 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc075d18-5ad5-47a1-a8d6-659a95771ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:26.359690 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc075d18-5ad5-47a1-a8d6-659a95771ef5 admin admin] PATH_INFO: `/v3/projects/039cb83335ce4d3687d6d461aa19237b/users/228cbe2926df497d82f612f80adb9df2/roles/604444e7ad0d437dbd1f5a6e02b761f5` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:26.374363 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc075d18-5ad5-47a1-a8d6-659a95771ef5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=039cb83335ce4d3687d6d461aa19237b, user_id=228cbe2926df497d82f612f80adb9df2, role_id=604444e7ad0d437dbd1f5a6e02b761f5)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:33:26.377056 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc075d18-5ad5-47a1-a8d6-659a95771ef5 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:33:26.390026 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1342/2679] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:33:26 2022] PUT /identity/v3/projects/039cb83335ce4d3687d6d461aa19237b/users/228cbe2926df497d82f612f80adb9df2/roles/604444e7ad0d437dbd1f5a6e02b761f5 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 22:33:26.402225 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0a609f-09d7-4553-919f-483c6357b3cd None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:26.402530 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0a609f-09d7-4553-919f-483c6357b3cd None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:26.402833 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0a609f-09d7-4553-919f-483c6357b3cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:26.430947 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-9d0a609f-09d7-4553-919f-483c6357b3cd None None] MFA Rules not processed for user `228cbe2926df497d82f612f80adb9df2`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:33:26.432162 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-9d0a609f-09d7-4553-919f-483c6357b3cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:33:26.496490 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1338/2680] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:33:26 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:33:26.500968 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc075d18-5ad5-47a1-a8d6-659a95771ef5 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:33:26.561643 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc075d18-5ad5-47a1-a8d6-659a95771ef5 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:33:26.567543 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae304435-a22b-4372-9439-1c25395effed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:33:26.568135 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae304435-a22b-4372-9439-1c25395effed admin admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:26.568439 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae304435-a22b-4372-9439-1c25395effed admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:26.568706 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae304435-a22b-4372-9439-1c25395effed admin admin] PATH_INFO: `/v3/projects` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:26.569341 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae304435-a22b-4372-9439-1c25395effed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:33:26.571246 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae304435-a22b-4372-9439-1c25395effed admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:33:26.598036 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1343/2681] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 20 22:33:26 2022] POST /identity/v3/projects => generated 367 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:33:26.602085 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0a609f-09d7-4553-919f-483c6357b3cd None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:33:26.612846 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0a609f-09d7-4553-919f-483c6357b3cd None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:33:26.668779 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a1eb17-bfd2-47ac-b8c3-0971673f442f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:33:26.669393 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a1eb17-bfd2-47ac-b8c3-0971673f442f admin admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:26.669674 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a1eb17-bfd2-47ac-b8c3-0971673f442f admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:26.669999 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a1eb17-bfd2-47ac-b8c3-0971673f442f admin admin] PATH_INFO: `/v3/users` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:26.670768 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a1eb17-bfd2-47ac-b8c3-0971673f442f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:33:26.672711 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a1eb17-bfd2-47ac-b8c3-0971673f442f admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:33:26.693795 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1339/2682] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 20 22:33:26 2022] POST /identity/v3/users => generated 290 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:33:26.697892 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae304435-a22b-4372-9439-1c25395effed admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:33:26.708315 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae304435-a22b-4372-9439-1c25395effed admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:33:26.712976 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f55e23-9489-4e2f-8186-aa21fefe6c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:33:26.713577 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f55e23-9489-4e2f-8186-aa21fefe6c58 admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:26.713859 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f55e23-9489-4e2f-8186-aa21fefe6c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:26.714136 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f55e23-9489-4e2f-8186-aa21fefe6c58 admin admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:26.714822 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f55e23-9489-4e2f-8186-aa21fefe6c58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:33:26.716413 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f55e23-9489-4e2f-8186-aa21fefe6c58 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:33:26.727977 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1344/2683] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:33:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:33:26.731892 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a1eb17-bfd2-47ac-b8c3-0971673f442f admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:33:26.742149 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a1eb17-bfd2-47ac-b8c3-0971673f442f admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:33:26.747009 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea573508-e9be-4476-8fba-652d49ec9674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:33:26.747596 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea573508-e9be-4476-8fba-652d49ec9674 admin admin] REQUEST_METHOD: `PUT` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:26.747877 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea573508-e9be-4476-8fba-652d49ec9674 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:26.748149 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea573508-e9be-4476-8fba-652d49ec9674 admin admin] PATH_INFO: `/v3/projects/e3efeef1253347f8a1d42ca9a99b76dd/users/92d5aa4ccfc74ba2ada02d3bb3ccdd3d/roles/8a829170b29d42d6af589399e51edb0f` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:26.764460 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea573508-e9be-4476-8fba-652d49ec9674 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3efeef1253347f8a1d42ca9a99b76dd, user_id=92d5aa4ccfc74ba2ada02d3bb3ccdd3d, role_id=8a829170b29d42d6af589399e51edb0f)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:33:26.767122 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea573508-e9be-4476-8fba-652d49ec9674 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:33:26.780000 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1340/2684] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:33:26 2022] PUT /identity/v3/projects/e3efeef1253347f8a1d42ca9a99b76dd/users/92d5aa4ccfc74ba2ada02d3bb3ccdd3d/roles/8a829170b29d42d6af589399e51edb0f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:33:26.784288 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f55e23-9489-4e2f-8186-aa21fefe6c58 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:33:26.793903 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f55e23-9489-4e2f-8186-aa21fefe6c58 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:33:26.813517 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:33:26.853701 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88995bac-6c03-4358-81ed-7ac98b7f5f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:33:26.854329 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88995bac-6c03-4358-81ed-7ac98b7f5f88 admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:26.854587 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88995bac-6c03-4358-81ed-7ac98b7f5f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:26.854859 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88995bac-6c03-4358-81ed-7ac98b7f5f88 admin admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:26.855491 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88995bac-6c03-4358-81ed-7ac98b7f5f88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:33:26.857063 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88995bac-6c03-4358-81ed-7ac98b7f5f88 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:33:26.867435 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1345/2685] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:33:26 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 20 22:33:26.871862 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea573508-e9be-4476-8fba-652d49ec9674 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:33:26.882778 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea573508-e9be-4476-8fba-652d49ec9674 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:33:26.887322 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04cadb4-9f25-4703-ac2a-a25ae781f5d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:33:26.887953 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04cadb4-9f25-4703-ac2a-a25ae781f5d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:26.888227 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04cadb4-9f25-4703-ac2a-a25ae781f5d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:26.888496 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04cadb4-9f25-4703-ac2a-a25ae781f5d9 admin admin] PATH_INFO: `/v3/projects/e3efeef1253347f8a1d42ca9a99b76dd/users/92d5aa4ccfc74ba2ada02d3bb3ccdd3d/roles/8a829170b29d42d6af589399e51edb0f` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:26.890374 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04cadb4-9f25-4703-ac2a-a25ae781f5d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3efeef1253347f8a1d42ca9a99b76dd, user_id=92d5aa4ccfc74ba2ada02d3bb3ccdd3d, role_id=8a829170b29d42d6af589399e51edb0f)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:33:26.893007 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04cadb4-9f25-4703-ac2a-a25ae781f5d9 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:33:26.902794 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1341/2686] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:33:26 2022] PUT /identity/v3/projects/e3efeef1253347f8a1d42ca9a99b76dd/users/92d5aa4ccfc74ba2ada02d3bb3ccdd3d/roles/8a829170b29d42d6af589399e51edb0f => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:33:26.912907 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d24c595-5e67-4d0f-9de1-0acf0cbe4bba None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:26.913263 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d24c595-5e67-4d0f-9de1-0acf0cbe4bba None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:26.913625 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d24c595-5e67-4d0f-9de1-0acf0cbe4bba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:26.941885 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-8d24c595-5e67-4d0f-9de1-0acf0cbe4bba None None] MFA Rules not processed for user `92d5aa4ccfc74ba2ada02d3bb3ccdd3d`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:33:26.943125 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-8d24c595-5e67-4d0f-9de1-0acf0cbe4bba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:33:27.009392 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1346/2687] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:33:26 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:33:27.020652 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04cadb4-9f25-4703-ac2a-a25ae781f5d9 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:33:27.022335 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-f04cadb4-9f25-4703-ac2a-a25ae781f5d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:33:27.067929 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:33:27.079923 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04cadb4-9f25-4703-ac2a-a25ae781f5d9 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:33:27.083551 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7e7c71-d158-4dde-9f19-44e3f0bce103 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577c8b14c1f4279beac13b9ba11aba1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:33:27.084146 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7e7c71-d158-4dde-9f19-44e3f0bce103 service cinder] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:27.084449 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7e7c71-d158-4dde-9f19-44e3f0bce103 service cinder] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:27.084713 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7e7c71-d158-4dde-9f19-44e3f0bce103 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:27.094843 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7e7c71-d158-4dde-9f19-44e3f0bce103 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:33:27.096323 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7e7c71-d158-4dde-9f19-44e3f0bce103 service cinder] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:33:27.106169 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1342/2688] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:33:27 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:33:27.150571 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d24c595-5e67-4d0f-9de1-0acf0cbe4bba None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:33:27.151932 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-8d24c595-5e67-4d0f-9de1-0acf0cbe4bba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:33:27.165197 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d24c595-5e67-4d0f-9de1-0acf0cbe4bba None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:33:27.169250 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e2a4df-0ef2-4aad-ba13-2f1c05e3edc9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577c8b14c1f4279beac13b9ba11aba1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:33:27.169834 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e2a4df-0ef2-4aad-ba13-2f1c05e3edc9 service cinder] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:27.170117 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e2a4df-0ef2-4aad-ba13-2f1c05e3edc9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:27.170387 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e2a4df-0ef2-4aad-ba13-2f1c05e3edc9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:27.229156 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e2a4df-0ef2-4aad-ba13-2f1c05e3edc9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:33:27.230601 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e2a4df-0ef2-4aad-ba13-2f1c05e3edc9 service cinder] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:33:27.239912 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1347/2689] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:33:27 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:33:30.535992 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7e7c71-d158-4dde-9f19-44e3f0bce103 service cinder] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:33:30.597990 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7e7c71-d158-4dde-9f19-44e3f0bce103 service cinder] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:33:30.602415 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1725462f-38aa-4b70-99ce-f74f0bcbf865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:33:30.603060 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1725462f-38aa-4b70-99ce-f74f0bcbf865 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:30.603335 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1725462f-38aa-4b70-99ce-f74f0bcbf865 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:30.603618 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1725462f-38aa-4b70-99ce-f74f0bcbf865 admin admin] PATH_INFO: `/v3/users/228cbe2926df497d82f612f80adb9df2` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:30.604719 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1725462f-38aa-4b70-99ce-f74f0bcbf865 admin admin] RBAC: Authorizing `identity:delete_user(user_id=228cbe2926df497d82f612f80adb9df2)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:33:30.606649 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1725462f-38aa-4b70-99ce-f74f0bcbf865 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:33:30.651500 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-1725462f-38aa-4b70-99ce-f74f0bcbf865 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '228cbe2926df497d82f612f80adb9df2'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:33:30.658639 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-1725462f-38aa-4b70-99ce-f74f0bcbf865 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '228cbe2926df497d82f612f80adb9df2'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:33:30.659796 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-1725462f-38aa-4b70-99ce-f74f0bcbf865 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '228cbe2926df497d82f612f80adb9df2'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:33:30.660418 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-1725462f-38aa-4b70-99ce-f74f0bcbf865 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '228cbe2926df497d82f612f80adb9df2'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:33:30.667289 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-1725462f-38aa-4b70-99ce-f74f0bcbf865 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '228cbe2926df497d82f612f80adb9df2'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:33:30.684188 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1343/2690] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 20 22:33:30 2022] DELETE /identity/v3/users/228cbe2926df497d82f612f80adb9df2 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:33:30.688743 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8238d5-335a-4f97-8faf-5b671260e022 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:30.689232 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8238d5-335a-4f97-8faf-5b671260e022 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:30.689342 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8238d5-335a-4f97-8faf-5b671260e022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:30.709738 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-ea8238d5-335a-4f97-8faf-5b671260e022 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:33:30.710978 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-ea8238d5-335a-4f97-8faf-5b671260e022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:33:30.749541 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:33:30.767836 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1348/2691] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:33:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:33:30.778680 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1725462f-38aa-4b70-99ce-f74f0bcbf865 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:33:30.780110 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-1725462f-38aa-4b70-99ce-f74f0bcbf865 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:33:30.837167 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1725462f-38aa-4b70-99ce-f74f0bcbf865 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:33:30.840942 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2d1e5e-6824-47f6-874e-018b9a94909e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b0b3ca4ecd41aaba9cf8e0f91fbf54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:33:30.841538 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2d1e5e-6824-47f6-874e-018b9a94909e service neutron] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:30.841822 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2d1e5e-6824-47f6-874e-018b9a94909e service neutron] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:30.842096 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2d1e5e-6824-47f6-874e-018b9a94909e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:30.851423 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2d1e5e-6824-47f6-874e-018b9a94909e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:33:30.852859 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2d1e5e-6824-47f6-874e-018b9a94909e service neutron] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:33:30.862435 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1344/2692] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:33:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:33:31.124526 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8238d5-335a-4f97-8faf-5b671260e022 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:33:31.125995 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-ea8238d5-335a-4f97-8faf-5b671260e022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:33:31.140420 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8238d5-335a-4f97-8faf-5b671260e022 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:33:31.145815 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee91a74-88a9-4874-9604-d692f32d7946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:33:31.146464 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee91a74-88a9-4874-9604-d692f32d7946 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:31.146782 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee91a74-88a9-4874-9604-d692f32d7946 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:31.147049 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee91a74-88a9-4874-9604-d692f32d7946 admin admin] PATH_INFO: `/v3/projects/039cb83335ce4d3687d6d461aa19237b` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:31.148196 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee91a74-88a9-4874-9604-d692f32d7946 admin admin] RBAC: Authorizing `identity:delete_project(project_id=039cb83335ce4d3687d6d461aa19237b)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:33:31.150081 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee91a74-88a9-4874-9604-d692f32d7946 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:33:31.197136 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-bee91a74-88a9-4874-9604-d692f32d7946 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '039cb83335ce4d3687d6d461aa19237b', 'request_id': 'req-bee91a74-88a9-4874-9604-d692f32d7946'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:33:31.203222 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-bee91a74-88a9-4874-9604-d692f32d7946 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '039cb83335ce4d3687d6d461aa19237b', 'request_id': 'req-bee91a74-88a9-4874-9604-d692f32d7946'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:33:31.210741 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-bee91a74-88a9-4874-9604-d692f32d7946 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '039cb83335ce4d3687d6d461aa19237b', 'request_id': 'req-bee91a74-88a9-4874-9604-d692f32d7946'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:33:31.221166 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-bee91a74-88a9-4874-9604-d692f32d7946 admin admin] The token cache is being invalidate because project 039cb83335ce4d3687d6d461aa19237b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81306) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 22:33:31.221458 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-bee91a74-88a9-4874-9604-d692f32d7946 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:33:31.222082 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-bee91a74-88a9-4874-9604-d692f32d7946 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:33:31.223656 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1349/2693] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 20 22:33:31 2022] DELETE /identity/v3/projects/039cb83335ce4d3687d6d461aa19237b => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:33:31.227771 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2d1e5e-6824-47f6-874e-018b9a94909e service neutron] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:33:31.237914 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2d1e5e-6824-47f6-874e-018b9a94909e service neutron] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:33:31.241656 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:33:31.295820 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3579db80-2ceb-467b-9329-a7b5a2f8cd06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:33:31.296372 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3579db80-2ceb-467b-9329-a7b5a2f8cd06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:31.296658 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3579db80-2ceb-467b-9329-a7b5a2f8cd06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:31.296936 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3579db80-2ceb-467b-9329-a7b5a2f8cd06 admin admin] PATH_INFO: `/v3/users/92d5aa4ccfc74ba2ada02d3bb3ccdd3d` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:31.298071 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3579db80-2ceb-467b-9329-a7b5a2f8cd06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92d5aa4ccfc74ba2ada02d3bb3ccdd3d)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:33:31.300542 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3579db80-2ceb-467b-9329-a7b5a2f8cd06 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:33:31.345016 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-3579db80-2ceb-467b-9329-a7b5a2f8cd06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92d5aa4ccfc74ba2ada02d3bb3ccdd3d'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:33:31.352164 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-3579db80-2ceb-467b-9329-a7b5a2f8cd06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92d5aa4ccfc74ba2ada02d3bb3ccdd3d'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:33:31.352785 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-3579db80-2ceb-467b-9329-a7b5a2f8cd06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92d5aa4ccfc74ba2ada02d3bb3ccdd3d'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:33:31.353402 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-3579db80-2ceb-467b-9329-a7b5a2f8cd06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92d5aa4ccfc74ba2ada02d3bb3ccdd3d'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:33:31.360316 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-3579db80-2ceb-467b-9329-a7b5a2f8cd06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92d5aa4ccfc74ba2ada02d3bb3ccdd3d'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:33:31.377704 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1345/2694] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 20 22:33:31 2022] DELETE /identity/v3/users/92d5aa4ccfc74ba2ada02d3bb3ccdd3d => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:33:31.643312 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee91a74-88a9-4874-9604-d692f32d7946 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:33:31.644865 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-bee91a74-88a9-4874-9604-d692f32d7946 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:33:31.658440 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee91a74-88a9-4874-9604-d692f32d7946 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:33:31.717606 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0400af9c-83d2-4e8a-959e-97b99f1b546b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:33:31.718253 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0400af9c-83d2-4e8a-959e-97b99f1b546b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:31.718498 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0400af9c-83d2-4e8a-959e-97b99f1b546b admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:31.718799 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0400af9c-83d2-4e8a-959e-97b99f1b546b admin admin] PATH_INFO: `/v3/projects/e3efeef1253347f8a1d42ca9a99b76dd` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:31.719900 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0400af9c-83d2-4e8a-959e-97b99f1b546b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3efeef1253347f8a1d42ca9a99b76dd)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:33:31.722297 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0400af9c-83d2-4e8a-959e-97b99f1b546b admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:33:31.768316 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-0400af9c-83d2-4e8a-959e-97b99f1b546b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3efeef1253347f8a1d42ca9a99b76dd', 'request_id': 'req-0400af9c-83d2-4e8a-959e-97b99f1b546b'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:33:31.774249 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-0400af9c-83d2-4e8a-959e-97b99f1b546b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3efeef1253347f8a1d42ca9a99b76dd', 'request_id': 'req-0400af9c-83d2-4e8a-959e-97b99f1b546b'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:33:31.781913 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-0400af9c-83d2-4e8a-959e-97b99f1b546b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3efeef1253347f8a1d42ca9a99b76dd', 'request_id': 'req-0400af9c-83d2-4e8a-959e-97b99f1b546b'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:33:31.788825 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:33:31.794213 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-0400af9c-83d2-4e8a-959e-97b99f1b546b admin admin] The token cache is being invalidate because project e3efeef1253347f8a1d42ca9a99b76dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81306) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 22:33:31.794657 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-0400af9c-83d2-4e8a-959e-97b99f1b546b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:33:31.795414 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-0400af9c-83d2-4e8a-959e-97b99f1b546b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:33:31.797008 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1350/2695] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 20 22:33:31 2022] DELETE /identity/v3/projects/e3efeef1253347f8a1d42ca9a99b76dd => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:33:31.802815 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b9916-9cf8-4983-af10-7cdebc6fb02a None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:31.803275 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b9916-9cf8-4983-af10-7cdebc6fb02a None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:31.803375 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b9916-9cf8-4983-af10-7cdebc6fb02a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:31.823168 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-a94b9916-9cf8-4983-af10-7cdebc6fb02a None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:33:31.824361 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-a94b9916-9cf8-4983-af10-7cdebc6fb02a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:33:31.880815 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1346/2696] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:33:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:33:31.889845 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c594445-dbb7-4f22-b1f4-bc3715b40afc None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:31.890132 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c594445-dbb7-4f22-b1f4-bc3715b40afc None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:31.890408 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c594445-dbb7-4f22-b1f4-bc3715b40afc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:31.910679 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-0c594445-dbb7-4f22-b1f4-bc3715b40afc None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:33:31.912078 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-0c594445-dbb7-4f22-b1f4-bc3715b40afc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:33:31.920233 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1351/2697] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:33:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:33:31.924380 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94b9916-9cf8-4983-af10-7cdebc6fb02a None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:33:31.934376 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94b9916-9cf8-4983-af10-7cdebc6fb02a None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:33:31.938875 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0b1169-0c5a-47a5-9af5-5f2bc3194ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:33:31.939467 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0b1169-0c5a-47a5-9af5-5f2bc3194ad6 admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:31.939742 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0b1169-0c5a-47a5-9af5-5f2bc3194ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:31.940010 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0b1169-0c5a-47a5-9af5-5f2bc3194ad6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:31.940690 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0b1169-0c5a-47a5-9af5-5f2bc3194ad6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:33:31.940987 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0b1169-0c5a-47a5-9af5-5f2bc3194ad6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:33:31.942580 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0b1169-0c5a-47a5-9af5-5f2bc3194ad6 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:33:31.953657 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1347/2698] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 20 22:33:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:33:31.958247 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c594445-dbb7-4f22-b1f4-bc3715b40afc None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:33:31.967319 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c594445-dbb7-4f22-b1f4-bc3715b40afc None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:33:31.972464 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca3faed-2cf1-4758-9840-1f53bfa41f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:33:31.973052 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca3faed-2cf1-4758-9840-1f53bfa41f3a admin admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:31.973328 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca3faed-2cf1-4758-9840-1f53bfa41f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:31.973598 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca3faed-2cf1-4758-9840-1f53bfa41f3a admin admin] PATH_INFO: `/v3/projects` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:31.974259 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca3faed-2cf1-4758-9840-1f53bfa41f3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:33:31.976180 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca3faed-2cf1-4758-9840-1f53bfa41f3a admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:33:32.002386 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1352/2699] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 20 22:33:31 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 20 22:33:32.006476 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0b1169-0c5a-47a5-9af5-5f2bc3194ad6 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:33:32.016319 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0b1169-0c5a-47a5-9af5-5f2bc3194ad6 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:33:32.025549 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:33:32.073034 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19981482-05d9-4cb4-9662-ebab81c0d228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:33:32.073565 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19981482-05d9-4cb4-9662-ebab81c0d228 admin admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:32.073868 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19981482-05d9-4cb4-9662-ebab81c0d228 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:32.074137 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19981482-05d9-4cb4-9662-ebab81c0d228 admin admin] PATH_INFO: `/v3/users` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:32.074796 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19981482-05d9-4cb4-9662-ebab81c0d228 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:33:32.076698 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19981482-05d9-4cb4-9662-ebab81c0d228 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:33:32.098587 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1348/2700] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 20 22:33:32 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 20 22:33:32.102761 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca3faed-2cf1-4758-9840-1f53bfa41f3a admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:33:32.112846 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca3faed-2cf1-4758-9840-1f53bfa41f3a admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:33:32.117433 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085380d6-9f58-4ba1-a9a3-09fc43454d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:33:32.118030 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085380d6-9f58-4ba1-a9a3-09fc43454d47 admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:32.118311 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085380d6-9f58-4ba1-a9a3-09fc43454d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:32.118675 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085380d6-9f58-4ba1-a9a3-09fc43454d47 admin admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:32.119315 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085380d6-9f58-4ba1-a9a3-09fc43454d47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:33:32.120886 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085380d6-9f58-4ba1-a9a3-09fc43454d47 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:33:32.130566 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1353/2701] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:33:32 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 20 22:33:32.134259 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19981482-05d9-4cb4-9662-ebab81c0d228 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:33:32.144484 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19981482-05d9-4cb4-9662-ebab81c0d228 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:33:32.148959 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4ea5e1-9870-44b4-932a-fdef5aad22bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:33:32.149542 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4ea5e1-9870-44b4-932a-fdef5aad22bc admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:32.149820 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4ea5e1-9870-44b4-932a-fdef5aad22bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:32.150089 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4ea5e1-9870-44b4-932a-fdef5aad22bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:32.150741 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4ea5e1-9870-44b4-932a-fdef5aad22bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:33:32.152333 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4ea5e1-9870-44b4-932a-fdef5aad22bc admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:33:32.163501 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1349/2702] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:33:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:33:32.167482 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085380d6-9f58-4ba1-a9a3-09fc43454d47 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:33:32.177189 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085380d6-9f58-4ba1-a9a3-09fc43454d47 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:33:32.182148 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983da97c-83f2-4446-845f-f2ffe67119be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:33:32.182839 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983da97c-83f2-4446-845f-f2ffe67119be admin admin] REQUEST_METHOD: `PUT` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:32.183137 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983da97c-83f2-4446-845f-f2ffe67119be admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:32.183395 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983da97c-83f2-4446-845f-f2ffe67119be admin admin] PATH_INFO: `/v3/projects/d234fbcf9c7d47029431dfa0ce816107/users/c6398624286a49e98421df7fbf58fd65/roles/604444e7ad0d437dbd1f5a6e02b761f5` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:32.198903 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983da97c-83f2-4446-845f-f2ffe67119be admin admin] RBAC: Authorizing `identity:create_grant(project_id=d234fbcf9c7d47029431dfa0ce816107, user_id=c6398624286a49e98421df7fbf58fd65, role_id=604444e7ad0d437dbd1f5a6e02b761f5)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:33:32.201539 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983da97c-83f2-4446-845f-f2ffe67119be admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:33:32.214586 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1354/2703] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:33:32 2022] PUT /identity/v3/projects/d234fbcf9c7d47029431dfa0ce816107/users/c6398624286a49e98421df7fbf58fd65/roles/604444e7ad0d437dbd1f5a6e02b761f5 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 22:33:32.225301 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49197a9b-0315-4e25-afe6-138fd46eab4a None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:32.225603 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49197a9b-0315-4e25-afe6-138fd46eab4a None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:32.225873 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49197a9b-0315-4e25-afe6-138fd46eab4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:32.253361 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-49197a9b-0315-4e25-afe6-138fd46eab4a None None] MFA Rules not processed for user `c6398624286a49e98421df7fbf58fd65`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:33:32.254584 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-49197a9b-0315-4e25-afe6-138fd46eab4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:33:32.318055 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1350/2704] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:33:32 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:33:32.322700 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983da97c-83f2-4446-845f-f2ffe67119be admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:33:32.383427 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983da97c-83f2-4446-845f-f2ffe67119be admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:33:32.388000 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aa4e78-6692-406e-b459-02233c1b3cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:33:32.388597 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aa4e78-6692-406e-b459-02233c1b3cbd admin admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:32.388875 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aa4e78-6692-406e-b459-02233c1b3cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:32.389148 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aa4e78-6692-406e-b459-02233c1b3cbd admin admin] PATH_INFO: `/v3/projects` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:32.389774 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aa4e78-6692-406e-b459-02233c1b3cbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:33:32.391684 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aa4e78-6692-406e-b459-02233c1b3cbd admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:33:32.418284 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1355/2705] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 20 22:33:32 2022] POST /identity/v3/projects => generated 385 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:33:32.422379 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49197a9b-0315-4e25-afe6-138fd46eab4a None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:33:32.433115 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49197a9b-0315-4e25-afe6-138fd46eab4a None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:33:32.489207 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dee7a9b-bce5-4898-9021-f01403a3f001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:33:32.489813 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dee7a9b-bce5-4898-9021-f01403a3f001 admin admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:32.490092 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dee7a9b-bce5-4898-9021-f01403a3f001 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:32.490365 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dee7a9b-bce5-4898-9021-f01403a3f001 admin admin] PATH_INFO: `/v3/users` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:32.491025 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dee7a9b-bce5-4898-9021-f01403a3f001 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:33:32.492941 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dee7a9b-bce5-4898-9021-f01403a3f001 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:33:32.513898 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1351/2706] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 20 22:33:32 2022] POST /identity/v3/users => generated 299 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:33:32.517985 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aa4e78-6692-406e-b459-02233c1b3cbd admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:33:32.528630 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aa4e78-6692-406e-b459-02233c1b3cbd admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:33:32.533499 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bc1f81-1d56-46f1-a80d-583ff56a2118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:33:32.534112 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bc1f81-1d56-46f1-a80d-583ff56a2118 admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:32.534390 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bc1f81-1d56-46f1-a80d-583ff56a2118 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:32.534759 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bc1f81-1d56-46f1-a80d-583ff56a2118 admin admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:32.535388 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bc1f81-1d56-46f1-a80d-583ff56a2118 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:33:32.536970 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bc1f81-1d56-46f1-a80d-583ff56a2118 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:33:32.547244 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1356/2707] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:33:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:33:32.551152 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dee7a9b-bce5-4898-9021-f01403a3f001 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:33:32.561048 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dee7a9b-bce5-4898-9021-f01403a3f001 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:33:32.566272 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0212451-23e7-46d9-bc1b-f3726c899ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:33:32.566956 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0212451-23e7-46d9-bc1b-f3726c899ad2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:32.567239 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0212451-23e7-46d9-bc1b-f3726c899ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:32.567517 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0212451-23e7-46d9-bc1b-f3726c899ad2 admin admin] PATH_INFO: `/v3/projects/969991bf8c6a4c1a801fb803f0241316/users/3c7d4b7cb0a942a0a67012236a48d36c/roles/8a829170b29d42d6af589399e51edb0f` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:32.576298 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:33:32.584822 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0212451-23e7-46d9-bc1b-f3726c899ad2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=969991bf8c6a4c1a801fb803f0241316, user_id=3c7d4b7cb0a942a0a67012236a48d36c, role_id=8a829170b29d42d6af589399e51edb0f)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:33:32.587570 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0212451-23e7-46d9-bc1b-f3726c899ad2 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:33:32.599836 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1352/2708] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:33:32 2022] PUT /identity/v3/projects/969991bf8c6a4c1a801fb803f0241316/users/3c7d4b7cb0a942a0a67012236a48d36c/roles/8a829170b29d42d6af589399e51edb0f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:33:32.603704 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bc1f81-1d56-46f1-a80d-583ff56a2118 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:33:32.613452 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bc1f81-1d56-46f1-a80d-583ff56a2118 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:33:32.668343 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7486cd72-edd2-462d-8e87-a47283cf4336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:33:32.668872 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7486cd72-edd2-462d-8e87-a47283cf4336 admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:32.669149 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7486cd72-edd2-462d-8e87-a47283cf4336 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:32.669417 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7486cd72-edd2-462d-8e87-a47283cf4336 admin admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:32.670063 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7486cd72-edd2-462d-8e87-a47283cf4336 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:33:32.671695 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7486cd72-edd2-462d-8e87-a47283cf4336 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:33:32.681669 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1357/2709] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:33:32 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:33:32.685907 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0212451-23e7-46d9-bc1b-f3726c899ad2 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:33:32.697035 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0212451-23e7-46d9-bc1b-f3726c899ad2 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:33:32.701893 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945dbaa7-fe1d-4d7a-96c4-06e1d21956c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:33:32.702610 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945dbaa7-fe1d-4d7a-96c4-06e1d21956c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:32.702889 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945dbaa7-fe1d-4d7a-96c4-06e1d21956c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:32.703159 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945dbaa7-fe1d-4d7a-96c4-06e1d21956c1 admin admin] PATH_INFO: `/v3/projects/969991bf8c6a4c1a801fb803f0241316/users/3c7d4b7cb0a942a0a67012236a48d36c/roles/8a829170b29d42d6af589399e51edb0f` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:32.705075 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945dbaa7-fe1d-4d7a-96c4-06e1d21956c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=969991bf8c6a4c1a801fb803f0241316, user_id=3c7d4b7cb0a942a0a67012236a48d36c, role_id=8a829170b29d42d6af589399e51edb0f)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:33:32.707768 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945dbaa7-fe1d-4d7a-96c4-06e1d21956c1 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:33:32.717956 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1353/2710] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:33:32 2022] PUT /identity/v3/projects/969991bf8c6a4c1a801fb803f0241316/users/3c7d4b7cb0a942a0a67012236a48d36c/roles/8a829170b29d42d6af589399e51edb0f => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 22:33:32.728093 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812dc546-20d3-4d2d-a505-214e4ea1fdd3 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:32.728564 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812dc546-20d3-4d2d-a505-214e4ea1fdd3 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:32.728672 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812dc546-20d3-4d2d-a505-214e4ea1fdd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:32.736898 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:33:32.758287 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-812dc546-20d3-4d2d-a505-214e4ea1fdd3 None None] MFA Rules not processed for user `3c7d4b7cb0a942a0a67012236a48d36c`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:33:32.759531 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-812dc546-20d3-4d2d-a505-214e4ea1fdd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:33:32.825379 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1358/2711] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:33:32 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 22:33:32.836748 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945dbaa7-fe1d-4d7a-96c4-06e1d21956c1 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:33:32.838531 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-945dbaa7-fe1d-4d7a-96c4-06e1d21956c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:33:32.895378 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945dbaa7-fe1d-4d7a-96c4-06e1d21956c1 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:33:32.899005 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26121301-9642-441a-9a2e-541d74e99e52 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577c8b14c1f4279beac13b9ba11aba1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:33:32.899600 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26121301-9642-441a-9a2e-541d74e99e52 service cinder] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:32.899876 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26121301-9642-441a-9a2e-541d74e99e52 service cinder] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:32.900147 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26121301-9642-441a-9a2e-541d74e99e52 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:32.909199 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26121301-9642-441a-9a2e-541d74e99e52 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:33:32.910641 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26121301-9642-441a-9a2e-541d74e99e52 service cinder] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:33:32.919965 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1354/2712] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:33:32 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:33:32.985359 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812dc546-20d3-4d2d-a505-214e4ea1fdd3 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:33:33.046769 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812dc546-20d3-4d2d-a505-214e4ea1fdd3 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:33:33.051877 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739433fe-a278-42d8-8bf5-2cb7c61d5e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:33:33.052493 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739433fe-a278-42d8-8bf5-2cb7c61d5e18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:33.052769 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739433fe-a278-42d8-8bf5-2cb7c61d5e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:33.053040 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739433fe-a278-42d8-8bf5-2cb7c61d5e18 admin admin] PATH_INFO: `/v3/users/c6398624286a49e98421df7fbf58fd65` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:33.054150 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739433fe-a278-42d8-8bf5-2cb7c61d5e18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6398624286a49e98421df7fbf58fd65)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:33:33.056069 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739433fe-a278-42d8-8bf5-2cb7c61d5e18 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:33:33.101444 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-739433fe-a278-42d8-8bf5-2cb7c61d5e18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6398624286a49e98421df7fbf58fd65'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:33:33.108782 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-739433fe-a278-42d8-8bf5-2cb7c61d5e18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6398624286a49e98421df7fbf58fd65'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:33:33.109430 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-739433fe-a278-42d8-8bf5-2cb7c61d5e18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6398624286a49e98421df7fbf58fd65'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:33:33.110030 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-739433fe-a278-42d8-8bf5-2cb7c61d5e18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6398624286a49e98421df7fbf58fd65'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:33:33.118332 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-739433fe-a278-42d8-8bf5-2cb7c61d5e18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6398624286a49e98421df7fbf58fd65'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:33:33.135328 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1359/2713] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 20 22:33:32 2022] DELETE /identity/v3/users/c6398624286a49e98421df7fbf58fd65 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:33:33.139744 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456609ee-0139-43ad-8326-9b89178b97ac None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:33.140031 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456609ee-0139-43ad-8326-9b89178b97ac None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:33.140308 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456609ee-0139-43ad-8326-9b89178b97ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:33.159544 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-456609ee-0139-43ad-8326-9b89178b97ac None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:33:33.160738 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-456609ee-0139-43ad-8326-9b89178b97ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:33:33.217117 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1355/2714] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:33:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:33:33.227137 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739433fe-a278-42d8-8bf5-2cb7c61d5e18 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:33:33.228542 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-739433fe-a278-42d8-8bf5-2cb7c61d5e18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:33:33.239897 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:33:33.288116 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739433fe-a278-42d8-8bf5-2cb7c61d5e18 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:33:33.291976 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab43d398-78e5-48d8-b17c-a0a35df5bb49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b0b3ca4ecd41aaba9cf8e0f91fbf54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:33:33.292587 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab43d398-78e5-48d8-b17c-a0a35df5bb49 service neutron] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:33.292867 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab43d398-78e5-48d8-b17c-a0a35df5bb49 service neutron] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:33.293140 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab43d398-78e5-48d8-b17c-a0a35df5bb49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:33.303105 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab43d398-78e5-48d8-b17c-a0a35df5bb49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:33:33.304521 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab43d398-78e5-48d8-b17c-a0a35df5bb49 service neutron] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:33:33.313943 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1360/2715] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:33:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:33:33.574830 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456609ee-0139-43ad-8326-9b89178b97ac None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:33:33.576356 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-456609ee-0139-43ad-8326-9b89178b97ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:33:33.589338 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456609ee-0139-43ad-8326-9b89178b97ac None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:33:33.594068 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cdcb16-fe8c-4f19-b4af-08ca80902d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:33:33.594797 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cdcb16-fe8c-4f19-b4af-08ca80902d27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:33.595141 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cdcb16-fe8c-4f19-b4af-08ca80902d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:33.595472 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cdcb16-fe8c-4f19-b4af-08ca80902d27 admin admin] PATH_INFO: `/v3/projects/d234fbcf9c7d47029431dfa0ce816107` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:33.597315 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cdcb16-fe8c-4f19-b4af-08ca80902d27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d234fbcf9c7d47029431dfa0ce816107)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:33:33.599725 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cdcb16-fe8c-4f19-b4af-08ca80902d27 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:33:33.646223 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-73cdcb16-fe8c-4f19-b4af-08ca80902d27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd234fbcf9c7d47029431dfa0ce816107', 'request_id': 'req-73cdcb16-fe8c-4f19-b4af-08ca80902d27'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:33:33.652333 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-73cdcb16-fe8c-4f19-b4af-08ca80902d27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd234fbcf9c7d47029431dfa0ce816107', 'request_id': 'req-73cdcb16-fe8c-4f19-b4af-08ca80902d27'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:33:33.661073 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-73cdcb16-fe8c-4f19-b4af-08ca80902d27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd234fbcf9c7d47029431dfa0ce816107', 'request_id': 'req-73cdcb16-fe8c-4f19-b4af-08ca80902d27'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:33:33.668158 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:33:33.672338 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-73cdcb16-fe8c-4f19-b4af-08ca80902d27 admin admin] The token cache is being invalidate because project d234fbcf9c7d47029431dfa0ce816107 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81307) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 22:33:33.672703 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-73cdcb16-fe8c-4f19-b4af-08ca80902d27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:33:33.673739 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-73cdcb16-fe8c-4f19-b4af-08ca80902d27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:33:33.675451 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1356/2716] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 20 22:33:33 2022] DELETE /identity/v3/projects/d234fbcf9c7d47029431dfa0ce816107 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:33:33.679539 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab43d398-78e5-48d8-b17c-a0a35df5bb49 service neutron] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:33:33.689243 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab43d398-78e5-48d8-b17c-a0a35df5bb49 service neutron] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:33:33.747347 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8839b8ec-a653-4806-ac7b-2b7c11c0c6d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:33:33.747981 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8839b8ec-a653-4806-ac7b-2b7c11c0c6d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:33.748244 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8839b8ec-a653-4806-ac7b-2b7c11c0c6d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:33.748517 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8839b8ec-a653-4806-ac7b-2b7c11c0c6d5 admin admin] PATH_INFO: `/v3/users/3c7d4b7cb0a942a0a67012236a48d36c` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:33.749632 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8839b8ec-a653-4806-ac7b-2b7c11c0c6d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c7d4b7cb0a942a0a67012236a48d36c)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:33:33.751822 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8839b8ec-a653-4806-ac7b-2b7c11c0c6d5 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:33:33.796388 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-8839b8ec-a653-4806-ac7b-2b7c11c0c6d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c7d4b7cb0a942a0a67012236a48d36c'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:33:33.803593 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-8839b8ec-a653-4806-ac7b-2b7c11c0c6d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c7d4b7cb0a942a0a67012236a48d36c'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:33:33.804223 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-8839b8ec-a653-4806-ac7b-2b7c11c0c6d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c7d4b7cb0a942a0a67012236a48d36c'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:33:33.804820 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-8839b8ec-a653-4806-ac7b-2b7c11c0c6d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c7d4b7cb0a942a0a67012236a48d36c'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:33:33.811709 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-8839b8ec-a653-4806-ac7b-2b7c11c0c6d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c7d4b7cb0a942a0a67012236a48d36c'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:33:33.828824 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1361/2717] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 20 22:33:33 2022] DELETE /identity/v3/users/3c7d4b7cb0a942a0a67012236a48d36c => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:33:34.103476 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cdcb16-fe8c-4f19-b4af-08ca80902d27 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:33:34.104903 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-73cdcb16-fe8c-4f19-b4af-08ca80902d27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:33:34.118148 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cdcb16-fe8c-4f19-b4af-08ca80902d27 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:33:34.176467 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7d72fc-21fc-48a2-82e8-4c8ffe130536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:33:34.177104 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7d72fc-21fc-48a2-82e8-4c8ffe130536 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:34.177388 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7d72fc-21fc-48a2-82e8-4c8ffe130536 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:34.177664 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7d72fc-21fc-48a2-82e8-4c8ffe130536 admin admin] PATH_INFO: `/v3/projects/969991bf8c6a4c1a801fb803f0241316` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:34.178844 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7d72fc-21fc-48a2-82e8-4c8ffe130536 admin admin] RBAC: Authorizing `identity:delete_project(project_id=969991bf8c6a4c1a801fb803f0241316)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:33:34.180752 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7d72fc-21fc-48a2-82e8-4c8ffe130536 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:33:34.227039 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-aa7d72fc-21fc-48a2-82e8-4c8ffe130536 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '969991bf8c6a4c1a801fb803f0241316', 'request_id': 'req-aa7d72fc-21fc-48a2-82e8-4c8ffe130536'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:33:34.233098 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-aa7d72fc-21fc-48a2-82e8-4c8ffe130536 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '969991bf8c6a4c1a801fb803f0241316', 'request_id': 'req-aa7d72fc-21fc-48a2-82e8-4c8ffe130536'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:33:34.242046 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-aa7d72fc-21fc-48a2-82e8-4c8ffe130536 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '969991bf8c6a4c1a801fb803f0241316', 'request_id': 'req-aa7d72fc-21fc-48a2-82e8-4c8ffe130536'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:33:34.257286 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-aa7d72fc-21fc-48a2-82e8-4c8ffe130536 admin admin] The token cache is being invalidate because project 969991bf8c6a4c1a801fb803f0241316 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81307) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 22:33:34.257568 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-aa7d72fc-21fc-48a2-82e8-4c8ffe130536 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:33:34.258198 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-aa7d72fc-21fc-48a2-82e8-4c8ffe130536 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:33:34.259681 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1357/2718] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 20 22:33:34 2022] DELETE /identity/v3/projects/969991bf8c6a4c1a801fb803f0241316 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:33:34.265458 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106b9928-cb22-4e44-ba55-a610cd78d7a1 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:34.265744 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106b9928-cb22-4e44-ba55-a610cd78d7a1 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:34.266020 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106b9928-cb22-4e44-ba55-a610cd78d7a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:34.286496 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-106b9928-cb22-4e44-ba55-a610cd78d7a1 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:33:34.287651 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-106b9928-cb22-4e44-ba55-a610cd78d7a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:33:34.314456 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:33:34.354308 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1362/2719] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:33:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:33:34.363766 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed53b5a0-54dc-4800-85d5-23d7f2b6b589 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:34.364052 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed53b5a0-54dc-4800-85d5-23d7f2b6b589 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:34.364328 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed53b5a0-54dc-4800-85d5-23d7f2b6b589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:34.385355 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-ed53b5a0-54dc-4800-85d5-23d7f2b6b589 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:33:34.387369 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-ed53b5a0-54dc-4800-85d5-23d7f2b6b589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:33:34.395604 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1358/2720] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:33:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:33:34.400279 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106b9928-cb22-4e44-ba55-a610cd78d7a1 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:33:34.410353 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106b9928-cb22-4e44-ba55-a610cd78d7a1 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:33:34.414930 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac4729e-b7f3-4de9-bf10-52a7a8c52c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:33:34.415533 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac4729e-b7f3-4de9-bf10-52a7a8c52c1b admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:34.415813 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac4729e-b7f3-4de9-bf10-52a7a8c52c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:34.416084 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac4729e-b7f3-4de9-bf10-52a7a8c52c1b admin admin] PATH_INFO: `/v3/domains` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:34.416727 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac4729e-b7f3-4de9-bf10-52a7a8c52c1b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:33:34.417030 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac4729e-b7f3-4de9-bf10-52a7a8c52c1b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:33:34.418641 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac4729e-b7f3-4de9-bf10-52a7a8c52c1b admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:33:34.430663 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1363/2721] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 20 22:33:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:33:34.435011 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed53b5a0-54dc-4800-85d5-23d7f2b6b589 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:33:34.445050 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed53b5a0-54dc-4800-85d5-23d7f2b6b589 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:33:34.449737 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6bca0f-43cc-4045-9029-999059b38ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:33:34.450328 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6bca0f-43cc-4045-9029-999059b38ccc admin admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:34.450632 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6bca0f-43cc-4045-9029-999059b38ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:34.450903 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6bca0f-43cc-4045-9029-999059b38ccc admin admin] PATH_INFO: `/v3/projects` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:34.451643 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6bca0f-43cc-4045-9029-999059b38ccc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:33:34.453646 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6bca0f-43cc-4045-9029-999059b38ccc admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:33:34.481709 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1359/2722] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 20 22:33:34 2022] POST /identity/v3/projects => generated 381 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:33:34.486093 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac4729e-b7f3-4de9-bf10-52a7a8c52c1b admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:33:34.496518 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac4729e-b7f3-4de9-bf10-52a7a8c52c1b admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:33:34.553100 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763f9ebb-ba44-4a92-8964-6b05c9b3229d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:33:34.553618 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f9ebb-ba44-4a92-8964-6b05c9b3229d admin admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:34.553896 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f9ebb-ba44-4a92-8964-6b05c9b3229d admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:34.554168 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f9ebb-ba44-4a92-8964-6b05c9b3229d admin admin] PATH_INFO: `/v3/users` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:34.554848 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763f9ebb-ba44-4a92-8964-6b05c9b3229d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:33:34.556833 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763f9ebb-ba44-4a92-8964-6b05c9b3229d admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:33:34.578096 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1364/2723] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 20 22:33:34 2022] POST /identity/v3/users => generated 291 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:33:34.582367 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6bca0f-43cc-4045-9029-999059b38ccc admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:33:34.593184 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6bca0f-43cc-4045-9029-999059b38ccc admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:33:34.598362 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540d9305-f802-4ac3-8b07-fd877b72165e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:33:34.598997 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540d9305-f802-4ac3-8b07-fd877b72165e admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:34.599272 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540d9305-f802-4ac3-8b07-fd877b72165e admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:34.599538 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540d9305-f802-4ac3-8b07-fd877b72165e admin admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:34.600203 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540d9305-f802-4ac3-8b07-fd877b72165e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:33:34.601789 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540d9305-f802-4ac3-8b07-fd877b72165e admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:33:34.612836 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1360/2724] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:33:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:33:34.616985 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763f9ebb-ba44-4a92-8964-6b05c9b3229d admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:33:34.627197 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763f9ebb-ba44-4a92-8964-6b05c9b3229d admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:33:34.631885 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dc5d1a-6ff3-4ba6-8c6d-818a0611a1d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:33:34.632479 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dc5d1a-6ff3-4ba6-8c6d-818a0611a1d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:34.632755 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dc5d1a-6ff3-4ba6-8c6d-818a0611a1d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:34.633021 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dc5d1a-6ff3-4ba6-8c6d-818a0611a1d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:34.633657 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dc5d1a-6ff3-4ba6-8c6d-818a0611a1d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:33:34.635267 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dc5d1a-6ff3-4ba6-8c6d-818a0611a1d6 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:33:34.645973 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1365/2725] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:33:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:33:34.650601 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540d9305-f802-4ac3-8b07-fd877b72165e admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:33:34.661272 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540d9305-f802-4ac3-8b07-fd877b72165e admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:33:34.665843 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16fa10b-9126-45f5-bb27-3399ac93b3ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:33:34.666485 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16fa10b-9126-45f5-bb27-3399ac93b3ae admin admin] REQUEST_METHOD: `PUT` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:34.666797 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16fa10b-9126-45f5-bb27-3399ac93b3ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:34.667069 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16fa10b-9126-45f5-bb27-3399ac93b3ae admin admin] PATH_INFO: `/v3/projects/9f8d4b40eaac4dd69e102b17bfbc3e32/users/d33c376af14348e3947aac9b0a425156/roles/604444e7ad0d437dbd1f5a6e02b761f5` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:34.683484 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16fa10b-9126-45f5-bb27-3399ac93b3ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f8d4b40eaac4dd69e102b17bfbc3e32, user_id=d33c376af14348e3947aac9b0a425156, role_id=604444e7ad0d437dbd1f5a6e02b761f5)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:33:34.686114 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16fa10b-9126-45f5-bb27-3399ac93b3ae admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:33:34.699905 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1361/2726] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:33:34 2022] PUT /identity/v3/projects/9f8d4b40eaac4dd69e102b17bfbc3e32/users/d33c376af14348e3947aac9b0a425156/roles/604444e7ad0d437dbd1f5a6e02b761f5 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:33:34.710036 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa3a5e6-3f4c-4117-bce4-f1eef8a318ac None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:34.710411 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa3a5e6-3f4c-4117-bce4-f1eef8a318ac None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:34.710710 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa3a5e6-3f4c-4117-bce4-f1eef8a318ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:34.739197 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-dfa3a5e6-3f4c-4117-bce4-f1eef8a318ac None None] MFA Rules not processed for user `d33c376af14348e3947aac9b0a425156`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:33:34.740405 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-dfa3a5e6-3f4c-4117-bce4-f1eef8a318ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:33:34.805937 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1366/2727] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:33:34 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:33:34.810931 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16fa10b-9126-45f5-bb27-3399ac93b3ae admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:33:34.841178 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:33:34.875893 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16fa10b-9126-45f5-bb27-3399ac93b3ae admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:33:34.880602 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274b5753-cccc-4110-b716-a63d359a412e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:33:34.881205 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274b5753-cccc-4110-b716-a63d359a412e admin admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:34.881484 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274b5753-cccc-4110-b716-a63d359a412e admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:34.881756 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274b5753-cccc-4110-b716-a63d359a412e admin admin] PATH_INFO: `/v3/projects` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:34.882381 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274b5753-cccc-4110-b716-a63d359a412e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:33:34.884311 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274b5753-cccc-4110-b716-a63d359a412e admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:33:34.911329 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1362/2728] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 20 22:33:34 2022] POST /identity/v3/projects => generated 381 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:33:34.915439 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa3a5e6-3f4c-4117-bce4-f1eef8a318ac None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:33:34.926613 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa3a5e6-3f4c-4117-bce4-f1eef8a318ac None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:33:34.950186 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:33:34.983865 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d15f1e-73d2-45d5-8020-21e3d46e0a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:33:34.984463 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d15f1e-73d2-45d5-8020-21e3d46e0a71 admin admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:34.984748 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d15f1e-73d2-45d5-8020-21e3d46e0a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:34.985009 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d15f1e-73d2-45d5-8020-21e3d46e0a71 admin admin] PATH_INFO: `/v3/users` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:34.985620 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d15f1e-73d2-45d5-8020-21e3d46e0a71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:33:34.987572 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d15f1e-73d2-45d5-8020-21e3d46e0a71 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:33:35.007880 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1367/2729] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 20 22:33:34 2022] POST /identity/v3/users => generated 297 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:33:35.012010 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274b5753-cccc-4110-b716-a63d359a412e admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:33:35.022745 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274b5753-cccc-4110-b716-a63d359a412e admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:33:35.027336 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf2fe6c-44cc-4bb1-b4dd-05fab300fefb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:33:35.027933 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf2fe6c-44cc-4bb1-b4dd-05fab300fefb admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:35.028211 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf2fe6c-44cc-4bb1-b4dd-05fab300fefb admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:35.028483 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf2fe6c-44cc-4bb1-b4dd-05fab300fefb admin admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:35.029118 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf2fe6c-44cc-4bb1-b4dd-05fab300fefb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:33:35.030735 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf2fe6c-44cc-4bb1-b4dd-05fab300fefb admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:33:35.042118 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1363/2730] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:33:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:33:35.046201 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d15f1e-73d2-45d5-8020-21e3d46e0a71 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:33:35.056209 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d15f1e-73d2-45d5-8020-21e3d46e0a71 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:33:35.060775 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65d1fb1-323e-4cf6-a6a8-a30ad4f45d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:33:35.061419 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d1fb1-323e-4cf6-a6a8-a30ad4f45d08 admin admin] REQUEST_METHOD: `PUT` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:35.061708 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d1fb1-323e-4cf6-a6a8-a30ad4f45d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:35.061984 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d1fb1-323e-4cf6-a6a8-a30ad4f45d08 admin admin] PATH_INFO: `/v3/projects/f6b45ef642724e8aadbcdda9a593b6e7/users/e4885ba902f241f0b5936daae89213ac/roles/8a829170b29d42d6af589399e51edb0f` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:35.076526 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65d1fb1-323e-4cf6-a6a8-a30ad4f45d08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6b45ef642724e8aadbcdda9a593b6e7, user_id=e4885ba902f241f0b5936daae89213ac, role_id=8a829170b29d42d6af589399e51edb0f)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:33:35.079302 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65d1fb1-323e-4cf6-a6a8-a30ad4f45d08 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:33:35.092445 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1368/2731] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:33:35 2022] PUT /identity/v3/projects/f6b45ef642724e8aadbcdda9a593b6e7/users/e4885ba902f241f0b5936daae89213ac/roles/8a829170b29d42d6af589399e51edb0f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 22:33:35.096392 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf2fe6c-44cc-4bb1-b4dd-05fab300fefb admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:33:35.106725 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf2fe6c-44cc-4bb1-b4dd-05fab300fefb admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:33:35.161198 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66eb18c-ece6-4e27-a48d-f8495b0a1bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:33:35.161798 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66eb18c-ece6-4e27-a48d-f8495b0a1bd6 admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:35.162073 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66eb18c-ece6-4e27-a48d-f8495b0a1bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:35.162339 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66eb18c-ece6-4e27-a48d-f8495b0a1bd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:35.163003 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66eb18c-ece6-4e27-a48d-f8495b0a1bd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:33:35.164580 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66eb18c-ece6-4e27-a48d-f8495b0a1bd6 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:33:35.174378 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1364/2732] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:33:35 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:33:35.178722 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65d1fb1-323e-4cf6-a6a8-a30ad4f45d08 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:33:35.188681 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65d1fb1-323e-4cf6-a6a8-a30ad4f45d08 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:33:35.193245 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2681ef-6f6b-4b2f-a2b5-2c162a355d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:33:35.193877 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2681ef-6f6b-4b2f-a2b5-2c162a355d2a admin admin] REQUEST_METHOD: `PUT` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:35.194152 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2681ef-6f6b-4b2f-a2b5-2c162a355d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:35.194420 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2681ef-6f6b-4b2f-a2b5-2c162a355d2a admin admin] PATH_INFO: `/v3/projects/f6b45ef642724e8aadbcdda9a593b6e7/users/e4885ba902f241f0b5936daae89213ac/roles/8a829170b29d42d6af589399e51edb0f` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:35.196326 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2681ef-6f6b-4b2f-a2b5-2c162a355d2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6b45ef642724e8aadbcdda9a593b6e7, user_id=e4885ba902f241f0b5936daae89213ac, role_id=8a829170b29d42d6af589399e51edb0f)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:33:35.198955 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2681ef-6f6b-4b2f-a2b5-2c162a355d2a admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:33:35.209260 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1369/2733] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:33:35 2022] PUT /identity/v3/projects/f6b45ef642724e8aadbcdda9a593b6e7/users/e4885ba902f241f0b5936daae89213ac/roles/8a829170b29d42d6af589399e51edb0f => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:33:35.219056 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5521f30a-3dfd-4958-98cf-c3cac6f23dc7 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:35.219342 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5521f30a-3dfd-4958-98cf-c3cac6f23dc7 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:35.219613 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5521f30a-3dfd-4958-98cf-c3cac6f23dc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:35.246948 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-5521f30a-3dfd-4958-98cf-c3cac6f23dc7 None None] MFA Rules not processed for user `e4885ba902f241f0b5936daae89213ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:33:35.248187 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-5521f30a-3dfd-4958-98cf-c3cac6f23dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:33:35.316014 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1365/2734] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:33:35 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:33:35.326549 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2681ef-6f6b-4b2f-a2b5-2c162a355d2a admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:33:35.328254 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-6e2681ef-6f6b-4b2f-a2b5-2c162a355d2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:33:35.385419 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2681ef-6f6b-4b2f-a2b5-2c162a355d2a admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:33:35.389172 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ea7bfd-809a-48d2-8cf4-984d05051d4f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577c8b14c1f4279beac13b9ba11aba1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:33:35.389773 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ea7bfd-809a-48d2-8cf4-984d05051d4f service cinder] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:35.390049 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ea7bfd-809a-48d2-8cf4-984d05051d4f service cinder] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:35.390318 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ea7bfd-809a-48d2-8cf4-984d05051d4f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:35.399872 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ea7bfd-809a-48d2-8cf4-984d05051d4f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:33:35.401284 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ea7bfd-809a-48d2-8cf4-984d05051d4f service cinder] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:33:35.410734 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1370/2735] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:33:35 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:33:35.808939 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5521f30a-3dfd-4958-98cf-c3cac6f23dc7 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:33:35.834524 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:33:35.872897 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5521f30a-3dfd-4958-98cf-c3cac6f23dc7 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:33:35.877391 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13df797-4473-447d-a326-4e2a3d5493dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:33:35.878623 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13df797-4473-447d-a326-4e2a3d5493dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:35.878902 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13df797-4473-447d-a326-4e2a3d5493dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:35.879196 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13df797-4473-447d-a326-4e2a3d5493dd admin admin] PATH_INFO: `/v3/users/d33c376af14348e3947aac9b0a425156` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:35.880304 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13df797-4473-447d-a326-4e2a3d5493dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=d33c376af14348e3947aac9b0a425156)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:33:35.882247 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13df797-4473-447d-a326-4e2a3d5493dd admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:33:35.927405 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-e13df797-4473-447d-a326-4e2a3d5493dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd33c376af14348e3947aac9b0a425156'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:33:35.934442 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-e13df797-4473-447d-a326-4e2a3d5493dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd33c376af14348e3947aac9b0a425156'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:33:35.935093 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-e13df797-4473-447d-a326-4e2a3d5493dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd33c376af14348e3947aac9b0a425156'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:33:35.935702 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-e13df797-4473-447d-a326-4e2a3d5493dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd33c376af14348e3947aac9b0a425156'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:33:35.944507 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-e13df797-4473-447d-a326-4e2a3d5493dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd33c376af14348e3947aac9b0a425156'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:33:35.963338 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1366/2736] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 20 22:33:35 2022] DELETE /identity/v3/users/d33c376af14348e3947aac9b0a425156 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:33:35.967918 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a811ddad-a780-4c08-9810-1b028094d747 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:35.968371 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a811ddad-a780-4c08-9810-1b028094d747 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:35.968492 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a811ddad-a780-4c08-9810-1b028094d747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:35.987617 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-a811ddad-a780-4c08-9810-1b028094d747 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:33:35.988825 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-a811ddad-a780-4c08-9810-1b028094d747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:33:36.047236 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1371/2737] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:33:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:33:36.057656 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13df797-4473-447d-a326-4e2a3d5493dd admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:33:36.059136 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-e13df797-4473-447d-a326-4e2a3d5493dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:33:36.117165 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13df797-4473-447d-a326-4e2a3d5493dd admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:33:36.120921 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac06274-5e4f-4491-bcb2-5b739ca1c893 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b0b3ca4ecd41aaba9cf8e0f91fbf54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:33:36.121524 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac06274-5e4f-4491-bcb2-5b739ca1c893 service neutron] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:36.121833 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac06274-5e4f-4491-bcb2-5b739ca1c893 service neutron] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:36.122109 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac06274-5e4f-4491-bcb2-5b739ca1c893 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:36.131054 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac06274-5e4f-4491-bcb2-5b739ca1c893 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:33:36.132483 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac06274-5e4f-4491-bcb2-5b739ca1c893 service neutron] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:33:36.141804 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1367/2738] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:33:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:33:36.406379 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a811ddad-a780-4c08-9810-1b028094d747 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:33:36.408121 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-a811ddad-a780-4c08-9810-1b028094d747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:33:36.421343 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a811ddad-a780-4c08-9810-1b028094d747 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:33:36.427534 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd2b10d-70fb-4282-87b9-4647f8dc30c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:33:36.428184 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd2b10d-70fb-4282-87b9-4647f8dc30c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:36.428465 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd2b10d-70fb-4282-87b9-4647f8dc30c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:36.428731 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd2b10d-70fb-4282-87b9-4647f8dc30c7 admin admin] PATH_INFO: `/v3/projects/9f8d4b40eaac4dd69e102b17bfbc3e32` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:36.429907 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd2b10d-70fb-4282-87b9-4647f8dc30c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f8d4b40eaac4dd69e102b17bfbc3e32)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:33:36.438544 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd2b10d-70fb-4282-87b9-4647f8dc30c7 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:33:36.455418 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:33:36.486612 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-5dd2b10d-70fb-4282-87b9-4647f8dc30c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f8d4b40eaac4dd69e102b17bfbc3e32', 'request_id': 'req-5dd2b10d-70fb-4282-87b9-4647f8dc30c7'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:33:36.492721 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-5dd2b10d-70fb-4282-87b9-4647f8dc30c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f8d4b40eaac4dd69e102b17bfbc3e32', 'request_id': 'req-5dd2b10d-70fb-4282-87b9-4647f8dc30c7'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:33:36.499829 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-5dd2b10d-70fb-4282-87b9-4647f8dc30c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f8d4b40eaac4dd69e102b17bfbc3e32', 'request_id': 'req-5dd2b10d-70fb-4282-87b9-4647f8dc30c7'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:33:36.510063 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-5dd2b10d-70fb-4282-87b9-4647f8dc30c7 admin admin] The token cache is being invalidate because project 9f8d4b40eaac4dd69e102b17bfbc3e32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81306) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 22:33:36.510348 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-5dd2b10d-70fb-4282-87b9-4647f8dc30c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:33:36.510994 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-5dd2b10d-70fb-4282-87b9-4647f8dc30c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:33:36.512460 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1372/2739] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 20 22:33:36 2022] DELETE /identity/v3/projects/9f8d4b40eaac4dd69e102b17bfbc3e32 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:33:36.516424 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac06274-5e4f-4491-bcb2-5b739ca1c893 service neutron] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:33:36.526485 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac06274-5e4f-4491-bcb2-5b739ca1c893 service neutron] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:33:36.570964 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:33:36.588791 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162a63e3-5cdf-4026-99b0-3eede0cb8d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:33:36.589418 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162a63e3-5cdf-4026-99b0-3eede0cb8d78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:36.589695 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162a63e3-5cdf-4026-99b0-3eede0cb8d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:36.589965 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162a63e3-5cdf-4026-99b0-3eede0cb8d78 admin admin] PATH_INFO: `/v3/users/e4885ba902f241f0b5936daae89213ac` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:36.591091 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162a63e3-5cdf-4026-99b0-3eede0cb8d78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4885ba902f241f0b5936daae89213ac)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:33:36.592991 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162a63e3-5cdf-4026-99b0-3eede0cb8d78 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:33:36.637257 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-162a63e3-5cdf-4026-99b0-3eede0cb8d78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4885ba902f241f0b5936daae89213ac'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:33:36.645034 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-162a63e3-5cdf-4026-99b0-3eede0cb8d78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4885ba902f241f0b5936daae89213ac'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:33:36.645793 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-162a63e3-5cdf-4026-99b0-3eede0cb8d78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4885ba902f241f0b5936daae89213ac'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:33:36.646545 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-162a63e3-5cdf-4026-99b0-3eede0cb8d78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4885ba902f241f0b5936daae89213ac'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:33:36.653522 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-162a63e3-5cdf-4026-99b0-3eede0cb8d78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4885ba902f241f0b5936daae89213ac'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:33:36.672916 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1368/2740] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 20 22:33:36 2022] DELETE /identity/v3/users/e4885ba902f241f0b5936daae89213ac => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:33:36.941457 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd2b10d-70fb-4282-87b9-4647f8dc30c7 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:33:36.942914 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-5dd2b10d-70fb-4282-87b9-4647f8dc30c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:33:36.956690 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd2b10d-70fb-4282-87b9-4647f8dc30c7 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:33:37.013120 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165ac5ec-ed9b-4318-9352-663b792f2ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:33:37.013795 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ac5ec-ed9b-4318-9352-663b792f2ea0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:37.014012 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ac5ec-ed9b-4318-9352-663b792f2ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:37.014278 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ac5ec-ed9b-4318-9352-663b792f2ea0 admin admin] PATH_INFO: `/v3/projects/f6b45ef642724e8aadbcdda9a593b6e7` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:37.015472 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165ac5ec-ed9b-4318-9352-663b792f2ea0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6b45ef642724e8aadbcdda9a593b6e7)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:33:37.017354 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165ac5ec-ed9b-4318-9352-663b792f2ea0 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:33:37.061826 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-165ac5ec-ed9b-4318-9352-663b792f2ea0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6b45ef642724e8aadbcdda9a593b6e7', 'request_id': 'req-165ac5ec-ed9b-4318-9352-663b792f2ea0'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:33:37.068355 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-165ac5ec-ed9b-4318-9352-663b792f2ea0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6b45ef642724e8aadbcdda9a593b6e7', 'request_id': 'req-165ac5ec-ed9b-4318-9352-663b792f2ea0'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:33:37.076646 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-165ac5ec-ed9b-4318-9352-663b792f2ea0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6b45ef642724e8aadbcdda9a593b6e7', 'request_id': 'req-165ac5ec-ed9b-4318-9352-663b792f2ea0'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:33:37.087536 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-165ac5ec-ed9b-4318-9352-663b792f2ea0 admin admin] The token cache is being invalidate because project f6b45ef642724e8aadbcdda9a593b6e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81306) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 22:33:37.087783 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-165ac5ec-ed9b-4318-9352-663b792f2ea0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:33:37.088407 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-165ac5ec-ed9b-4318-9352-663b792f2ea0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:33:37.089890 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1373/2741] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 20 22:33:36 2022] DELETE /identity/v3/projects/f6b45ef642724e8aadbcdda9a593b6e7 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:33:37.094717 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ead44e9-9b1b-4cff-a0a2-c7bba174464b None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:37.095004 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ead44e9-9b1b-4cff-a0a2-c7bba174464b None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:37.095276 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ead44e9-9b1b-4cff-a0a2-c7bba174464b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:37.115527 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-2ead44e9-9b1b-4cff-a0a2-c7bba174464b None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:33:37.116717 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-2ead44e9-9b1b-4cff-a0a2-c7bba174464b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:33:37.177264 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1369/2742] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:33:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:33:37.187079 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21897c32-fabd-41e8-86e6-932ca800746c None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:37.187365 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21897c32-fabd-41e8-86e6-932ca800746c None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:37.187636 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21897c32-fabd-41e8-86e6-932ca800746c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:37.207887 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-21897c32-fabd-41e8-86e6-932ca800746c None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:33:37.209077 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-21897c32-fabd-41e8-86e6-932ca800746c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:33:37.216784 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1374/2743] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:33:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:33:37.220903 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ead44e9-9b1b-4cff-a0a2-c7bba174464b None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:33:37.230674 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ead44e9-9b1b-4cff-a0a2-c7bba174464b None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:33:37.235232 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5117f615-5b5c-49b4-92e5-639f94307f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:33:37.235853 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5117f615-5b5c-49b4-92e5-639f94307f1a admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:37.236131 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5117f615-5b5c-49b4-92e5-639f94307f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:37.236424 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5117f615-5b5c-49b4-92e5-639f94307f1a admin admin] PATH_INFO: `/v3/domains` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:37.237569 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5117f615-5b5c-49b4-92e5-639f94307f1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:33:37.237855 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5117f615-5b5c-49b4-92e5-639f94307f1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:33:37.239486 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5117f615-5b5c-49b4-92e5-639f94307f1a admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:33:37.250719 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1370/2744] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 20 22:33:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:33:37.255557 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21897c32-fabd-41e8-86e6-932ca800746c None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:33:37.264617 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21897c32-fabd-41e8-86e6-932ca800746c None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:33:37.269274 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13e2405-0eef-4de0-ada8-200d70214009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:33:37.269868 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13e2405-0eef-4de0-ada8-200d70214009 admin admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:37.270141 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13e2405-0eef-4de0-ada8-200d70214009 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:37.270411 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13e2405-0eef-4de0-ada8-200d70214009 admin admin] PATH_INFO: `/v3/projects` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:37.271062 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13e2405-0eef-4de0-ada8-200d70214009 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:33:37.272950 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13e2405-0eef-4de0-ada8-200d70214009 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:33:37.303856 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1375/2745] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 20 22:33:37 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 20 22:33:37.305000 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5117f615-5b5c-49b4-92e5-639f94307f1a admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:33:37.315730 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5117f615-5b5c-49b4-92e5-639f94307f1a admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:33:37.360498 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:33:37.372689 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68f0524-0130-4aba-8ba3-8eb16a4910e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:33:37.373307 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68f0524-0130-4aba-8ba3-8eb16a4910e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:37.373585 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68f0524-0130-4aba-8ba3-8eb16a4910e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:37.373854 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68f0524-0130-4aba-8ba3-8eb16a4910e0 admin admin] PATH_INFO: `/v3/users` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:37.374466 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68f0524-0130-4aba-8ba3-8eb16a4910e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:33:37.376393 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68f0524-0130-4aba-8ba3-8eb16a4910e0 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:33:37.397069 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1371/2746] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 20 22:33:37 2022] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:33:37.401232 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13e2405-0eef-4de0-ada8-200d70214009 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:33:37.411787 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13e2405-0eef-4de0-ada8-200d70214009 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:33:37.416353 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3674d2d0-713f-4554-9a6d-e81fd0a12e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:33:37.416943 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3674d2d0-713f-4554-9a6d-e81fd0a12e20 admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:37.417221 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3674d2d0-713f-4554-9a6d-e81fd0a12e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:37.417491 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3674d2d0-713f-4554-9a6d-e81fd0a12e20 admin admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:37.418121 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3674d2d0-713f-4554-9a6d-e81fd0a12e20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:33:37.419760 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3674d2d0-713f-4554-9a6d-e81fd0a12e20 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:33:37.420957 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:33:37.431949 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1376/2747] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:33:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:33:37.435231 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68f0524-0130-4aba-8ba3-8eb16a4910e0 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:33:37.446611 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68f0524-0130-4aba-8ba3-8eb16a4910e0 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:33:37.451312 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f66913-f184-4596-876b-fa26ffdf8ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:33:37.451912 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f66913-f184-4596-876b-fa26ffdf8ef2 admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:37.452195 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f66913-f184-4596-876b-fa26ffdf8ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:37.452471 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f66913-f184-4596-876b-fa26ffdf8ef2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:37.453114 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f66913-f184-4596-876b-fa26ffdf8ef2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:33:37.454737 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f66913-f184-4596-876b-fa26ffdf8ef2 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:33:37.465664 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1372/2748] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:33:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:33:37.469848 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3674d2d0-713f-4554-9a6d-e81fd0a12e20 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:33:37.479858 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3674d2d0-713f-4554-9a6d-e81fd0a12e20 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:33:37.485010 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b522883b-f2e2-470f-9a4f-f8f6df73c02b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:33:37.485654 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b522883b-f2e2-470f-9a4f-f8f6df73c02b admin admin] REQUEST_METHOD: `PUT` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:37.485932 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b522883b-f2e2-470f-9a4f-f8f6df73c02b admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:37.486202 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b522883b-f2e2-470f-9a4f-f8f6df73c02b admin admin] PATH_INFO: `/v3/projects/85174e057faa4707a0ef6a887aa31098/users/d5e2ed17336e43b1b29d48d55c9a1f2f/roles/604444e7ad0d437dbd1f5a6e02b761f5` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:37.501041 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b522883b-f2e2-470f-9a4f-f8f6df73c02b admin admin] RBAC: Authorizing `identity:create_grant(project_id=85174e057faa4707a0ef6a887aa31098, user_id=d5e2ed17336e43b1b29d48d55c9a1f2f, role_id=604444e7ad0d437dbd1f5a6e02b761f5)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:33:37.504288 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b522883b-f2e2-470f-9a4f-f8f6df73c02b admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:33:37.516572 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1377/2749] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:33:37 2022] PUT /identity/v3/projects/85174e057faa4707a0ef6a887aa31098/users/d5e2ed17336e43b1b29d48d55c9a1f2f/roles/604444e7ad0d437dbd1f5a6e02b761f5 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:33:37.526778 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c0ce7b-5172-4089-84d6-a369742a9366 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:37.527068 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c0ce7b-5172-4089-84d6-a369742a9366 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:37.527343 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c0ce7b-5172-4089-84d6-a369742a9366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:37.555476 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-d3c0ce7b-5172-4089-84d6-a369742a9366 None None] MFA Rules not processed for user `d5e2ed17336e43b1b29d48d55c9a1f2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:33:37.556685 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-d3c0ce7b-5172-4089-84d6-a369742a9366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:33:37.619950 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1373/2750] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:33:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:33:37.624425 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b522883b-f2e2-470f-9a4f-f8f6df73c02b admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:33:37.684956 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b522883b-f2e2-470f-9a4f-f8f6df73c02b admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:33:37.689443 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24b4ce3-e184-4770-a32c-f3fbb3ef25a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:33:37.690034 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24b4ce3-e184-4770-a32c-f3fbb3ef25a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:37.690311 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24b4ce3-e184-4770-a32c-f3fbb3ef25a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:37.690616 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24b4ce3-e184-4770-a32c-f3fbb3ef25a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:37.691248 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24b4ce3-e184-4770-a32c-f3fbb3ef25a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:33:37.693129 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24b4ce3-e184-4770-a32c-f3fbb3ef25a5 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:33:37.718601 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1378/2751] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 20 22:33:37 2022] POST /identity/v3/projects => generated 385 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:33:37.723103 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c0ce7b-5172-4089-84d6-a369742a9366 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:33:37.733603 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c0ce7b-5172-4089-84d6-a369742a9366 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:33:37.791429 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da8b33e-7359-4c2c-9aa6-f5a70dfcf594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:33:37.792779 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da8b33e-7359-4c2c-9aa6-f5a70dfcf594 admin admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:37.793066 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da8b33e-7359-4c2c-9aa6-f5a70dfcf594 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:37.793510 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da8b33e-7359-4c2c-9aa6-f5a70dfcf594 admin admin] PATH_INFO: `/v3/users` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:37.794144 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da8b33e-7359-4c2c-9aa6-f5a70dfcf594 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:33:37.796096 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da8b33e-7359-4c2c-9aa6-f5a70dfcf594 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:33:37.819846 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1374/2752] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 20 22:33:37 2022] POST /identity/v3/users => generated 299 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 20 22:33:37.823818 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24b4ce3-e184-4770-a32c-f3fbb3ef25a5 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:33:37.834435 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24b4ce3-e184-4770-a32c-f3fbb3ef25a5 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:33:37.839014 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304eebb5-25ad-4970-9f73-c3fb40055cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:33:37.839606 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304eebb5-25ad-4970-9f73-c3fb40055cef admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:37.839880 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304eebb5-25ad-4970-9f73-c3fb40055cef admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:37.840153 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304eebb5-25ad-4970-9f73-c3fb40055cef admin admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:37.840781 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304eebb5-25ad-4970-9f73-c3fb40055cef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:33:37.842354 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304eebb5-25ad-4970-9f73-c3fb40055cef admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:33:37.853448 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1379/2753] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:33:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:33:37.857675 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da8b33e-7359-4c2c-9aa6-f5a70dfcf594 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:33:37.868223 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da8b33e-7359-4c2c-9aa6-f5a70dfcf594 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:33:37.872927 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae14d54b-c6e3-411c-88e5-3fae79e3b56a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:33:37.873578 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae14d54b-c6e3-411c-88e5-3fae79e3b56a admin admin] REQUEST_METHOD: `PUT` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:37.873860 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae14d54b-c6e3-411c-88e5-3fae79e3b56a admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:37.874139 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae14d54b-c6e3-411c-88e5-3fae79e3b56a admin admin] PATH_INFO: `/v3/projects/d3d027498e27447a8ec8f433bd037802/users/c563cf9408f549379a17332e36f1ed70/roles/8a829170b29d42d6af589399e51edb0f` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:37.888701 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae14d54b-c6e3-411c-88e5-3fae79e3b56a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3d027498e27447a8ec8f433bd037802, user_id=c563cf9408f549379a17332e36f1ed70, role_id=8a829170b29d42d6af589399e51edb0f)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:33:37.891395 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae14d54b-c6e3-411c-88e5-3fae79e3b56a admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:33:37.903523 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1375/2754] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:33:37 2022] PUT /identity/v3/projects/d3d027498e27447a8ec8f433bd037802/users/c563cf9408f549379a17332e36f1ed70/roles/8a829170b29d42d6af589399e51edb0f => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:33:37.907628 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304eebb5-25ad-4970-9f73-c3fb40055cef admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:33:37.919330 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304eebb5-25ad-4970-9f73-c3fb40055cef admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:33:37.982323 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7454230b-3811-438a-b2f2-9bf31a81f76b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:33:37.982888 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7454230b-3811-438a-b2f2-9bf31a81f76b admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:37.983168 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7454230b-3811-438a-b2f2-9bf31a81f76b admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:37.983442 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7454230b-3811-438a-b2f2-9bf31a81f76b admin admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:37.984078 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7454230b-3811-438a-b2f2-9bf31a81f76b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:33:37.985661 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7454230b-3811-438a-b2f2-9bf31a81f76b admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:33:37.995407 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1380/2755] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:33:37 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:33:37.999530 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae14d54b-c6e3-411c-88e5-3fae79e3b56a admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:33:38.009749 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae14d54b-c6e3-411c-88e5-3fae79e3b56a admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:33:38.014429 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4ba035-b097-4173-ba86-66a26f233535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:33:38.015244 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4ba035-b097-4173-ba86-66a26f233535 admin admin] REQUEST_METHOD: `PUT` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:38.015531 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4ba035-b097-4173-ba86-66a26f233535 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:38.015807 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4ba035-b097-4173-ba86-66a26f233535 admin admin] PATH_INFO: `/v3/projects/d3d027498e27447a8ec8f433bd037802/users/c563cf9408f549379a17332e36f1ed70/roles/8a829170b29d42d6af589399e51edb0f` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:38.017767 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4ba035-b097-4173-ba86-66a26f233535 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3d027498e27447a8ec8f433bd037802, user_id=c563cf9408f549379a17332e36f1ed70, role_id=8a829170b29d42d6af589399e51edb0f)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:33:38.021007 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4ba035-b097-4173-ba86-66a26f233535 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:33:38.031380 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1376/2756] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:33:37 2022] PUT /identity/v3/projects/d3d027498e27447a8ec8f433bd037802/users/c563cf9408f549379a17332e36f1ed70/roles/8a829170b29d42d6af589399e51edb0f => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:33:38.097937 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fa3435-5a64-4ea4-a883-fb0b98934e0e None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:38.098553 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fa3435-5a64-4ea4-a883-fb0b98934e0e None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:38.098553 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fa3435-5a64-4ea4-a883-fb0b98934e0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:38.125530 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-f7fa3435-5a64-4ea4-a883-fb0b98934e0e None None] MFA Rules not processed for user `c563cf9408f549379a17332e36f1ed70`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:33:38.126759 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-f7fa3435-5a64-4ea4-a883-fb0b98934e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:33:38.155711 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:33:38.192688 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1381/2757] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:33:38 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:33:38.203188 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4ba035-b097-4173-ba86-66a26f233535 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:33:38.204882 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-2b4ba035-b097-4173-ba86-66a26f233535 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:33:38.219121 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:33:38.262660 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4ba035-b097-4173-ba86-66a26f233535 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:33:38.266190 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c27d89-bd22-4831-9254-ae6b99d5c4b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577c8b14c1f4279beac13b9ba11aba1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:33:38.266816 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c27d89-bd22-4831-9254-ae6b99d5c4b0 service cinder] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:38.267096 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c27d89-bd22-4831-9254-ae6b99d5c4b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:38.267370 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c27d89-bd22-4831-9254-ae6b99d5c4b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:38.324564 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c27d89-bd22-4831-9254-ae6b99d5c4b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:33:38.326000 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c27d89-bd22-4831-9254-ae6b99d5c4b0 service cinder] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:33:38.335473 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1377/2758] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:33:38 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:33:42.537464 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fa3435-5a64-4ea4-a883-fb0b98934e0e None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:33:42.538926 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-f7fa3435-5a64-4ea4-a883-fb0b98934e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:33:42.551235 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fa3435-5a64-4ea4-a883-fb0b98934e0e None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:33:42.554733 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5e48ac-a75f-4ffb-b22b-4281819724d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577c8b14c1f4279beac13b9ba11aba1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:33:42.555329 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e48ac-a75f-4ffb-b22b-4281819724d9 service cinder] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:42.555605 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e48ac-a75f-4ffb-b22b-4281819724d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:42.555873 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e48ac-a75f-4ffb-b22b-4281819724d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:42.564609 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5e48ac-a75f-4ffb-b22b-4281819724d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:33:42.566662 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5e48ac-a75f-4ffb-b22b-4281819724d9 service cinder] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:33:42.575945 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1382/2759] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:33:42 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:33:47.453056 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c27d89-bd22-4831-9254-ae6b99d5c4b0 service cinder] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:33:47.514123 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c27d89-bd22-4831-9254-ae6b99d5c4b0 service cinder] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:33:47.518643 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac32e38-fab7-436f-a534-a899d514b66a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:33:47.519255 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac32e38-fab7-436f-a534-a899d514b66a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:47.519532 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac32e38-fab7-436f-a534-a899d514b66a admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:47.519797 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac32e38-fab7-436f-a534-a899d514b66a admin admin] PATH_INFO: `/v3/users/d5e2ed17336e43b1b29d48d55c9a1f2f` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:47.520893 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac32e38-fab7-436f-a534-a899d514b66a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5e2ed17336e43b1b29d48d55c9a1f2f)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:33:47.522821 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac32e38-fab7-436f-a534-a899d514b66a admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:33:47.568516 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-dac32e38-fab7-436f-a534-a899d514b66a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5e2ed17336e43b1b29d48d55c9a1f2f'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:33:47.575118 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-dac32e38-fab7-436f-a534-a899d514b66a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5e2ed17336e43b1b29d48d55c9a1f2f'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:33:47.575726 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-dac32e38-fab7-436f-a534-a899d514b66a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5e2ed17336e43b1b29d48d55c9a1f2f'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:33:47.576323 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-dac32e38-fab7-436f-a534-a899d514b66a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5e2ed17336e43b1b29d48d55c9a1f2f'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:33:47.583167 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-dac32e38-fab7-436f-a534-a899d514b66a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5e2ed17336e43b1b29d48d55c9a1f2f'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:33:47.587508 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:33:47.603129 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1378/2760] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 20 22:33:47 2022] DELETE /identity/v3/users/d5e2ed17336e43b1b29d48d55c9a1f2f => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:33:47.607699 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af32ea14-3869-468d-8d43-a04e60a0cb54 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:47.608173 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af32ea14-3869-468d-8d43-a04e60a0cb54 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:47.608274 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af32ea14-3869-468d-8d43-a04e60a0cb54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:47.627270 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-af32ea14-3869-468d-8d43-a04e60a0cb54 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:33:47.628486 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-af32ea14-3869-468d-8d43-a04e60a0cb54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:33:47.684800 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1383/2761] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:33:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:33:47.694662 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac32e38-fab7-436f-a534-a899d514b66a admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:33:47.696101 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-dac32e38-fab7-436f-a534-a899d514b66a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:33:47.752447 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac32e38-fab7-436f-a534-a899d514b66a admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:33:47.756113 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad1e485-9f05-4b31-b455-8371ffc0f046 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b0b3ca4ecd41aaba9cf8e0f91fbf54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:33:47.756711 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad1e485-9f05-4b31-b455-8371ffc0f046 service neutron] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:47.756989 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad1e485-9f05-4b31-b455-8371ffc0f046 service neutron] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:47.757262 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad1e485-9f05-4b31-b455-8371ffc0f046 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:47.766039 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad1e485-9f05-4b31-b455-8371ffc0f046 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:33:47.767487 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad1e485-9f05-4b31-b455-8371ffc0f046 service neutron] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:33:47.777502 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1379/2762] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:33:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:33:48.037995 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af32ea14-3869-468d-8d43-a04e60a0cb54 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:33:48.039499 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-af32ea14-3869-468d-8d43-a04e60a0cb54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:33:48.051943 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af32ea14-3869-468d-8d43-a04e60a0cb54 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:33:48.056698 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203956c3-09c8-4559-8495-7a80a6f63c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:33:48.057447 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203956c3-09c8-4559-8495-7a80a6f63c09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:48.057777 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203956c3-09c8-4559-8495-7a80a6f63c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:48.058129 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203956c3-09c8-4559-8495-7a80a6f63c09 admin admin] PATH_INFO: `/v3/projects/85174e057faa4707a0ef6a887aa31098` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:48.059421 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203956c3-09c8-4559-8495-7a80a6f63c09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85174e057faa4707a0ef6a887aa31098)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:33:48.061773 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203956c3-09c8-4559-8495-7a80a6f63c09 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:33:48.111697 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-203956c3-09c8-4559-8495-7a80a6f63c09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85174e057faa4707a0ef6a887aa31098', 'request_id': 'req-203956c3-09c8-4559-8495-7a80a6f63c09'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:33:48.117704 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-203956c3-09c8-4559-8495-7a80a6f63c09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85174e057faa4707a0ef6a887aa31098', 'request_id': 'req-203956c3-09c8-4559-8495-7a80a6f63c09'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:33:48.124932 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-203956c3-09c8-4559-8495-7a80a6f63c09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85174e057faa4707a0ef6a887aa31098', 'request_id': 'req-203956c3-09c8-4559-8495-7a80a6f63c09'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:33:48.135721 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-203956c3-09c8-4559-8495-7a80a6f63c09 admin admin] The token cache is being invalidate because project 85174e057faa4707a0ef6a887aa31098 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81306) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 22:33:48.135996 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-203956c3-09c8-4559-8495-7a80a6f63c09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:33:48.136600 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-203956c3-09c8-4559-8495-7a80a6f63c09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:33:48.138071 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1384/2763] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 20 22:33:48 2022] DELETE /identity/v3/projects/85174e057faa4707a0ef6a887aa31098 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:33:48.142079 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad1e485-9f05-4b31-b455-8371ffc0f046 service neutron] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:33:48.152403 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad1e485-9f05-4b31-b455-8371ffc0f046 service neutron] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:33:48.207600 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35173921-dedf-41b5-a7a8-8b7ceb187007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:33:48.208224 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35173921-dedf-41b5-a7a8-8b7ceb187007 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:48.208504 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35173921-dedf-41b5-a7a8-8b7ceb187007 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:48.208775 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35173921-dedf-41b5-a7a8-8b7ceb187007 admin admin] PATH_INFO: `/v3/users/c563cf9408f549379a17332e36f1ed70` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:48.209874 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35173921-dedf-41b5-a7a8-8b7ceb187007 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c563cf9408f549379a17332e36f1ed70)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:33:48.211870 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35173921-dedf-41b5-a7a8-8b7ceb187007 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:33:48.255271 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-35173921-dedf-41b5-a7a8-8b7ceb187007 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c563cf9408f549379a17332e36f1ed70'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:33:48.262294 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-35173921-dedf-41b5-a7a8-8b7ceb187007 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c563cf9408f549379a17332e36f1ed70'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:33:48.262930 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-35173921-dedf-41b5-a7a8-8b7ceb187007 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c563cf9408f549379a17332e36f1ed70'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:33:48.263526 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-35173921-dedf-41b5-a7a8-8b7ceb187007 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c563cf9408f549379a17332e36f1ed70'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:33:48.270841 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-35173921-dedf-41b5-a7a8-8b7ceb187007 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c563cf9408f549379a17332e36f1ed70'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:33:48.287582 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1380/2764] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 20 22:33:48 2022] DELETE /identity/v3/users/c563cf9408f549379a17332e36f1ed70 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:33:48.552721 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203956c3-09c8-4559-8495-7a80a6f63c09 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:33:48.554167 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-203956c3-09c8-4559-8495-7a80a6f63c09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:33:48.571127 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203956c3-09c8-4559-8495-7a80a6f63c09 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:33:48.605419 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:33:48.630584 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15e4086-863a-46d6-8265-6fcc742e695b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:33:48.631249 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e4086-863a-46d6-8265-6fcc742e695b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:48.631522 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e4086-863a-46d6-8265-6fcc742e695b admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:48.631793 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e4086-863a-46d6-8265-6fcc742e695b admin admin] PATH_INFO: `/v3/projects/d3d027498e27447a8ec8f433bd037802` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:48.632964 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15e4086-863a-46d6-8265-6fcc742e695b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3d027498e27447a8ec8f433bd037802)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:33:48.634918 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15e4086-863a-46d6-8265-6fcc742e695b admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:33:48.680891 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-b15e4086-863a-46d6-8265-6fcc742e695b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3d027498e27447a8ec8f433bd037802', 'request_id': 'req-b15e4086-863a-46d6-8265-6fcc742e695b'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:33:48.686878 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-b15e4086-863a-46d6-8265-6fcc742e695b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3d027498e27447a8ec8f433bd037802', 'request_id': 'req-b15e4086-863a-46d6-8265-6fcc742e695b'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:33:48.694671 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-b15e4086-863a-46d6-8265-6fcc742e695b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3d027498e27447a8ec8f433bd037802', 'request_id': 'req-b15e4086-863a-46d6-8265-6fcc742e695b'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:33:48.704837 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-b15e4086-863a-46d6-8265-6fcc742e695b admin admin] The token cache is being invalidate because project d3d027498e27447a8ec8f433bd037802 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81306) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 22:33:48.705120 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-b15e4086-863a-46d6-8265-6fcc742e695b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:33:48.705739 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-b15e4086-863a-46d6-8265-6fcc742e695b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:33:48.707233 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1385/2765] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 20 22:33:48 2022] DELETE /identity/v3/projects/d3d027498e27447a8ec8f433bd037802 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:33:48.713118 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33654b6-e5ef-4ddc-a6c4-073407fea0cd None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:48.713617 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33654b6-e5ef-4ddc-a6c4-073407fea0cd None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:48.713729 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33654b6-e5ef-4ddc-a6c4-073407fea0cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:48.727233 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:33:48.733469 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-c33654b6-e5ef-4ddc-a6c4-073407fea0cd None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:33:48.735204 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-c33654b6-e5ef-4ddc-a6c4-073407fea0cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:33:48.793846 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1381/2766] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:33:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 22:33:48.802955 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d9383-eb77-4d11-a589-1e7b2145ad24 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:48.803269 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d9383-eb77-4d11-a589-1e7b2145ad24 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:48.803542 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d9383-eb77-4d11-a589-1e7b2145ad24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:48.822787 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-ce0d9383-eb77-4d11-a589-1e7b2145ad24 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:33:48.824020 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-ce0d9383-eb77-4d11-a589-1e7b2145ad24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:33:48.831731 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1386/2767] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:33:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:33:48.835884 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33654b6-e5ef-4ddc-a6c4-073407fea0cd None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:33:48.845659 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33654b6-e5ef-4ddc-a6c4-073407fea0cd None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:33:48.851833 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c46e5a-a56d-44c3-9e66-f4dda676ecfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:33:48.852433 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c46e5a-a56d-44c3-9e66-f4dda676ecfa admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:48.852712 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c46e5a-a56d-44c3-9e66-f4dda676ecfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:48.852983 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c46e5a-a56d-44c3-9e66-f4dda676ecfa admin admin] PATH_INFO: `/v3/domains` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:48.853629 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c46e5a-a56d-44c3-9e66-f4dda676ecfa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:33:48.853932 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c46e5a-a56d-44c3-9e66-f4dda676ecfa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:33:48.855595 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c46e5a-a56d-44c3-9e66-f4dda676ecfa admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:33:48.867685 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1382/2768] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 20 22:33:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:33:48.871863 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0d9383-eb77-4d11-a589-1e7b2145ad24 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:33:48.881115 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0d9383-eb77-4d11-a589-1e7b2145ad24 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:33:48.885721 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef4a29a-b4fc-4355-8d4a-44b8df198444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:33:48.886306 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef4a29a-b4fc-4355-8d4a-44b8df198444 admin admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:48.886618 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef4a29a-b4fc-4355-8d4a-44b8df198444 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:48.886891 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef4a29a-b4fc-4355-8d4a-44b8df198444 admin admin] PATH_INFO: `/v3/projects` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:48.887524 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef4a29a-b4fc-4355-8d4a-44b8df198444 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:33:48.889397 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef4a29a-b4fc-4355-8d4a-44b8df198444 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:33:48.925672 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1387/2769] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 20 22:33:48 2022] POST /identity/v3/projects => generated 375 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:33:48.929802 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c46e5a-a56d-44c3-9e66-f4dda676ecfa admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:33:48.939494 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c46e5a-a56d-44c3-9e66-f4dda676ecfa admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:33:48.995022 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2054c823-c9a1-414f-a34e-668b0b9c2a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:33:48.995613 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2054c823-c9a1-414f-a34e-668b0b9c2a55 admin admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:48.995897 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2054c823-c9a1-414f-a34e-668b0b9c2a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:48.996188 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2054c823-c9a1-414f-a34e-668b0b9c2a55 admin admin] PATH_INFO: `/v3/users` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:48.996859 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2054c823-c9a1-414f-a34e-668b0b9c2a55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:33:48.998837 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2054c823-c9a1-414f-a34e-668b0b9c2a55 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:33:49.018397 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1383/2770] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 20 22:33:48 2022] POST /identity/v3/users => generated 288 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:33:49.022435 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef4a29a-b4fc-4355-8d4a-44b8df198444 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:33:49.032715 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef4a29a-b4fc-4355-8d4a-44b8df198444 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:33:49.037765 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a1ae2d-7683-4ec7-a89c-473fc7c025ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:33:49.038405 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a1ae2d-7683-4ec7-a89c-473fc7c025ce admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:49.038703 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a1ae2d-7683-4ec7-a89c-473fc7c025ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:49.038973 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a1ae2d-7683-4ec7-a89c-473fc7c025ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:49.039604 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a1ae2d-7683-4ec7-a89c-473fc7c025ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:33:49.041180 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a1ae2d-7683-4ec7-a89c-473fc7c025ce admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:33:49.051532 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1388/2771] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:33:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:33:49.055244 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2054c823-c9a1-414f-a34e-668b0b9c2a55 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:33:49.064916 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2054c823-c9a1-414f-a34e-668b0b9c2a55 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:33:49.069557 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dee0c9d-1b73-4804-9845-b0b40bd61fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:33:49.070143 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dee0c9d-1b73-4804-9845-b0b40bd61fac admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:49.070420 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dee0c9d-1b73-4804-9845-b0b40bd61fac admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:49.070718 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dee0c9d-1b73-4804-9845-b0b40bd61fac admin admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:49.071350 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dee0c9d-1b73-4804-9845-b0b40bd61fac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:33:49.072923 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dee0c9d-1b73-4804-9845-b0b40bd61fac admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:33:49.083164 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1384/2772] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:33:49 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:33:49.087054 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a1ae2d-7683-4ec7-a89c-473fc7c025ce admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:33:49.097523 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a1ae2d-7683-4ec7-a89c-473fc7c025ce admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:33:49.102014 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8599c810-1819-410c-9d56-0bf01204999d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:33:49.102684 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8599c810-1819-410c-9d56-0bf01204999d admin admin] REQUEST_METHOD: `PUT` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:49.102963 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8599c810-1819-410c-9d56-0bf01204999d admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:49.103230 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8599c810-1819-410c-9d56-0bf01204999d admin admin] PATH_INFO: `/v3/projects/a5bd4ad04976460abf67edc880a8e32c/users/c19a0365a29646079c86547475c5b3ae/roles/604444e7ad0d437dbd1f5a6e02b761f5` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:49.118277 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8599c810-1819-410c-9d56-0bf01204999d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5bd4ad04976460abf67edc880a8e32c, user_id=c19a0365a29646079c86547475c5b3ae, role_id=604444e7ad0d437dbd1f5a6e02b761f5)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:33:49.120938 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8599c810-1819-410c-9d56-0bf01204999d admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:33:49.133717 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1389/2773] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:33:49 2022] PUT /identity/v3/projects/a5bd4ad04976460abf67edc880a8e32c/users/c19a0365a29646079c86547475c5b3ae/roles/604444e7ad0d437dbd1f5a6e02b761f5 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:33:49.144995 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e322d8f-18c7-4715-9de7-9452718f7383 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:49.145308 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e322d8f-18c7-4715-9de7-9452718f7383 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:49.145584 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e322d8f-18c7-4715-9de7-9452718f7383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:49.173298 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-2e322d8f-18c7-4715-9de7-9452718f7383 None None] MFA Rules not processed for user `c19a0365a29646079c86547475c5b3ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:33:49.174494 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-2e322d8f-18c7-4715-9de7-9452718f7383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:33:49.237154 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1385/2774] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:33:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:33:49.248682 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8599c810-1819-410c-9d56-0bf01204999d admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:33:49.250349 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-8599c810-1819-410c-9d56-0bf01204999d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:33:49.306929 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8599c810-1819-410c-9d56-0bf01204999d admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:33:49.310528 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d790b583-83bd-4910-b802-dee39a75eda0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577c8b14c1f4279beac13b9ba11aba1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:33:49.311127 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d790b583-83bd-4910-b802-dee39a75eda0 service cinder] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:33:49.311405 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d790b583-83bd-4910-b802-dee39a75eda0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:33:49.311677 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d790b583-83bd-4910-b802-dee39a75eda0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:33:49.319814 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d790b583-83bd-4910-b802-dee39a75eda0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:33:49.321223 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d790b583-83bd-4910-b802-dee39a75eda0 service cinder] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:33:49.324640 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:33:49.331950 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1390/2775] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:33:49 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:33:59.234228 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=96,keystone:INSERT=3 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:33:59.335486 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=1 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:34:01.757259 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e322d8f-18c7-4715-9de7-9452718f7383 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:34:01.817553 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e322d8f-18c7-4715-9de7-9452718f7383 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:34:01.822019 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e444894b-fac9-4b93-9756-b54c2d35ce8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:34:01.822683 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e444894b-fac9-4b93-9756-b54c2d35ce8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:34:01.822964 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e444894b-fac9-4b93-9756-b54c2d35ce8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:34:01.823236 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e444894b-fac9-4b93-9756-b54c2d35ce8a admin admin] PATH_INFO: `/v3/users/c19a0365a29646079c86547475c5b3ae` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:34:01.824343 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e444894b-fac9-4b93-9756-b54c2d35ce8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c19a0365a29646079c86547475c5b3ae)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:34:01.826240 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e444894b-fac9-4b93-9756-b54c2d35ce8a admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:34:01.872389 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-e444894b-fac9-4b93-9756-b54c2d35ce8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c19a0365a29646079c86547475c5b3ae'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:34:01.880514 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-e444894b-fac9-4b93-9756-b54c2d35ce8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c19a0365a29646079c86547475c5b3ae'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:34:01.881231 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-e444894b-fac9-4b93-9756-b54c2d35ce8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c19a0365a29646079c86547475c5b3ae'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:34:01.881832 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-e444894b-fac9-4b93-9756-b54c2d35ce8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c19a0365a29646079c86547475c5b3ae'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:34:01.888688 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-e444894b-fac9-4b93-9756-b54c2d35ce8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c19a0365a29646079c86547475c5b3ae'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:34:01.905678 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1386/2776] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 20 22:34:01 2022] DELETE /identity/v3/users/c19a0365a29646079c86547475c5b3ae => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:34:01.910276 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfcf8ee-b63a-429b-bb09-7350131e9f24 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:34:01.910808 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfcf8ee-b63a-429b-bb09-7350131e9f24 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:34:01.910909 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfcf8ee-b63a-429b-bb09-7350131e9f24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:34:01.929822 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-fbfcf8ee-b63a-429b-bb09-7350131e9f24 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:34:01.931041 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-fbfcf8ee-b63a-429b-bb09-7350131e9f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:34:01.987133 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1391/2777] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:34:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:34:01.997100 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e444894b-fac9-4b93-9756-b54c2d35ce8a admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:34:01.998520 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-e444894b-fac9-4b93-9756-b54c2d35ce8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:34:02.055727 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e444894b-fac9-4b93-9756-b54c2d35ce8a admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:34:02.059298 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c81591d-a5b2-491b-9f7f-7a5dc1cd1d4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b0b3ca4ecd41aaba9cf8e0f91fbf54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:34:02.059890 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c81591d-a5b2-491b-9f7f-7a5dc1cd1d4c service neutron] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:34:02.060163 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c81591d-a5b2-491b-9f7f-7a5dc1cd1d4c service neutron] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:34:02.060438 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c81591d-a5b2-491b-9f7f-7a5dc1cd1d4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:34:02.070840 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c81591d-a5b2-491b-9f7f-7a5dc1cd1d4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:34:02.073446 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c81591d-a5b2-491b-9f7f-7a5dc1cd1d4c service neutron] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:34:02.082928 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1387/2778] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:34:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:34:02.342657 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfcf8ee-b63a-429b-bb09-7350131e9f24 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:34:02.344074 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-fbfcf8ee-b63a-429b-bb09-7350131e9f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:34:02.356696 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfcf8ee-b63a-429b-bb09-7350131e9f24 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:34:02.361386 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879d6021-3276-45c6-b71f-237d6f83adf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:34:02.362018 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d6021-3276-45c6-b71f-237d6f83adf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:34:02.362297 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d6021-3276-45c6-b71f-237d6f83adf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:34:02.362662 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d6021-3276-45c6-b71f-237d6f83adf3 admin admin] PATH_INFO: `/v3/projects/a5bd4ad04976460abf67edc880a8e32c` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:34:02.364438 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879d6021-3276-45c6-b71f-237d6f83adf3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5bd4ad04976460abf67edc880a8e32c)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:34:02.366359 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879d6021-3276-45c6-b71f-237d6f83adf3 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:34:02.414099 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-879d6021-3276-45c6-b71f-237d6f83adf3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5bd4ad04976460abf67edc880a8e32c', 'request_id': 'req-879d6021-3276-45c6-b71f-237d6f83adf3'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:34:02.420307 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-879d6021-3276-45c6-b71f-237d6f83adf3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5bd4ad04976460abf67edc880a8e32c', 'request_id': 'req-879d6021-3276-45c6-b71f-237d6f83adf3'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:34:02.427579 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-879d6021-3276-45c6-b71f-237d6f83adf3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5bd4ad04976460abf67edc880a8e32c', 'request_id': 'req-879d6021-3276-45c6-b71f-237d6f83adf3'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:34:02.437837 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-879d6021-3276-45c6-b71f-237d6f83adf3 admin admin] The token cache is being invalidate because project a5bd4ad04976460abf67edc880a8e32c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81306) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 22:34:02.438124 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-879d6021-3276-45c6-b71f-237d6f83adf3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:34:02.438776 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-879d6021-3276-45c6-b71f-237d6f83adf3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:34:02.440274 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1392/2779] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 20 22:34:02 2022] DELETE /identity/v3/projects/a5bd4ad04976460abf67edc880a8e32c => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:34:02.445096 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a296e1-30ef-42bf-a0f3-232375a56b5b None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:34:02.445378 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a296e1-30ef-42bf-a0f3-232375a56b5b None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:34:02.445649 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a296e1-30ef-42bf-a0f3-232375a56b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:34:02.464647 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-15a296e1-30ef-42bf-a0f3-232375a56b5b None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:34:02.465818 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-15a296e1-30ef-42bf-a0f3-232375a56b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:34:02.482308 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:34:02.525447 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1388/2780] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:34:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:34:02.533421 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d89625-723f-48b4-bb23-6fdab6da420d None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:34:02.533712 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d89625-723f-48b4-bb23-6fdab6da420d None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:34:02.533987 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d89625-723f-48b4-bb23-6fdab6da420d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:34:02.554390 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-f9d89625-723f-48b4-bb23-6fdab6da420d None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:34:02.555629 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-f9d89625-723f-48b4-bb23-6fdab6da420d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:34:02.563483 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1393/2781] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:34:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:34:02.567508 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a296e1-30ef-42bf-a0f3-232375a56b5b None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:34:02.577006 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a296e1-30ef-42bf-a0f3-232375a56b5b None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:34:02.581631 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d43fc8-9e75-486f-9d60-16cc3edae845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:34:02.582224 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d43fc8-9e75-486f-9d60-16cc3edae845 admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:34:02.582593 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d43fc8-9e75-486f-9d60-16cc3edae845 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:34:02.582801 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d43fc8-9e75-486f-9d60-16cc3edae845 admin admin] PATH_INFO: `/v3/domains` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:34:02.583441 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d43fc8-9e75-486f-9d60-16cc3edae845 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:34:02.583743 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d43fc8-9e75-486f-9d60-16cc3edae845 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:34:02.585325 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d43fc8-9e75-486f-9d60-16cc3edae845 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:34:02.596400 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1389/2782] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 20 22:34:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:34:02.600955 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d89625-723f-48b4-bb23-6fdab6da420d None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:34:02.610121 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d89625-723f-48b4-bb23-6fdab6da420d None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:34:02.615462 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664db704-7a3c-4938-b056-ff7a1e4e9d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:34:02.616049 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664db704-7a3c-4938-b056-ff7a1e4e9d6f admin admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:34:02.616354 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664db704-7a3c-4938-b056-ff7a1e4e9d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:34:02.616622 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664db704-7a3c-4938-b056-ff7a1e4e9d6f admin admin] PATH_INFO: `/v3/projects` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:34:02.617244 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664db704-7a3c-4938-b056-ff7a1e4e9d6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:34:02.619231 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664db704-7a3c-4938-b056-ff7a1e4e9d6f admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:34:02.645913 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1394/2783] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 20 22:34:02 2022] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:34:02.649957 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d43fc8-9e75-486f-9d60-16cc3edae845 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:34:02.660753 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d43fc8-9e75-486f-9d60-16cc3edae845 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:34:02.714551 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb00532f-bbfe-4939-9a2f-83c69d4c03cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:34:02.715087 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb00532f-bbfe-4939-9a2f-83c69d4c03cc admin admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:34:02.715369 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb00532f-bbfe-4939-9a2f-83c69d4c03cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:34:02.715643 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb00532f-bbfe-4939-9a2f-83c69d4c03cc admin admin] PATH_INFO: `/v3/users` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:34:02.716272 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb00532f-bbfe-4939-9a2f-83c69d4c03cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:34:02.718177 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb00532f-bbfe-4939-9a2f-83c69d4c03cc admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:34:02.739800 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1390/2784] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 20 22:34:02 2022] POST /identity/v3/users => generated 292 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:34:02.743883 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664db704-7a3c-4938-b056-ff7a1e4e9d6f admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:34:02.754110 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664db704-7a3c-4938-b056-ff7a1e4e9d6f admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:34:02.758756 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40318724-f388-4cb3-add3-53eaa25f00eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:34:02.759352 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40318724-f388-4cb3-add3-53eaa25f00eb admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:34:02.759631 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40318724-f388-4cb3-add3-53eaa25f00eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:34:02.759904 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40318724-f388-4cb3-add3-53eaa25f00eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:34:02.760545 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40318724-f388-4cb3-add3-53eaa25f00eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:34:02.762133 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40318724-f388-4cb3-add3-53eaa25f00eb admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:34:02.772472 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1395/2785] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:34:02 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 20 22:34:02.776189 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb00532f-bbfe-4939-9a2f-83c69d4c03cc admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:34:02.787113 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb00532f-bbfe-4939-9a2f-83c69d4c03cc admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:34:02.791716 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43faf880-5320-4cbb-874f-fb664a47e535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:34:02.792312 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43faf880-5320-4cbb-874f-fb664a47e535 admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:34:02.792592 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43faf880-5320-4cbb-874f-fb664a47e535 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:34:02.792864 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43faf880-5320-4cbb-874f-fb664a47e535 admin admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:34:02.793500 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43faf880-5320-4cbb-874f-fb664a47e535 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:34:02.795125 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43faf880-5320-4cbb-874f-fb664a47e535 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:34:02.805788 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1391/2786] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:34:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:34:02.810135 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40318724-f388-4cb3-add3-53eaa25f00eb admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:34:02.820206 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40318724-f388-4cb3-add3-53eaa25f00eb admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:34:02.824808 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf0d10f-80a6-4a03-9271-bbe542021478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:34:02.825446 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf0d10f-80a6-4a03-9271-bbe542021478 admin admin] REQUEST_METHOD: `PUT` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:34:02.825724 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf0d10f-80a6-4a03-9271-bbe542021478 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:34:02.825995 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf0d10f-80a6-4a03-9271-bbe542021478 admin admin] PATH_INFO: `/v3/projects/34ffd122b80546b1a4a903c1847b9992/users/4f2bce0cb5c04e1d857e63cf20345c64/roles/604444e7ad0d437dbd1f5a6e02b761f5` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:34:02.841704 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf0d10f-80a6-4a03-9271-bbe542021478 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34ffd122b80546b1a4a903c1847b9992, user_id=4f2bce0cb5c04e1d857e63cf20345c64, role_id=604444e7ad0d437dbd1f5a6e02b761f5)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:34:02.844360 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf0d10f-80a6-4a03-9271-bbe542021478 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:34:02.858256 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1396/2787] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:34:02 2022] PUT /identity/v3/projects/34ffd122b80546b1a4a903c1847b9992/users/4f2bce0cb5c04e1d857e63cf20345c64/roles/604444e7ad0d437dbd1f5a6e02b761f5 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 22:34:02.868673 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a7316-882d-4c87-b70f-5bb35f49da85 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:34:02.868959 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a7316-882d-4c87-b70f-5bb35f49da85 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:34:02.869228 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a7316-882d-4c87-b70f-5bb35f49da85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:34:02.896456 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-ae2a7316-882d-4c87-b70f-5bb35f49da85 None None] MFA Rules not processed for user `4f2bce0cb5c04e1d857e63cf20345c64`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:34:02.897656 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-ae2a7316-882d-4c87-b70f-5bb35f49da85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:34:02.965315 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1392/2788] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:34:02 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:34:02.969839 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf0d10f-80a6-4a03-9271-bbe542021478 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:34:02.990830 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:34:03.032905 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf0d10f-80a6-4a03-9271-bbe542021478 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:34:03.037552 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a733a3e-3132-4e50-bb7c-65319158c956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:34:03.038144 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a733a3e-3132-4e50-bb7c-65319158c956 admin admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:34:03.038421 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a733a3e-3132-4e50-bb7c-65319158c956 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:34:03.038720 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a733a3e-3132-4e50-bb7c-65319158c956 admin admin] PATH_INFO: `/v3/projects` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:34:03.039338 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a733a3e-3132-4e50-bb7c-65319158c956 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:34:03.041209 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a733a3e-3132-4e50-bb7c-65319158c956 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:34:03.069026 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1397/2789] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 20 22:34:02 2022] POST /identity/v3/projects => generated 385 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:34:03.071419 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2a7316-882d-4c87-b70f-5bb35f49da85 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:34:03.082401 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2a7316-882d-4c87-b70f-5bb35f49da85 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:34:03.094992 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:34:03.139808 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1874d1f-667c-43b3-a475-bc599048d433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:34:03.140411 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1874d1f-667c-43b3-a475-bc599048d433 admin admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:34:03.140691 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1874d1f-667c-43b3-a475-bc599048d433 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:34:03.140962 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1874d1f-667c-43b3-a475-bc599048d433 admin admin] PATH_INFO: `/v3/users` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:34:03.141579 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1874d1f-667c-43b3-a475-bc599048d433 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:34:03.143527 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1874d1f-667c-43b3-a475-bc599048d433 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:34:03.165198 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1393/2790] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 20 22:34:03 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 20 22:34:03.169232 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a733a3e-3132-4e50-bb7c-65319158c956 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:34:03.179629 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a733a3e-3132-4e50-bb7c-65319158c956 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:34:03.184302 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3812d8c4-94ed-4e43-b8c0-791cba020cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:34:03.184897 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3812d8c4-94ed-4e43-b8c0-791cba020cc8 admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:34:03.185177 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3812d8c4-94ed-4e43-b8c0-791cba020cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:34:03.185451 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3812d8c4-94ed-4e43-b8c0-791cba020cc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:34:03.186085 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3812d8c4-94ed-4e43-b8c0-791cba020cc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:34:03.187703 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3812d8c4-94ed-4e43-b8c0-791cba020cc8 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:34:03.198562 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1398/2791] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:34:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:34:03.202398 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1874d1f-667c-43b3-a475-bc599048d433 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:34:03.213279 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1874d1f-667c-43b3-a475-bc599048d433 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:34:03.218031 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72030b38-c575-4cb4-b044-e34582eb04df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:34:03.218624 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72030b38-c575-4cb4-b044-e34582eb04df admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:34:03.218911 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72030b38-c575-4cb4-b044-e34582eb04df admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:34:03.219187 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72030b38-c575-4cb4-b044-e34582eb04df admin admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:34:03.219865 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72030b38-c575-4cb4-b044-e34582eb04df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:34:03.221440 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72030b38-c575-4cb4-b044-e34582eb04df admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:34:03.231273 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1394/2792] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:34:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:34:03.235265 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3812d8c4-94ed-4e43-b8c0-791cba020cc8 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:34:03.245001 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3812d8c4-94ed-4e43-b8c0-791cba020cc8 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:34:03.249483 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d75f54-83cc-444f-a2d6-b1e850130eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:34:03.250114 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d75f54-83cc-444f-a2d6-b1e850130eee admin admin] REQUEST_METHOD: `PUT` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:34:03.250389 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d75f54-83cc-444f-a2d6-b1e850130eee admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:34:03.250688 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d75f54-83cc-444f-a2d6-b1e850130eee admin admin] PATH_INFO: `/v3/projects/483248473ea641f8a3a056c78aa809ac/users/9e7f2f4a27914a12888a682e783422b4/roles/604444e7ad0d437dbd1f5a6e02b761f5` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:34:03.266932 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d75f54-83cc-444f-a2d6-b1e850130eee admin admin] RBAC: Authorizing `identity:create_grant(project_id=483248473ea641f8a3a056c78aa809ac, user_id=9e7f2f4a27914a12888a682e783422b4, role_id=604444e7ad0d437dbd1f5a6e02b761f5)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:34:03.270247 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d75f54-83cc-444f-a2d6-b1e850130eee admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:34:03.283153 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1399/2793] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:34:03 2022] PUT /identity/v3/projects/483248473ea641f8a3a056c78aa809ac/users/9e7f2f4a27914a12888a682e783422b4/roles/604444e7ad0d437dbd1f5a6e02b761f5 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:34:03.294594 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b1be0-0f05-4e02-9148-89fa724ac013 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:34:03.294890 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b1be0-0f05-4e02-9148-89fa724ac013 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:34:03.295173 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b1be0-0f05-4e02-9148-89fa724ac013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:34:03.323443 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-e83b1be0-0f05-4e02-9148-89fa724ac013 None None] MFA Rules not processed for user `9e7f2f4a27914a12888a682e783422b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:34:03.324654 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-e83b1be0-0f05-4e02-9148-89fa724ac013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:34:03.388081 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1395/2794] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:34:03 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:34:03.392641 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d75f54-83cc-444f-a2d6-b1e850130eee admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:34:03.453842 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d75f54-83cc-444f-a2d6-b1e850130eee admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:34:03.458478 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f5266d-7784-4f93-91a6-db1104af0f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:34:03.459120 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f5266d-7784-4f93-91a6-db1104af0f7e admin admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:34:03.459402 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f5266d-7784-4f93-91a6-db1104af0f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:34:03.459664 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f5266d-7784-4f93-91a6-db1104af0f7e admin admin] PATH_INFO: `/v3/projects` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:34:03.460277 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f5266d-7784-4f93-91a6-db1104af0f7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:34:03.462136 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f5266d-7784-4f93-91a6-db1104af0f7e admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:34:03.488529 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1400/2795] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 20 22:34:03 2022] POST /identity/v3/projects => generated 383 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 20 22:34:03.492456 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83b1be0-0f05-4e02-9148-89fa724ac013 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:34:03.503855 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83b1be0-0f05-4e02-9148-89fa724ac013 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:34:03.558314 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c37a3f5-4acb-4bf3-a664-ce3f3ddff385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:34:03.558938 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c37a3f5-4acb-4bf3-a664-ce3f3ddff385 admin admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:34:03.559219 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c37a3f5-4acb-4bf3-a664-ce3f3ddff385 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:34:03.559491 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c37a3f5-4acb-4bf3-a664-ce3f3ddff385 admin admin] PATH_INFO: `/v3/users` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:34:03.560119 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c37a3f5-4acb-4bf3-a664-ce3f3ddff385 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:34:03.562049 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c37a3f5-4acb-4bf3-a664-ce3f3ddff385 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:34:03.586856 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1396/2796] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 20 22:34:03 2022] POST /identity/v3/users => generated 298 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:34:03.588041 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f5266d-7784-4f93-91a6-db1104af0f7e admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:34:03.598180 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f5266d-7784-4f93-91a6-db1104af0f7e admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:34:03.602907 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f3f6ee-2f32-40d6-b567-3774524cedc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:34:03.603521 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f3f6ee-2f32-40d6-b567-3774524cedc7 admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:34:03.603780 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f3f6ee-2f32-40d6-b567-3774524cedc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:34:03.604053 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f3f6ee-2f32-40d6-b567-3774524cedc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:34:03.604686 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f3f6ee-2f32-40d6-b567-3774524cedc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:34:03.606272 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f3f6ee-2f32-40d6-b567-3774524cedc7 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:34:03.617284 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1401/2797] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:34:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:34:03.621494 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c37a3f5-4acb-4bf3-a664-ce3f3ddff385 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:34:03.632121 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c37a3f5-4acb-4bf3-a664-ce3f3ddff385 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:34:03.636673 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56efa58b-bc9f-4a11-a717-eede8a4c71f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:34:03.637308 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56efa58b-bc9f-4a11-a717-eede8a4c71f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:34:03.637585 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56efa58b-bc9f-4a11-a717-eede8a4c71f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:34:03.637853 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56efa58b-bc9f-4a11-a717-eede8a4c71f5 admin admin] PATH_INFO: `/v3/projects/6855edeb483f42c7a939f90fb41044d2/users/d7d65434e04f48e7b9243a5591b87be4/roles/8a829170b29d42d6af589399e51edb0f` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:34:03.649945 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:34:03.653267 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56efa58b-bc9f-4a11-a717-eede8a4c71f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6855edeb483f42c7a939f90fb41044d2, user_id=d7d65434e04f48e7b9243a5591b87be4, role_id=8a829170b29d42d6af589399e51edb0f)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:34:03.656336 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56efa58b-bc9f-4a11-a717-eede8a4c71f5 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:34:03.669349 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1397/2798] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:34:03 2022] PUT /identity/v3/projects/6855edeb483f42c7a939f90fb41044d2/users/d7d65434e04f48e7b9243a5591b87be4/roles/8a829170b29d42d6af589399e51edb0f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:34:03.673240 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f3f6ee-2f32-40d6-b567-3774524cedc7 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:34:03.683596 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f3f6ee-2f32-40d6-b567-3774524cedc7 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:34:03.724976 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:34:03.741243 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ee195b-5ef5-46aa-ac31-148b51892ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:34:03.741797 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee195b-5ef5-46aa-ac31-148b51892ebe admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:34:03.742077 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee195b-5ef5-46aa-ac31-148b51892ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:34:03.742347 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee195b-5ef5-46aa-ac31-148b51892ebe admin admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:34:03.743047 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ee195b-5ef5-46aa-ac31-148b51892ebe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:34:03.744686 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ee195b-5ef5-46aa-ac31-148b51892ebe admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:34:03.754410 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1402/2799] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:34:03 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:34:03.758416 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56efa58b-bc9f-4a11-a717-eede8a4c71f5 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:34:03.768423 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56efa58b-bc9f-4a11-a717-eede8a4c71f5 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:34:03.773049 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac80f200-0c58-47df-8de3-5dd8447b9312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:34:03.773732 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac80f200-0c58-47df-8de3-5dd8447b9312 admin admin] REQUEST_METHOD: `PUT` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:34:03.774015 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac80f200-0c58-47df-8de3-5dd8447b9312 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:34:03.774289 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac80f200-0c58-47df-8de3-5dd8447b9312 admin admin] PATH_INFO: `/v3/projects/6855edeb483f42c7a939f90fb41044d2/users/d7d65434e04f48e7b9243a5591b87be4/roles/8a829170b29d42d6af589399e51edb0f` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:34:03.776340 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac80f200-0c58-47df-8de3-5dd8447b9312 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6855edeb483f42c7a939f90fb41044d2, user_id=d7d65434e04f48e7b9243a5591b87be4, role_id=8a829170b29d42d6af589399e51edb0f)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:34:03.779010 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac80f200-0c58-47df-8de3-5dd8447b9312 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:34:03.789907 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1398/2800] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:34:03 2022] PUT /identity/v3/projects/6855edeb483f42c7a939f90fb41044d2/users/d7d65434e04f48e7b9243a5591b87be4/roles/8a829170b29d42d6af589399e51edb0f => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:34:03.799991 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5fa662-46c2-4d4f-86d2-08d9cf77989d None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:34:03.800921 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5fa662-46c2-4d4f-86d2-08d9cf77989d None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:34:03.801269 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5fa662-46c2-4d4f-86d2-08d9cf77989d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:34:03.829166 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-1d5fa662-46c2-4d4f-86d2-08d9cf77989d None None] MFA Rules not processed for user `d7d65434e04f48e7b9243a5591b87be4`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:34:03.830377 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-1d5fa662-46c2-4d4f-86d2-08d9cf77989d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:34:03.896007 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1403/2801] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:34:03 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 22:34:03.907609 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac80f200-0c58-47df-8de3-5dd8447b9312 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:34:03.909855 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-ac80f200-0c58-47df-8de3-5dd8447b9312 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:34:03.967664 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac80f200-0c58-47df-8de3-5dd8447b9312 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:34:03.971509 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aee208-2d9c-4a33-bf2a-57549ee7defd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577c8b14c1f4279beac13b9ba11aba1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:34:03.972733 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aee208-2d9c-4a33-bf2a-57549ee7defd service cinder] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:34:03.972997 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aee208-2d9c-4a33-bf2a-57549ee7defd service cinder] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:34:03.973266 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aee208-2d9c-4a33-bf2a-57549ee7defd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:34:04.027420 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38aee208-2d9c-4a33-bf2a-57549ee7defd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:34:04.028768 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38aee208-2d9c-4a33-bf2a-57549ee7defd service cinder] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:34:04.038310 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1399/2802] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:34:03 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:34:05.538686 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5fa662-46c2-4d4f-86d2-08d9cf77989d None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:34:05.540136 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-1d5fa662-46c2-4d4f-86d2-08d9cf77989d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:34:05.554290 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5fa662-46c2-4d4f-86d2-08d9cf77989d None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:34:05.558038 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee2ff69-bb2d-4378-96da-7d3aac4f71a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577c8b14c1f4279beac13b9ba11aba1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:34:05.558778 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee2ff69-bb2d-4378-96da-7d3aac4f71a9 service cinder] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:34:05.559055 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee2ff69-bb2d-4378-96da-7d3aac4f71a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:34:05.559425 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee2ff69-bb2d-4378-96da-7d3aac4f71a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:34:05.621385 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee2ff69-bb2d-4378-96da-7d3aac4f71a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:34:05.623085 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee2ff69-bb2d-4378-96da-7d3aac4f71a9 service cinder] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:34:05.632242 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1404/2803] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:34:05 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:34:06.148580 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aee208-2d9c-4a33-bf2a-57549ee7defd service cinder] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:34:06.157651 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aee208-2d9c-4a33-bf2a-57549ee7defd service cinder] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:34:06.161259 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07f73bc-d9d8-46ea-bac9-c3b4047655e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577c8b14c1f4279beac13b9ba11aba1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:34:06.161847 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07f73bc-d9d8-46ea-bac9-c3b4047655e2 service cinder] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:34:06.162124 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07f73bc-d9d8-46ea-bac9-c3b4047655e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:34:06.162408 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07f73bc-d9d8-46ea-bac9-c3b4047655e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:34:06.171434 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07f73bc-d9d8-46ea-bac9-c3b4047655e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:34:06.172839 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07f73bc-d9d8-46ea-bac9-c3b4047655e2 service cinder] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:34:06.182116 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1400/2804] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:34:06 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:34:10.040432 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee2ff69-bb2d-4378-96da-7d3aac4f71a9 service cinder] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:34:10.104547 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee2ff69-bb2d-4378-96da-7d3aac4f71a9 service cinder] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:34:10.109005 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f5c82f-1fb0-4a3c-92ab-91158733664d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:34:10.109623 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f5c82f-1fb0-4a3c-92ab-91158733664d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:34:10.109898 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f5c82f-1fb0-4a3c-92ab-91158733664d admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:34:10.110166 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f5c82f-1fb0-4a3c-92ab-91158733664d admin admin] PATH_INFO: `/v3/users/4f2bce0cb5c04e1d857e63cf20345c64` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:34:10.111292 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f5c82f-1fb0-4a3c-92ab-91158733664d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f2bce0cb5c04e1d857e63cf20345c64)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:34:10.113195 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f5c82f-1fb0-4a3c-92ab-91158733664d admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:34:10.117741 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=100 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:34:10.158395 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-94f5c82f-1fb0-4a3c-92ab-91158733664d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f2bce0cb5c04e1d857e63cf20345c64'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:34:10.165983 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-94f5c82f-1fb0-4a3c-92ab-91158733664d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f2bce0cb5c04e1d857e63cf20345c64'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:34:10.166643 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-94f5c82f-1fb0-4a3c-92ab-91158733664d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f2bce0cb5c04e1d857e63cf20345c64'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:34:10.167246 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-94f5c82f-1fb0-4a3c-92ab-91158733664d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f2bce0cb5c04e1d857e63cf20345c64'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:34:10.174207 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-94f5c82f-1fb0-4a3c-92ab-91158733664d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f2bce0cb5c04e1d857e63cf20345c64'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:34:10.190865 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1405/2805] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 20 22:34:10 2022] DELETE /identity/v3/users/4f2bce0cb5c04e1d857e63cf20345c64 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:34:10.195418 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794fd18e-9b33-49cd-bbdb-27c3a92ea85e None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:34:10.195894 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794fd18e-9b33-49cd-bbdb-27c3a92ea85e None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:34:10.196089 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794fd18e-9b33-49cd-bbdb-27c3a92ea85e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:34:10.215189 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-794fd18e-9b33-49cd-bbdb-27c3a92ea85e None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:34:10.216379 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-794fd18e-9b33-49cd-bbdb-27c3a92ea85e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:34:10.273227 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1401/2806] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:34:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:34:10.283072 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f5c82f-1fb0-4a3c-92ab-91158733664d admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:34:10.284495 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-94f5c82f-1fb0-4a3c-92ab-91158733664d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:34:10.342254 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f5c82f-1fb0-4a3c-92ab-91158733664d admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:34:10.345889 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf272403-952e-4b21-91df-fa3056e304b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b0b3ca4ecd41aaba9cf8e0f91fbf54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:34:10.346488 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf272403-952e-4b21-91df-fa3056e304b5 service neutron] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:34:10.346797 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf272403-952e-4b21-91df-fa3056e304b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:34:10.347071 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf272403-952e-4b21-91df-fa3056e304b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:34:10.356563 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf272403-952e-4b21-91df-fa3056e304b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:34:10.357979 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf272403-952e-4b21-91df-fa3056e304b5 service neutron] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:34:10.367291 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1406/2807] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:34:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:34:10.630541 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794fd18e-9b33-49cd-bbdb-27c3a92ea85e None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:34:10.632075 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-794fd18e-9b33-49cd-bbdb-27c3a92ea85e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:34:10.655526 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794fd18e-9b33-49cd-bbdb-27c3a92ea85e None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:34:10.660495 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6864465f-9249-489f-8435-634a4ffff816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:34:10.661131 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6864465f-9249-489f-8435-634a4ffff816 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:34:10.661410 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6864465f-9249-489f-8435-634a4ffff816 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:34:10.661685 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6864465f-9249-489f-8435-634a4ffff816 admin admin] PATH_INFO: `/v3/projects/34ffd122b80546b1a4a903c1847b9992` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:34:10.662824 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6864465f-9249-489f-8435-634a4ffff816 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34ffd122b80546b1a4a903c1847b9992)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:34:10.664730 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6864465f-9249-489f-8435-634a4ffff816 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:34:10.680923 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:34:10.712689 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-6864465f-9249-489f-8435-634a4ffff816 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34ffd122b80546b1a4a903c1847b9992', 'request_id': 'req-6864465f-9249-489f-8435-634a4ffff816'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:34:10.718772 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-6864465f-9249-489f-8435-634a4ffff816 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34ffd122b80546b1a4a903c1847b9992', 'request_id': 'req-6864465f-9249-489f-8435-634a4ffff816'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:34:10.726185 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-6864465f-9249-489f-8435-634a4ffff816 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34ffd122b80546b1a4a903c1847b9992', 'request_id': 'req-6864465f-9249-489f-8435-634a4ffff816'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:34:10.736931 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-6864465f-9249-489f-8435-634a4ffff816 admin admin] The token cache is being invalidate because project 34ffd122b80546b1a4a903c1847b9992 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81307) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 22:34:10.737236 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-6864465f-9249-489f-8435-634a4ffff816 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:34:10.737851 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-6864465f-9249-489f-8435-634a4ffff816 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:34:10.739394 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1402/2808] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 20 22:34:10 2022] DELETE /identity/v3/projects/34ffd122b80546b1a4a903c1847b9992 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:34:10.743493 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf272403-952e-4b21-91df-fa3056e304b5 service neutron] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:34:10.753277 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf272403-952e-4b21-91df-fa3056e304b5 service neutron] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:34:10.809310 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb6b495-8bd3-4342-b3cb-14ba70da13c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:34:10.809870 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb6b495-8bd3-4342-b3cb-14ba70da13c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:34:10.810145 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb6b495-8bd3-4342-b3cb-14ba70da13c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:34:10.810412 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb6b495-8bd3-4342-b3cb-14ba70da13c4 admin admin] PATH_INFO: `/v3/users/9e7f2f4a27914a12888a682e783422b4` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:34:10.811537 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb6b495-8bd3-4342-b3cb-14ba70da13c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e7f2f4a27914a12888a682e783422b4)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:34:10.813466 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb6b495-8bd3-4342-b3cb-14ba70da13c4 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:34:10.841822 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:34:10.859111 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-7bb6b495-8bd3-4342-b3cb-14ba70da13c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e7f2f4a27914a12888a682e783422b4'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:34:10.866448 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-7bb6b495-8bd3-4342-b3cb-14ba70da13c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e7f2f4a27914a12888a682e783422b4'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:34:10.867076 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-7bb6b495-8bd3-4342-b3cb-14ba70da13c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e7f2f4a27914a12888a682e783422b4'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:34:10.867660 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-7bb6b495-8bd3-4342-b3cb-14ba70da13c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e7f2f4a27914a12888a682e783422b4'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:34:10.874351 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-7bb6b495-8bd3-4342-b3cb-14ba70da13c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e7f2f4a27914a12888a682e783422b4'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:34:10.891543 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1407/2809] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 20 22:34:10 2022] DELETE /identity/v3/users/9e7f2f4a27914a12888a682e783422b4 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:34:11.161714 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6864465f-9249-489f-8435-634a4ffff816 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:34:11.163169 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-6864465f-9249-489f-8435-634a4ffff816 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:34:11.175959 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6864465f-9249-489f-8435-634a4ffff816 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:34:11.232633 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8167b0-3d6f-4846-9e86-dd084ac2e2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:34:11.233320 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8167b0-3d6f-4846-9e86-dd084ac2e2b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:34:11.233585 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8167b0-3d6f-4846-9e86-dd084ac2e2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:34:11.233861 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8167b0-3d6f-4846-9e86-dd084ac2e2b6 admin admin] PATH_INFO: `/v3/projects/483248473ea641f8a3a056c78aa809ac` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:34:11.235006 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8167b0-3d6f-4846-9e86-dd084ac2e2b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=483248473ea641f8a3a056c78aa809ac)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:34:11.236920 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8167b0-3d6f-4846-9e86-dd084ac2e2b6 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:34:11.282155 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-0e8167b0-3d6f-4846-9e86-dd084ac2e2b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '483248473ea641f8a3a056c78aa809ac', 'request_id': 'req-0e8167b0-3d6f-4846-9e86-dd084ac2e2b6'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:34:11.288061 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-0e8167b0-3d6f-4846-9e86-dd084ac2e2b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '483248473ea641f8a3a056c78aa809ac', 'request_id': 'req-0e8167b0-3d6f-4846-9e86-dd084ac2e2b6'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:34:11.295401 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-0e8167b0-3d6f-4846-9e86-dd084ac2e2b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '483248473ea641f8a3a056c78aa809ac', 'request_id': 'req-0e8167b0-3d6f-4846-9e86-dd084ac2e2b6'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:34:11.306494 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-0e8167b0-3d6f-4846-9e86-dd084ac2e2b6 admin admin] The token cache is being invalidate because project 483248473ea641f8a3a056c78aa809ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81307) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 22:34:11.306821 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-0e8167b0-3d6f-4846-9e86-dd084ac2e2b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:34:11.307453 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-0e8167b0-3d6f-4846-9e86-dd084ac2e2b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:34:11.308949 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1403/2810] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 20 22:34:11 2022] DELETE /identity/v3/projects/483248473ea641f8a3a056c78aa809ac => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:34:11.313243 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb6b495-8bd3-4342-b3cb-14ba70da13c4 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:34:11.314708 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-7bb6b495-8bd3-4342-b3cb-14ba70da13c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:34:11.327602 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb6b495-8bd3-4342-b3cb-14ba70da13c4 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:34:11.381651 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8212240c-de0d-4894-9f32-2847e49b3dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:34:11.382203 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8212240c-de0d-4894-9f32-2847e49b3dda admin admin] REQUEST_METHOD: `DELETE` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:34:11.382478 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8212240c-de0d-4894-9f32-2847e49b3dda admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:34:11.382778 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8212240c-de0d-4894-9f32-2847e49b3dda admin admin] PATH_INFO: `/v3/users/d7d65434e04f48e7b9243a5591b87be4` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:34:11.383865 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8212240c-de0d-4894-9f32-2847e49b3dda admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7d65434e04f48e7b9243a5591b87be4)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:34:11.385761 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8212240c-de0d-4894-9f32-2847e49b3dda admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:34:11.430293 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-8212240c-de0d-4894-9f32-2847e49b3dda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7d65434e04f48e7b9243a5591b87be4'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:34:11.437582 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-8212240c-de0d-4894-9f32-2847e49b3dda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7d65434e04f48e7b9243a5591b87be4'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:34:11.438224 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-8212240c-de0d-4894-9f32-2847e49b3dda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7d65434e04f48e7b9243a5591b87be4'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:34:11.438850 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-8212240c-de0d-4894-9f32-2847e49b3dda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7d65434e04f48e7b9243a5591b87be4'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:34:11.446391 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-8212240c-de0d-4894-9f32-2847e49b3dda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7d65434e04f48e7b9243a5591b87be4'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:34:11.463963 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1408/2811] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 20 22:34:11 2022] DELETE /identity/v3/users/d7d65434e04f48e7b9243a5591b87be4 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:34:11.728054 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8167b0-3d6f-4846-9e86-dd084ac2e2b6 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:34:11.729473 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-0e8167b0-3d6f-4846-9e86-dd084ac2e2b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:34:11.742691 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8167b0-3d6f-4846-9e86-dd084ac2e2b6 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:34:11.773648 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:34:11.801804 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc80819-c988-466c-b55d-99db888d84eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:34:11.802432 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc80819-c988-466c-b55d-99db888d84eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:34:11.802753 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc80819-c988-466c-b55d-99db888d84eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:34:11.803048 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc80819-c988-466c-b55d-99db888d84eb admin admin] PATH_INFO: `/v3/projects/6855edeb483f42c7a939f90fb41044d2` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:34:11.804154 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc80819-c988-466c-b55d-99db888d84eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=6855edeb483f42c7a939f90fb41044d2)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:34:11.806039 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc80819-c988-466c-b55d-99db888d84eb admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:34:11.851485 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-8bc80819-c988-466c-b55d-99db888d84eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6855edeb483f42c7a939f90fb41044d2', 'request_id': 'req-8bc80819-c988-466c-b55d-99db888d84eb'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:34:11.857977 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-8bc80819-c988-466c-b55d-99db888d84eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6855edeb483f42c7a939f90fb41044d2', 'request_id': 'req-8bc80819-c988-466c-b55d-99db888d84eb'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:34:11.867251 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-8bc80819-c988-466c-b55d-99db888d84eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6855edeb483f42c7a939f90fb41044d2', 'request_id': 'req-8bc80819-c988-466c-b55d-99db888d84eb'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:34:11.878017 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-8bc80819-c988-466c-b55d-99db888d84eb admin admin] The token cache is being invalidate because project 6855edeb483f42c7a939f90fb41044d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81307) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 22:34:11.878354 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-8bc80819-c988-466c-b55d-99db888d84eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:34:11.879633 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-8bc80819-c988-466c-b55d-99db888d84eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:34:11.881089 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1404/2812] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 20 22:34:11 2022] DELETE /identity/v3/projects/6855edeb483f42c7a939f90fb41044d2 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:34:21.460479 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=72,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:34:21.874913 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=36,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:34:40.978326 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8212240c-de0d-4894-9f32-2847e49b3dda admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:34:40.979787 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-8212240c-de0d-4894-9f32-2847e49b3dda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:34:41.035675 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8212240c-de0d-4894-9f32-2847e49b3dda admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:34:41.083280 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937dcd20-1206-4ff0-a03e-4a9bfbf4b5f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577c8b14c1f4279beac13b9ba11aba1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:34:41.083878 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937dcd20-1206-4ff0-a03e-4a9bfbf4b5f6 service cinder] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:34:41.084152 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937dcd20-1206-4ff0-a03e-4a9bfbf4b5f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:34:41.084418 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937dcd20-1206-4ff0-a03e-4a9bfbf4b5f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:34:41.086121 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-937dcd20-1206-4ff0-a03e-4a9bfbf4b5f6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:34:41.153862 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937dcd20-1206-4ff0-a03e-4a9bfbf4b5f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:34:41.155554 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937dcd20-1206-4ff0-a03e-4a9bfbf4b5f6 service cinder] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:34:41.166428 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1409/2813] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:34:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:34:44.978950 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc80819-c988-466c-b55d-99db888d84eb admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:34:44.980387 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-8bc80819-c988-466c-b55d-99db888d84eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:34:45.035733 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc80819-c988-466c-b55d-99db888d84eb admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:34:45.039269 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a950e9ad-f2c3-4075-a900-4899d0463ae7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b0b3ca4ecd41aaba9cf8e0f91fbf54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:34:45.039863 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a950e9ad-f2c3-4075-a900-4899d0463ae7 service neutron] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:34:45.040139 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a950e9ad-f2c3-4075-a900-4899d0463ae7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:34:45.040406 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a950e9ad-f2c3-4075-a900-4899d0463ae7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:34:45.042069 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-a950e9ad-f2c3-4075-a900-4899d0463ae7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:34:45.055363 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a950e9ad-f2c3-4075-a900-4899d0463ae7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:34:45.056807 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a950e9ad-f2c3-4075-a900-4899d0463ae7 service neutron] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:34:45.067964 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1405/2814] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:34:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:34:51.161640 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=74 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:34:55.062704 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=26 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:34:59.459065 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937dcd20-1206-4ff0-a03e-4a9bfbf4b5f6 service cinder] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:34:59.468776 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937dcd20-1206-4ff0-a03e-4a9bfbf4b5f6 service cinder] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:34:59.472380 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328fe700-c141-4e8e-be16-54eac472a3bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b0b3ca4ecd41aaba9cf8e0f91fbf54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:34:59.472979 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328fe700-c141-4e8e-be16-54eac472a3bb service neutron] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:34:59.473258 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328fe700-c141-4e8e-be16-54eac472a3bb service neutron] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:34:59.473535 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328fe700-c141-4e8e-be16-54eac472a3bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:34:59.475284 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-328fe700-c141-4e8e-be16-54eac472a3bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:34:59.484984 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328fe700-c141-4e8e-be16-54eac472a3bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:34:59.486412 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328fe700-c141-4e8e-be16-54eac472a3bb service neutron] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:34:59.494823 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1410/2815] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:34:59 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:35:09.490998 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=6 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:36:55.300117 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a950e9ad-f2c3-4075-a900-4899d0463ae7 service neutron] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:36:55.301667 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-a950e9ad-f2c3-4075-a900-4899d0463ae7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:36:55.320831 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a950e9ad-f2c3-4075-a900-4899d0463ae7 service neutron] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:36:55.328337 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970e76e8-24c0-436a-a89a-36454c91534d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db7eed561e99452289a662ad326cf919', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:36:55.328951 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e76e8-24c0-436a-a89a-36454c91534d service nova] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:36:55.329233 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e76e8-24c0-436a-a89a-36454c91534d service nova] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:36:55.329508 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e76e8-24c0-436a-a89a-36454c91534d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:36:55.332027 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-970e76e8-24c0-436a-a89a-36454c91534d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:36:55.346028 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970e76e8-24c0-436a-a89a-36454c91534d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:36:55.347673 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970e76e8-24c0-436a-a89a-36454c91534d service nova] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:36:55.360792 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1406/2816] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:36:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:36:58.740322 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91bf337-c6d5-46d9-a17a-3f0556df0634 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:36:58.740846 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91bf337-c6d5-46d9-a17a-3f0556df0634 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:36:58.740846 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91bf337-c6d5-46d9-a17a-3f0556df0634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:36:58.759596 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-e91bf337-c6d5-46d9-a17a-3f0556df0634 None None] MFA Rules not processed for user `ae68b69c55854f1badadd69711d839ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:36:58.760814 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-e91bf337-c6d5-46d9-a17a-3f0556df0634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:36:58.815575 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1411/2817] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:36:58 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 22:36:59.111605 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970e76e8-24c0-436a-a89a-36454c91534d service nova] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:36:59.120849 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970e76e8-24c0-436a-a89a-36454c91534d service nova] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:36:59.124562 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e53a38-3aa9-4d35-abb0-3e7f789c1c9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b0b3ca4ecd41aaba9cf8e0f91fbf54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:36:59.125162 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e53a38-3aa9-4d35-abb0-3e7f789c1c9d service neutron] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:36:59.125441 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e53a38-3aa9-4d35-abb0-3e7f789c1c9d service neutron] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:36:59.125711 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e53a38-3aa9-4d35-abb0-3e7f789c1c9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:36:59.127567 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-67e53a38-3aa9-4d35-abb0-3e7f789c1c9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:36:59.137629 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e53a38-3aa9-4d35-abb0-3e7f789c1c9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:36:59.139083 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e53a38-3aa9-4d35-abb0-3e7f789c1c9d service neutron] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:36:59.146890 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1407/2818] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:36:59 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:36:59.469821 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91bf337-c6d5-46d9-a17a-3f0556df0634 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:36:59.471293 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-e91bf337-c6d5-46d9-a17a-3f0556df0634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:36:59.543417 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91bf337-c6d5-46d9-a17a-3f0556df0634 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:36:59.548383 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74556e55-2b5f-4279-9b16-ad3e67a26922 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c79676ee86294dab92ba732e38d6fa74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:36:59.548987 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74556e55-2b5f-4279-9b16-ad3e67a26922 service placement] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:36:59.549266 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74556e55-2b5f-4279-9b16-ad3e67a26922 service placement] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:36:59.549538 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74556e55-2b5f-4279-9b16-ad3e67a26922 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:36:59.551232 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-74556e55-2b5f-4279-9b16-ad3e67a26922 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:36:59.562902 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74556e55-2b5f-4279-9b16-ad3e67a26922 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:36:59.564456 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74556e55-2b5f-4279-9b16-ad3e67a26922 service placement] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:36:59.574843 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1412/2819] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:36:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:37:07.035108 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e53a38-3aa9-4d35-abb0-3e7f789c1c9d service neutron] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:37:07.049459 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e53a38-3aa9-4d35-abb0-3e7f789c1c9d service neutron] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:37:07.054907 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57afc343-c369-4aa6-9de2-20fe145ff18a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db7eed561e99452289a662ad326cf919', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:37:07.055513 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57afc343-c369-4aa6-9de2-20fe145ff18a service nova] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:37:07.055788 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57afc343-c369-4aa6-9de2-20fe145ff18a service nova] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:37:07.056054 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57afc343-c369-4aa6-9de2-20fe145ff18a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:37:07.057764 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-57afc343-c369-4aa6-9de2-20fe145ff18a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:37:07.070457 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57afc343-c369-4aa6-9de2-20fe145ff18a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:37:07.072084 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57afc343-c369-4aa6-9de2-20fe145ff18a service nova] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:37:07.082980 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1408/2820] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:37:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:37:09.570030 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=57 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:37:09.970531 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74556e55-2b5f-4279-9b16-ad3e67a26922 service placement] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:37:09.981031 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74556e55-2b5f-4279-9b16-ad3e67a26922 service placement] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:37:09.986641 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9394506b-72e0-4ee7-8ab8-e3fe6c62d203 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c79676ee86294dab92ba732e38d6fa74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:37:09.987259 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9394506b-72e0-4ee7-8ab8-e3fe6c62d203 service placement] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:37:09.987540 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9394506b-72e0-4ee7-8ab8-e3fe6c62d203 service placement] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:37:09.987832 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9394506b-72e0-4ee7-8ab8-e3fe6c62d203 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:37:09.989571 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-9394506b-72e0-4ee7-8ab8-e3fe6c62d203 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:37:10.001690 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9394506b-72e0-4ee7-8ab8-e3fe6c62d203 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:37:10.003306 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9394506b-72e0-4ee7-8ab8-e3fe6c62d203 service placement] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:37:10.013444 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1413/2821] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:37:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 20 22:37:17.078109 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=18 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:37:20.009802 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=6 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:38:14.543485 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57afc343-c369-4aa6-9de2-20fe145ff18a service nova] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:38:14.545124 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-57afc343-c369-4aa6-9de2-20fe145ff18a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:38:14.559057 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57afc343-c369-4aa6-9de2-20fe145ff18a service nova] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:38:14.564394 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026a8c73-89ca-4765-8a33-bf874c809f50 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db7eed561e99452289a662ad326cf919', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:38:14.564984 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a8c73-89ca-4765-8a33-bf874c809f50 service nova] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:38:14.565286 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a8c73-89ca-4765-8a33-bf874c809f50 service nova] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:38:14.565559 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a8c73-89ca-4765-8a33-bf874c809f50 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:38:14.567745 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-026a8c73-89ca-4765-8a33-bf874c809f50 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:38:14.577557 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026a8c73-89ca-4765-8a33-bf874c809f50 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:38:14.579147 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026a8c73-89ca-4765-8a33-bf874c809f50 service nova] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:38:14.589764 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1409/2822] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:38:14 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:38:24.584517 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=6 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:38:33.417636 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9394506b-72e0-4ee7-8ab8-e3fe6c62d203 service placement] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:38:33.419051 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-9394506b-72e0-4ee7-8ab8-e3fe6c62d203 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:38:33.430365 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9394506b-72e0-4ee7-8ab8-e3fe6c62d203 service placement] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:38:33.433868 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f290034-b8d5-4608-aef9-792b8308ede4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b0b3ca4ecd41aaba9cf8e0f91fbf54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:38:33.434449 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f290034-b8d5-4608-aef9-792b8308ede4 service neutron] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:38:33.434752 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f290034-b8d5-4608-aef9-792b8308ede4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:38:33.435019 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f290034-b8d5-4608-aef9-792b8308ede4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:38:33.436615 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-5f290034-b8d5-4608-aef9-792b8308ede4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:38:33.496740 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f290034-b8d5-4608-aef9-792b8308ede4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:38:33.498148 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f290034-b8d5-4608-aef9-792b8308ede4 service neutron] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:38:33.507492 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1414/2823] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:38:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:38:36.618668 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026a8c73-89ca-4765-8a33-bf874c809f50 service nova] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:38:36.620114 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-026a8c73-89ca-4765-8a33-bf874c809f50 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:38:36.635037 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026a8c73-89ca-4765-8a33-bf874c809f50 service nova] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:38:36.641123 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deed6a18-f350-418b-9eb4-1b4909778ec3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c79676ee86294dab92ba732e38d6fa74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:38:36.641729 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deed6a18-f350-418b-9eb4-1b4909778ec3 service placement] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:38:36.642012 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deed6a18-f350-418b-9eb4-1b4909778ec3 service placement] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:38:36.642286 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deed6a18-f350-418b-9eb4-1b4909778ec3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:38:36.644228 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-deed6a18-f350-418b-9eb4-1b4909778ec3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:38:36.656182 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deed6a18-f350-418b-9eb4-1b4909778ec3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:38:36.658165 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deed6a18-f350-418b-9eb4-1b4909778ec3 service placement] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:38:36.670651 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1410/2824] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:38:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:38:36.676179 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f290034-b8d5-4608-aef9-792b8308ede4 service neutron] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:38:36.677658 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-5f290034-b8d5-4608-aef9-792b8308ede4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:38:36.692676 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f290034-b8d5-4608-aef9-792b8308ede4 service neutron] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:38:36.697520 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426a7640-5e67-4a8d-850e-5e2a70f6c698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:38:36.698254 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426a7640-5e67-4a8d-850e-5e2a70f6c698 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:38:36.698554 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426a7640-5e67-4a8d-850e-5e2a70f6c698 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:38:36.698831 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426a7640-5e67-4a8d-850e-5e2a70f6c698 admin admin] PATH_INFO: `/v3/users/ae68b69c55854f1badadd69711d839ee` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:38:36.699962 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426a7640-5e67-4a8d-850e-5e2a70f6c698 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae68b69c55854f1badadd69711d839ee)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:38:36.701906 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426a7640-5e67-4a8d-850e-5e2a70f6c698 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:38:36.749941 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-426a7640-5e67-4a8d-850e-5e2a70f6c698 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae68b69c55854f1badadd69711d839ee'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:38:36.756701 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-426a7640-5e67-4a8d-850e-5e2a70f6c698 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae68b69c55854f1badadd69711d839ee'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:38:36.757434 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-426a7640-5e67-4a8d-850e-5e2a70f6c698 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae68b69c55854f1badadd69711d839ee'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:38:36.758046 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-426a7640-5e67-4a8d-850e-5e2a70f6c698 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae68b69c55854f1badadd69711d839ee'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:38:36.764978 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-426a7640-5e67-4a8d-850e-5e2a70f6c698 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae68b69c55854f1badadd69711d839ee'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:38:36.781748 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1415/2825] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 20 22:38:36 2022] DELETE /identity/v3/users/ae68b69c55854f1badadd69711d839ee => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:38:36.963372 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deed6a18-f350-418b-9eb4-1b4909778ec3 service placement] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:38:36.973871 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deed6a18-f350-418b-9eb4-1b4909778ec3 service placement] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:38:37.031650 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a6f71a-ded1-4d11-9e5f-38b07e51a338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:38:37.032275 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a6f71a-ded1-4d11-9e5f-38b07e51a338 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:38:37.032553 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a6f71a-ded1-4d11-9e5f-38b07e51a338 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:38:37.032823 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a6f71a-ded1-4d11-9e5f-38b07e51a338 admin admin] PATH_INFO: `/v3/projects/68665d087cc54f2b90524c3d60502328` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:38:37.033921 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a6f71a-ded1-4d11-9e5f-38b07e51a338 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68665d087cc54f2b90524c3d60502328)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:38:37.035840 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a6f71a-ded1-4d11-9e5f-38b07e51a338 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:38:37.082939 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-05a6f71a-ded1-4d11-9e5f-38b07e51a338 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68665d087cc54f2b90524c3d60502328', 'request_id': 'req-05a6f71a-ded1-4d11-9e5f-38b07e51a338'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:38:37.089629 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-05a6f71a-ded1-4d11-9e5f-38b07e51a338 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68665d087cc54f2b90524c3d60502328', 'request_id': 'req-05a6f71a-ded1-4d11-9e5f-38b07e51a338'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:38:37.096959 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-05a6f71a-ded1-4d11-9e5f-38b07e51a338 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68665d087cc54f2b90524c3d60502328', 'request_id': 'req-05a6f71a-ded1-4d11-9e5f-38b07e51a338'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:38:37.108393 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-05a6f71a-ded1-4d11-9e5f-38b07e51a338 admin admin] The token cache is being invalidate because project 68665d087cc54f2b90524c3d60502328 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81307) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 22:38:37.108710 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-05a6f71a-ded1-4d11-9e5f-38b07e51a338 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:38:37.109483 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-05a6f71a-ded1-4d11-9e5f-38b07e51a338 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:38:37.111244 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1411/2826] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 20 22:38:36 2022] DELETE /identity/v3/projects/68665d087cc54f2b90524c3d60502328 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:38:37.116447 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c04e56-d9cc-44ca-9a75-7ff5e956de72 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:38:37.116736 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c04e56-d9cc-44ca-9a75-7ff5e956de72 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:38:37.117015 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c04e56-d9cc-44ca-9a75-7ff5e956de72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:38:37.136230 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-17c04e56-d9cc-44ca-9a75-7ff5e956de72 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:38:37.137424 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-17c04e56-d9cc-44ca-9a75-7ff5e956de72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:38:37.196917 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1416/2827] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:38:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:38:37.204600 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2725d928-fe4f-4b6c-bc08-3e94ff23a412 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:38:37.204882 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2725d928-fe4f-4b6c-bc08-3e94ff23a412 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:38:37.205154 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2725d928-fe4f-4b6c-bc08-3e94ff23a412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:38:37.224820 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-2725d928-fe4f-4b6c-bc08-3e94ff23a412 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:38:37.226663 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-2725d928-fe4f-4b6c-bc08-3e94ff23a412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:38:37.234339 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1412/2828] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:38:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:38:37.238332 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c04e56-d9cc-44ca-9a75-7ff5e956de72 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:38:37.248091 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c04e56-d9cc-44ca-9a75-7ff5e956de72 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:38:37.252707 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e001944-1e87-44e5-8b21-9c7e97bb0cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:38:37.253311 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e001944-1e87-44e5-8b21-9c7e97bb0cf0 admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:38:37.253591 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e001944-1e87-44e5-8b21-9c7e97bb0cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:38:37.253864 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e001944-1e87-44e5-8b21-9c7e97bb0cf0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:38:37.254528 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e001944-1e87-44e5-8b21-9c7e97bb0cf0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:38:37.254837 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e001944-1e87-44e5-8b21-9c7e97bb0cf0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:38:37.256418 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e001944-1e87-44e5-8b21-9c7e97bb0cf0 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:38:37.257846 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:38:37.270316 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1417/2829] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 20 22:38:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:38:37.274988 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2725d928-fe4f-4b6c-bc08-3e94ff23a412 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:38:37.284227 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2725d928-fe4f-4b6c-bc08-3e94ff23a412 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:38:37.295016 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17c12bc-8c0e-4483-b0ce-9ed1a258ff3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:38:37.295874 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17c12bc-8c0e-4483-b0ce-9ed1a258ff3f admin admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:38:37.296465 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17c12bc-8c0e-4483-b0ce-9ed1a258ff3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:38:37.296884 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17c12bc-8c0e-4483-b0ce-9ed1a258ff3f admin admin] PATH_INFO: `/v3/projects` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:38:37.297550 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17c12bc-8c0e-4483-b0ce-9ed1a258ff3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:38:37.299538 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17c12bc-8c0e-4483-b0ce-9ed1a258ff3f admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:38:37.328122 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1413/2830] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 20 22:38:37 2022] POST /identity/v3/projects => generated 383 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:38:37.332279 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e001944-1e87-44e5-8b21-9c7e97bb0cf0 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:38:37.342636 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e001944-1e87-44e5-8b21-9c7e97bb0cf0 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:38:37.399978 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cb1b9f-7b40-4dce-930c-70276da300fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:38:37.400668 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cb1b9f-7b40-4dce-930c-70276da300fb admin admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:38:37.400948 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cb1b9f-7b40-4dce-930c-70276da300fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:38:37.401267 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cb1b9f-7b40-4dce-930c-70276da300fb admin admin] PATH_INFO: `/v3/users` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:38:37.401862 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cb1b9f-7b40-4dce-930c-70276da300fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:38:37.403797 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cb1b9f-7b40-4dce-930c-70276da300fb admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:38:37.425207 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1418/2831] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 20 22:38:37 2022] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:38:37.429304 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17c12bc-8c0e-4483-b0ce-9ed1a258ff3f admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:38:37.439569 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17c12bc-8c0e-4483-b0ce-9ed1a258ff3f admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:38:37.444686 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3ad3d8-4e07-4a72-b71c-4ac9b31f8c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:38:37.445288 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3ad3d8-4e07-4a72-b71c-4ac9b31f8c18 admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:38:37.445568 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3ad3d8-4e07-4a72-b71c-4ac9b31f8c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:38:37.445841 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3ad3d8-4e07-4a72-b71c-4ac9b31f8c18 admin admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:38:37.446489 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3ad3d8-4e07-4a72-b71c-4ac9b31f8c18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:38:37.448471 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3ad3d8-4e07-4a72-b71c-4ac9b31f8c18 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:38:37.459298 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1414/2832] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:38:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 20 22:38:37.463906 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cb1b9f-7b40-4dce-930c-70276da300fb admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:38:37.473668 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cb1b9f-7b40-4dce-930c-70276da300fb admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:38:37.478236 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02d1ef3-3f79-4ed8-8dfd-dd01220be666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:38:37.478866 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02d1ef3-3f79-4ed8-8dfd-dd01220be666 admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:38:37.479148 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02d1ef3-3f79-4ed8-8dfd-dd01220be666 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:38:37.479425 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02d1ef3-3f79-4ed8-8dfd-dd01220be666 admin admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:38:37.480063 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02d1ef3-3f79-4ed8-8dfd-dd01220be666 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:38:37.481639 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02d1ef3-3f79-4ed8-8dfd-dd01220be666 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:38:37.491985 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1419/2833] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:38:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:38:37.495856 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3ad3d8-4e07-4a72-b71c-4ac9b31f8c18 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:38:37.505586 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3ad3d8-4e07-4a72-b71c-4ac9b31f8c18 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:38:37.510613 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80313d7-84d6-4aaa-bb1b-7510b920353b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:38:37.511241 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80313d7-84d6-4aaa-bb1b-7510b920353b admin admin] REQUEST_METHOD: `PUT` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:38:37.511518 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80313d7-84d6-4aaa-bb1b-7510b920353b admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:38:37.511782 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80313d7-84d6-4aaa-bb1b-7510b920353b admin admin] PATH_INFO: `/v3/projects/173174c2a43e47a1bc75756d3c094a04/users/7828b15d44344401b992070e291c4c61/roles/604444e7ad0d437dbd1f5a6e02b761f5` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:38:37.526472 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80313d7-84d6-4aaa-bb1b-7510b920353b admin admin] RBAC: Authorizing `identity:create_grant(project_id=173174c2a43e47a1bc75756d3c094a04, user_id=7828b15d44344401b992070e291c4c61, role_id=604444e7ad0d437dbd1f5a6e02b761f5)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:38:37.529117 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80313d7-84d6-4aaa-bb1b-7510b920353b admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:38:37.541678 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1415/2834] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:38:37 2022] PUT /identity/v3/projects/173174c2a43e47a1bc75756d3c094a04/users/7828b15d44344401b992070e291c4c61/roles/604444e7ad0d437dbd1f5a6e02b761f5 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:38:37.553037 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1ab20d-4040-498d-97c7-a2692f2a23dc None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:38:37.553325 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1ab20d-4040-498d-97c7-a2692f2a23dc None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:38:37.553618 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1ab20d-4040-498d-97c7-a2692f2a23dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:38:37.581073 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-2e1ab20d-4040-498d-97c7-a2692f2a23dc None None] MFA Rules not processed for user `7828b15d44344401b992070e291c4c61`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:38:37.582457 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-2e1ab20d-4040-498d-97c7-a2692f2a23dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:38:37.645021 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1420/2835] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:38:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 22:38:37.650267 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80313d7-84d6-4aaa-bb1b-7510b920353b admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:38:37.664418 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:38:37.713614 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80313d7-84d6-4aaa-bb1b-7510b920353b admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:38:37.718247 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828be193-91d5-4417-8917-5319bdb7e90d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:38:37.718880 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828be193-91d5-4417-8917-5319bdb7e90d admin admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:38:37.719160 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828be193-91d5-4417-8917-5319bdb7e90d admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:38:37.719433 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828be193-91d5-4417-8917-5319bdb7e90d admin admin] PATH_INFO: `/v3/projects` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:38:37.720063 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828be193-91d5-4417-8917-5319bdb7e90d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:38:37.721959 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828be193-91d5-4417-8917-5319bdb7e90d admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:38:37.749066 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1416/2836] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 20 22:38:37 2022] POST /identity/v3/projects => generated 383 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:38:37.753531 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1ab20d-4040-498d-97c7-a2692f2a23dc None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:38:37.764889 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1ab20d-4040-498d-97c7-a2692f2a23dc None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:38:37.823167 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987f65be-61ef-4e0c-8454-849af16e17d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:38:37.823798 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f65be-61ef-4e0c-8454-849af16e17d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:38:37.824071 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f65be-61ef-4e0c-8454-849af16e17d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:38:37.824340 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f65be-61ef-4e0c-8454-849af16e17d5 admin admin] PATH_INFO: `/v3/users` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:38:37.824961 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987f65be-61ef-4e0c-8454-849af16e17d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:38:37.826920 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987f65be-61ef-4e0c-8454-849af16e17d5 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:38:37.836164 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:38:37.852476 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1421/2837] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 20 22:38:37 2022] POST /identity/v3/users => generated 298 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:38:37.853854 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828be193-91d5-4417-8917-5319bdb7e90d admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:38:37.864616 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828be193-91d5-4417-8917-5319bdb7e90d admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:38:37.869308 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be834b0-f657-4bc9-b379-aa535aa2989d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:38:37.869901 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be834b0-f657-4bc9-b379-aa535aa2989d admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:38:37.870175 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be834b0-f657-4bc9-b379-aa535aa2989d admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:38:37.870445 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be834b0-f657-4bc9-b379-aa535aa2989d admin admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:38:37.871111 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be834b0-f657-4bc9-b379-aa535aa2989d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:38:37.872691 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be834b0-f657-4bc9-b379-aa535aa2989d admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:38:37.882956 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1417/2838] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:38:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:38:37.887066 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987f65be-61ef-4e0c-8454-849af16e17d5 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:38:37.896959 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987f65be-61ef-4e0c-8454-849af16e17d5 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:38:37.902019 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61e9d97-b227-4675-b06d-3f1abbce5159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:38:37.902701 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61e9d97-b227-4675-b06d-3f1abbce5159 admin admin] REQUEST_METHOD: `PUT` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:38:37.902980 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61e9d97-b227-4675-b06d-3f1abbce5159 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:38:37.903252 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61e9d97-b227-4675-b06d-3f1abbce5159 admin admin] PATH_INFO: `/v3/projects/4e1c7dff95b34c26b332120f677856c8/users/87b5cb4c78d14209b1dc4ca53e971408/roles/8a829170b29d42d6af589399e51edb0f` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:38:37.918415 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61e9d97-b227-4675-b06d-3f1abbce5159 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e1c7dff95b34c26b332120f677856c8, user_id=87b5cb4c78d14209b1dc4ca53e971408, role_id=8a829170b29d42d6af589399e51edb0f)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:38:37.921078 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61e9d97-b227-4675-b06d-3f1abbce5159 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:38:37.934704 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1422/2839] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:38:37 2022] PUT /identity/v3/projects/4e1c7dff95b34c26b332120f677856c8/users/87b5cb4c78d14209b1dc4ca53e971408/roles/8a829170b29d42d6af589399e51edb0f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:38:37.938801 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be834b0-f657-4bc9-b379-aa535aa2989d admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:38:37.948482 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be834b0-f657-4bc9-b379-aa535aa2989d admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:38:38.003355 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6b2b6a-e19e-41d2-bd41-95eaf25f693b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:38:38.003956 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6b2b6a-e19e-41d2-bd41-95eaf25f693b admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:38:38.004232 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6b2b6a-e19e-41d2-bd41-95eaf25f693b admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:38:38.004499 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6b2b6a-e19e-41d2-bd41-95eaf25f693b admin admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:38:38.005126 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6b2b6a-e19e-41d2-bd41-95eaf25f693b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:38:38.006957 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6b2b6a-e19e-41d2-bd41-95eaf25f693b admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:38:38.016974 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1418/2840] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:38:37 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:38:38.021307 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61e9d97-b227-4675-b06d-3f1abbce5159 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:38:38.032138 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61e9d97-b227-4675-b06d-3f1abbce5159 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:38:38.036719 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788ec903-7616-4cb9-b447-3483ecc099db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:38:38.037361 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ec903-7616-4cb9-b447-3483ecc099db admin admin] REQUEST_METHOD: `PUT` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:38:38.037640 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ec903-7616-4cb9-b447-3483ecc099db admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:38:38.038768 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ec903-7616-4cb9-b447-3483ecc099db admin admin] PATH_INFO: `/v3/projects/4e1c7dff95b34c26b332120f677856c8/users/87b5cb4c78d14209b1dc4ca53e971408/roles/8a829170b29d42d6af589399e51edb0f` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:38:38.040668 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788ec903-7616-4cb9-b447-3483ecc099db admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e1c7dff95b34c26b332120f677856c8, user_id=87b5cb4c78d14209b1dc4ca53e971408, role_id=8a829170b29d42d6af589399e51edb0f)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:38:38.044341 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788ec903-7616-4cb9-b447-3483ecc099db admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:38:38.056651 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1423/2841] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:38:38 2022] PUT /identity/v3/projects/4e1c7dff95b34c26b332120f677856c8/users/87b5cb4c78d14209b1dc4ca53e971408/roles/8a829170b29d42d6af589399e51edb0f => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:38:38.067024 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2920f5b-16ad-4702-8511-edd6d45dc318 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:38:38.067309 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2920f5b-16ad-4702-8511-edd6d45dc318 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:38:38.067581 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2920f5b-16ad-4702-8511-edd6d45dc318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:38:38.095230 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-d2920f5b-16ad-4702-8511-edd6d45dc318 None None] MFA Rules not processed for user `87b5cb4c78d14209b1dc4ca53e971408`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:38:38.096430 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-d2920f5b-16ad-4702-8511-edd6d45dc318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:38:38.163172 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1419/2842] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:38:38 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:38:38.175486 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788ec903-7616-4cb9-b447-3483ecc099db admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:38:38.177185 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-788ec903-7616-4cb9-b447-3483ecc099db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:38:38.239605 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788ec903-7616-4cb9-b447-3483ecc099db admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:38:38.243218 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e394d35-19da-41a3-93ce-e0f7bd235872 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577c8b14c1f4279beac13b9ba11aba1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:38:38.243855 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e394d35-19da-41a3-93ce-e0f7bd235872 service cinder] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:38:38.244134 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e394d35-19da-41a3-93ce-e0f7bd235872 service cinder] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:38:38.244405 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e394d35-19da-41a3-93ce-e0f7bd235872 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:38:38.253909 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e394d35-19da-41a3-93ce-e0f7bd235872 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:38:38.255377 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e394d35-19da-41a3-93ce-e0f7bd235872 service cinder] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:38:38.265433 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1424/2843] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:38:38 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:38:38.398536 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2920f5b-16ad-4702-8511-edd6d45dc318 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:38:38.412144 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2920f5b-16ad-4702-8511-edd6d45dc318 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:38:38.416146 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da37001-5111-45c4-8036-fd7d442cdccf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577c8b14c1f4279beac13b9ba11aba1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:38:38.416703 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da37001-5111-45c4-8036-fd7d442cdccf service cinder] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:38:38.416981 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da37001-5111-45c4-8036-fd7d442cdccf service cinder] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:38:38.417246 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da37001-5111-45c4-8036-fd7d442cdccf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:38:38.422905 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:38:38.490043 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da37001-5111-45c4-8036-fd7d442cdccf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:38:38.491513 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da37001-5111-45c4-8036-fd7d442cdccf service cinder] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:38:38.500400 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1420/2844] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:38:38 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 20 22:38:41.095477 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e394d35-19da-41a3-93ce-e0f7bd235872 service cinder] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:38:41.155450 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e394d35-19da-41a3-93ce-e0f7bd235872 service cinder] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:38:41.159890 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bcdfa3-68d4-49e1-85d1-c3a398b4b992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:38:41.160504 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bcdfa3-68d4-49e1-85d1-c3a398b4b992 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:38:41.160780 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bcdfa3-68d4-49e1-85d1-c3a398b4b992 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:38:41.161050 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bcdfa3-68d4-49e1-85d1-c3a398b4b992 admin admin] PATH_INFO: `/v3/users/7828b15d44344401b992070e291c4c61` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:38:41.162140 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bcdfa3-68d4-49e1-85d1-c3a398b4b992 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7828b15d44344401b992070e291c4c61)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:38:41.164827 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bcdfa3-68d4-49e1-85d1-c3a398b4b992 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:38:41.209451 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-95bcdfa3-68d4-49e1-85d1-c3a398b4b992 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7828b15d44344401b992070e291c4c61'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:38:41.216271 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-95bcdfa3-68d4-49e1-85d1-c3a398b4b992 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7828b15d44344401b992070e291c4c61'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:38:41.216999 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-95bcdfa3-68d4-49e1-85d1-c3a398b4b992 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7828b15d44344401b992070e291c4c61'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:38:41.217602 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-95bcdfa3-68d4-49e1-85d1-c3a398b4b992 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7828b15d44344401b992070e291c4c61'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:38:41.222054 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:INSERT=5,keystone:SELECT=87,keystone:DELETE=8 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:38:41.225269 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-95bcdfa3-68d4-49e1-85d1-c3a398b4b992 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7828b15d44344401b992070e291c4c61'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:38:41.244223 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1425/2845] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 20 22:38:41 2022] DELETE /identity/v3/users/7828b15d44344401b992070e291c4c61 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:38:41.248635 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f857a069-2e59-4383-909a-d4e9349dca20 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:38:41.249113 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f857a069-2e59-4383-909a-d4e9349dca20 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:38:41.249212 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f857a069-2e59-4383-909a-d4e9349dca20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:38:41.267656 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-f857a069-2e59-4383-909a-d4e9349dca20 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:38:41.268842 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-f857a069-2e59-4383-909a-d4e9349dca20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:38:41.328005 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1421/2846] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:38:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:38:41.338164 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bcdfa3-68d4-49e1-85d1-c3a398b4b992 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:38:41.339608 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-95bcdfa3-68d4-49e1-85d1-c3a398b4b992 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:38:41.395543 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bcdfa3-68d4-49e1-85d1-c3a398b4b992 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:38:41.399223 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904e65e6-7563-4830-9a13-ffdda0b7c7f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b0b3ca4ecd41aaba9cf8e0f91fbf54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:38:41.399829 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904e65e6-7563-4830-9a13-ffdda0b7c7f9 service neutron] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:38:41.400104 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904e65e6-7563-4830-9a13-ffdda0b7c7f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:38:41.400372 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904e65e6-7563-4830-9a13-ffdda0b7c7f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:38:41.409280 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904e65e6-7563-4830-9a13-ffdda0b7c7f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:38:41.410740 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904e65e6-7563-4830-9a13-ffdda0b7c7f9 service neutron] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:38:41.420798 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1426/2847] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:38:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:38:41.681786 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f857a069-2e59-4383-909a-d4e9349dca20 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:38:41.683204 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-f857a069-2e59-4383-909a-d4e9349dca20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:38:41.694962 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f857a069-2e59-4383-909a-d4e9349dca20 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:38:41.700503 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5e20ed-41b6-4f07-9f27-8a49e73ce08d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:38:41.701147 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5e20ed-41b6-4f07-9f27-8a49e73ce08d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:38:41.701954 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5e20ed-41b6-4f07-9f27-8a49e73ce08d admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:38:41.702231 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5e20ed-41b6-4f07-9f27-8a49e73ce08d admin admin] PATH_INFO: `/v3/projects/173174c2a43e47a1bc75756d3c094a04` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:38:41.703562 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5e20ed-41b6-4f07-9f27-8a49e73ce08d admin admin] RBAC: Authorizing `identity:delete_project(project_id=173174c2a43e47a1bc75756d3c094a04)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:38:41.705572 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5e20ed-41b6-4f07-9f27-8a49e73ce08d admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:38:41.752197 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-9e5e20ed-41b6-4f07-9f27-8a49e73ce08d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '173174c2a43e47a1bc75756d3c094a04', 'request_id': 'req-9e5e20ed-41b6-4f07-9f27-8a49e73ce08d'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:38:41.758268 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-9e5e20ed-41b6-4f07-9f27-8a49e73ce08d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '173174c2a43e47a1bc75756d3c094a04', 'request_id': 'req-9e5e20ed-41b6-4f07-9f27-8a49e73ce08d'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:38:41.765720 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-9e5e20ed-41b6-4f07-9f27-8a49e73ce08d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '173174c2a43e47a1bc75756d3c094a04', 'request_id': 'req-9e5e20ed-41b6-4f07-9f27-8a49e73ce08d'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:38:41.776509 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-9e5e20ed-41b6-4f07-9f27-8a49e73ce08d admin admin] The token cache is being invalidate because project 173174c2a43e47a1bc75756d3c094a04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81307) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 22:38:41.776811 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-9e5e20ed-41b6-4f07-9f27-8a49e73ce08d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:38:41.777418 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-9e5e20ed-41b6-4f07-9f27-8a49e73ce08d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:38:41.778917 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1422/2848] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 20 22:38:41 2022] DELETE /identity/v3/projects/173174c2a43e47a1bc75756d3c094a04 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:38:41.783069 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904e65e6-7563-4830-9a13-ffdda0b7c7f9 service neutron] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:38:41.794325 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904e65e6-7563-4830-9a13-ffdda0b7c7f9 service neutron] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:38:41.849095 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5e4cd2-276e-494c-ba49-73071ffb91cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:38:41.849721 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5e4cd2-276e-494c-ba49-73071ffb91cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:38:41.850083 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5e4cd2-276e-494c-ba49-73071ffb91cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:38:41.850982 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5e4cd2-276e-494c-ba49-73071ffb91cb admin admin] PATH_INFO: `/v3/users/87b5cb4c78d14209b1dc4ca53e971408` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:38:41.852100 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5e4cd2-276e-494c-ba49-73071ffb91cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=87b5cb4c78d14209b1dc4ca53e971408)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:38:41.854003 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5e4cd2-276e-494c-ba49-73071ffb91cb admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:38:41.899460 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-ab5e4cd2-276e-494c-ba49-73071ffb91cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87b5cb4c78d14209b1dc4ca53e971408'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:38:41.906369 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-ab5e4cd2-276e-494c-ba49-73071ffb91cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87b5cb4c78d14209b1dc4ca53e971408'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:38:41.907026 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-ab5e4cd2-276e-494c-ba49-73071ffb91cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87b5cb4c78d14209b1dc4ca53e971408'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:38:41.907617 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-ab5e4cd2-276e-494c-ba49-73071ffb91cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87b5cb4c78d14209b1dc4ca53e971408'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:38:41.914732 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-ab5e4cd2-276e-494c-ba49-73071ffb91cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87b5cb4c78d14209b1dc4ca53e971408'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:38:41.926968 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:38:41.932241 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1427/2849] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 20 22:38:41 2022] DELETE /identity/v3/users/87b5cb4c78d14209b1dc4ca53e971408 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:38:42.193485 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5e20ed-41b6-4f07-9f27-8a49e73ce08d admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:38:42.195551 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-9e5e20ed-41b6-4f07-9f27-8a49e73ce08d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:38:42.212089 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5e20ed-41b6-4f07-9f27-8a49e73ce08d admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:38:42.241295 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:38:42.271342 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6c7105-1dce-47a4-a1d2-0209926f079d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:38:42.271972 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6c7105-1dce-47a4-a1d2-0209926f079d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:38:42.272826 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6c7105-1dce-47a4-a1d2-0209926f079d admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:38:42.273104 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6c7105-1dce-47a4-a1d2-0209926f079d admin admin] PATH_INFO: `/v3/projects/4e1c7dff95b34c26b332120f677856c8` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:38:42.274218 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6c7105-1dce-47a4-a1d2-0209926f079d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e1c7dff95b34c26b332120f677856c8)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:38:42.276322 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6c7105-1dce-47a4-a1d2-0209926f079d admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:38:42.321835 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-5d6c7105-1dce-47a4-a1d2-0209926f079d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e1c7dff95b34c26b332120f677856c8', 'request_id': 'req-5d6c7105-1dce-47a4-a1d2-0209926f079d'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:38:42.327805 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-5d6c7105-1dce-47a4-a1d2-0209926f079d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e1c7dff95b34c26b332120f677856c8', 'request_id': 'req-5d6c7105-1dce-47a4-a1d2-0209926f079d'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:38:42.335040 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-5d6c7105-1dce-47a4-a1d2-0209926f079d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e1c7dff95b34c26b332120f677856c8', 'request_id': 'req-5d6c7105-1dce-47a4-a1d2-0209926f079d'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:38:42.345152 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-5d6c7105-1dce-47a4-a1d2-0209926f079d admin admin] The token cache is being invalidate because project 4e1c7dff95b34c26b332120f677856c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81307) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 22:38:42.345432 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-5d6c7105-1dce-47a4-a1d2-0209926f079d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:38:42.346049 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-5d6c7105-1dce-47a4-a1d2-0209926f079d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:38:42.347678 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1423/2850] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 20 22:38:42 2022] DELETE /identity/v3/projects/4e1c7dff95b34c26b332120f677856c8 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 22:38:42.352608 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22859792-736a-420e-9ec3-bfb1810a299c None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:38:42.353062 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22859792-736a-420e-9ec3-bfb1810a299c None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:38:42.353179 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22859792-736a-420e-9ec3-bfb1810a299c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:38:42.373288 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-22859792-736a-420e-9ec3-bfb1810a299c None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:38:42.374518 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-22859792-736a-420e-9ec3-bfb1810a299c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:38:42.433498 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1428/2851] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:38:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:38:42.442739 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af20991-abea-441f-8e49-8f8246f85c74 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:38:42.442966 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af20991-abea-441f-8e49-8f8246f85c74 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:38:42.443236 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af20991-abea-441f-8e49-8f8246f85c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:38:42.463139 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-1af20991-abea-441f-8e49-8f8246f85c74 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:38:42.464368 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-1af20991-abea-441f-8e49-8f8246f85c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:38:42.472231 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1424/2852] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:38:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:38:42.476624 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22859792-736a-420e-9ec3-bfb1810a299c None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:38:42.486249 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22859792-736a-420e-9ec3-bfb1810a299c None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:38:42.490801 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652dea8d-df29-4884-afff-b0cb61a722ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:38:42.491905 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652dea8d-df29-4884-afff-b0cb61a722ae admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:38:42.492183 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652dea8d-df29-4884-afff-b0cb61a722ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:38:42.492454 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652dea8d-df29-4884-afff-b0cb61a722ae admin admin] PATH_INFO: `/v3/domains` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:38:42.493094 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652dea8d-df29-4884-afff-b0cb61a722ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:38:42.493397 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652dea8d-df29-4884-afff-b0cb61a722ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:38:42.495016 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652dea8d-df29-4884-afff-b0cb61a722ae admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:38:42.506204 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1429/2853] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 20 22:38:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:38:42.510905 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af20991-abea-441f-8e49-8f8246f85c74 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:38:42.519906 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af20991-abea-441f-8e49-8f8246f85c74 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:38:42.524463 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c77b6aa-ada4-4f2f-90a6-09c89ca3c38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:38:42.525039 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c77b6aa-ada4-4f2f-90a6-09c89ca3c38c admin admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:38:42.525316 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c77b6aa-ada4-4f2f-90a6-09c89ca3c38c admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:38:42.525583 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c77b6aa-ada4-4f2f-90a6-09c89ca3c38c admin admin] PATH_INFO: `/v3/projects` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:38:42.526194 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c77b6aa-ada4-4f2f-90a6-09c89ca3c38c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:38:42.528087 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c77b6aa-ada4-4f2f-90a6-09c89ca3c38c admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:38:42.554532 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1425/2854] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 20 22:38:42 2022] POST /identity/v3/projects => generated 387 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:38:42.558977 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652dea8d-df29-4884-afff-b0cb61a722ae admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:38:42.568876 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652dea8d-df29-4884-afff-b0cb61a722ae admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:38:42.623707 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6be6a5-3bc2-4a7b-9a4e-1e10b2837fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:38:42.624326 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6be6a5-3bc2-4a7b-9a4e-1e10b2837fac admin admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:38:42.624601 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6be6a5-3bc2-4a7b-9a4e-1e10b2837fac admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:38:42.624871 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6be6a5-3bc2-4a7b-9a4e-1e10b2837fac admin admin] PATH_INFO: `/v3/users` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:38:42.625498 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6be6a5-3bc2-4a7b-9a4e-1e10b2837fac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:38:42.627420 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6be6a5-3bc2-4a7b-9a4e-1e10b2837fac admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:38:42.648212 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1430/2855] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 20 22:38:42 2022] POST /identity/v3/users => generated 294 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 20 22:38:42.652321 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c77b6aa-ada4-4f2f-90a6-09c89ca3c38c admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:38:42.663374 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c77b6aa-ada4-4f2f-90a6-09c89ca3c38c admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:38:42.668244 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2b9d11-a113-41da-9e36-fdfac5e9fc9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:38:42.668836 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2b9d11-a113-41da-9e36-fdfac5e9fc9c admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:38:42.669118 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2b9d11-a113-41da-9e36-fdfac5e9fc9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:38:42.669389 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2b9d11-a113-41da-9e36-fdfac5e9fc9c admin admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:38:42.670028 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2b9d11-a113-41da-9e36-fdfac5e9fc9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:38:42.671648 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2b9d11-a113-41da-9e36-fdfac5e9fc9c admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:38:42.681993 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1426/2856] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:38:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:38:42.685850 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6be6a5-3bc2-4a7b-9a4e-1e10b2837fac admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:38:42.695559 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6be6a5-3bc2-4a7b-9a4e-1e10b2837fac admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:38:42.700074 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52614340-cdf0-46ea-8741-1b129e4e503c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:38:42.700654 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52614340-cdf0-46ea-8741-1b129e4e503c admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:38:42.700930 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52614340-cdf0-46ea-8741-1b129e4e503c admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:38:42.701199 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52614340-cdf0-46ea-8741-1b129e4e503c admin admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:38:42.701825 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52614340-cdf0-46ea-8741-1b129e4e503c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:38:42.703415 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52614340-cdf0-46ea-8741-1b129e4e503c admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:38:42.713893 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1431/2857] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:38:42 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:38:42.717832 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2b9d11-a113-41da-9e36-fdfac5e9fc9c admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:38:42.728123 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2b9d11-a113-41da-9e36-fdfac5e9fc9c admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:38:42.732716 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ce733b-fe7e-4474-8e3f-2c9c977dc868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:38:42.733362 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce733b-fe7e-4474-8e3f-2c9c977dc868 admin admin] REQUEST_METHOD: `PUT` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:38:42.733642 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce733b-fe7e-4474-8e3f-2c9c977dc868 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:38:42.733918 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce733b-fe7e-4474-8e3f-2c9c977dc868 admin admin] PATH_INFO: `/v3/projects/3477d9a8d17c43c28c95f6ddab5174a6/users/4e579e40a0c54fc19ccb4b53488222ae/roles/604444e7ad0d437dbd1f5a6e02b761f5` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:38:42.748892 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ce733b-fe7e-4474-8e3f-2c9c977dc868 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3477d9a8d17c43c28c95f6ddab5174a6, user_id=4e579e40a0c54fc19ccb4b53488222ae, role_id=604444e7ad0d437dbd1f5a6e02b761f5)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:38:42.751585 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ce733b-fe7e-4474-8e3f-2c9c977dc868 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:38:42.764092 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1427/2858] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:38:42 2022] PUT /identity/v3/projects/3477d9a8d17c43c28c95f6ddab5174a6/users/4e579e40a0c54fc19ccb4b53488222ae/roles/604444e7ad0d437dbd1f5a6e02b761f5 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:38:42.774124 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d202c3-42b6-4e53-bcfd-f251330e118a None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:38:42.774411 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d202c3-42b6-4e53-bcfd-f251330e118a None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:38:42.774736 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d202c3-42b6-4e53-bcfd-f251330e118a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:38:42.802745 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-65d202c3-42b6-4e53-bcfd-f251330e118a None None] MFA Rules not processed for user `4e579e40a0c54fc19ccb4b53488222ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:38:42.804488 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-65d202c3-42b6-4e53-bcfd-f251330e118a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:38:42.856562 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:38:42.868529 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1432/2859] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:38:42 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 22:38:42.872946 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ce733b-fe7e-4474-8e3f-2c9c977dc868 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:38:42.929977 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:38:42.933700 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ce733b-fe7e-4474-8e3f-2c9c977dc868 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:38:42.939505 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8b9720-964a-4f74-8ea8-a42f05ab2add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:38:42.940118 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8b9720-964a-4f74-8ea8-a42f05ab2add admin admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:38:42.940660 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8b9720-964a-4f74-8ea8-a42f05ab2add admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:38:42.941129 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8b9720-964a-4f74-8ea8-a42f05ab2add admin admin] PATH_INFO: `/v3/projects` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:38:42.941983 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8b9720-964a-4f74-8ea8-a42f05ab2add admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:38:42.943934 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8b9720-964a-4f74-8ea8-a42f05ab2add admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:38:42.970194 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1428/2860] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 20 22:38:42 2022] POST /identity/v3/projects => generated 387 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:38:42.974065 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d202c3-42b6-4e53-bcfd-f251330e118a None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:38:42.985027 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d202c3-42b6-4e53-bcfd-f251330e118a None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:38:43.040417 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb282a8-6c9a-402c-9f59-8a1ce42697e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:38:43.041017 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb282a8-6c9a-402c-9f59-8a1ce42697e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:38:43.041295 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb282a8-6c9a-402c-9f59-8a1ce42697e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:38:43.041570 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb282a8-6c9a-402c-9f59-8a1ce42697e9 admin admin] PATH_INFO: `/v3/users` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:38:43.042197 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb282a8-6c9a-402c-9f59-8a1ce42697e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:38:43.044140 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb282a8-6c9a-402c-9f59-8a1ce42697e9 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:38:43.064226 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1433/2861] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 20 22:38:42 2022] POST /identity/v3/users => generated 300 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:38:43.068239 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8b9720-964a-4f74-8ea8-a42f05ab2add admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:38:43.078952 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8b9720-964a-4f74-8ea8-a42f05ab2add admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:38:43.083723 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c84556f-450e-444f-b9c5-3266feef20dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:38:43.084326 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c84556f-450e-444f-b9c5-3266feef20dd admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:38:43.084608 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c84556f-450e-444f-b9c5-3266feef20dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:38:43.085382 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c84556f-450e-444f-b9c5-3266feef20dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:38:43.086071 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c84556f-450e-444f-b9c5-3266feef20dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:38:43.087712 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c84556f-450e-444f-b9c5-3266feef20dd admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:38:43.098367 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1429/2862] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:38:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:38:43.103156 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb282a8-6c9a-402c-9f59-8a1ce42697e9 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:38:43.113435 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb282a8-6c9a-402c-9f59-8a1ce42697e9 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:38:43.118102 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5252889b-22f0-4ad4-a03d-60d5e7763060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:38:43.118789 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5252889b-22f0-4ad4-a03d-60d5e7763060 admin admin] REQUEST_METHOD: `PUT` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:38:43.119072 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5252889b-22f0-4ad4-a03d-60d5e7763060 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:38:43.119349 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5252889b-22f0-4ad4-a03d-60d5e7763060 admin admin] PATH_INFO: `/v3/projects/dd90007ae936487eab07619972240d16/users/53c41e0bea2345d080c0536e132f5fd8/roles/8a829170b29d42d6af589399e51edb0f` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:38:43.133828 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5252889b-22f0-4ad4-a03d-60d5e7763060 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd90007ae936487eab07619972240d16, user_id=53c41e0bea2345d080c0536e132f5fd8, role_id=8a829170b29d42d6af589399e51edb0f)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:38:43.136510 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5252889b-22f0-4ad4-a03d-60d5e7763060 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:38:43.149472 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1434/2863] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:38:43 2022] PUT /identity/v3/projects/dd90007ae936487eab07619972240d16/users/53c41e0bea2345d080c0536e132f5fd8/roles/8a829170b29d42d6af589399e51edb0f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:38:43.153317 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c84556f-450e-444f-b9c5-3266feef20dd admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:38:43.164435 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c84556f-450e-444f-b9c5-3266feef20dd admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:38:43.219322 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80c3304-e797-4239-affc-63c2d5fbffc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:38:43.219922 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c3304-e797-4239-affc-63c2d5fbffc7 admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:38:43.220255 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c3304-e797-4239-affc-63c2d5fbffc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:38:43.220480 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c3304-e797-4239-affc-63c2d5fbffc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:38:43.221118 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80c3304-e797-4239-affc-63c2d5fbffc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:38:43.222806 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80c3304-e797-4239-affc-63c2d5fbffc7 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:38:43.233064 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1430/2864] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:38:43 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:38:43.237180 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5252889b-22f0-4ad4-a03d-60d5e7763060 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:38:43.247305 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5252889b-22f0-4ad4-a03d-60d5e7763060 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:38:43.251834 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed332a4d-dd36-4cad-b227-d894492913ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:38:43.252471 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed332a4d-dd36-4cad-b227-d894492913ce admin admin] REQUEST_METHOD: `PUT` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:38:43.252749 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed332a4d-dd36-4cad-b227-d894492913ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:38:43.253020 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed332a4d-dd36-4cad-b227-d894492913ce admin admin] PATH_INFO: `/v3/projects/dd90007ae936487eab07619972240d16/users/53c41e0bea2345d080c0536e132f5fd8/roles/8a829170b29d42d6af589399e51edb0f` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:38:43.254965 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed332a4d-dd36-4cad-b227-d894492913ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd90007ae936487eab07619972240d16, user_id=53c41e0bea2345d080c0536e132f5fd8, role_id=8a829170b29d42d6af589399e51edb0f)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:38:43.257586 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed332a4d-dd36-4cad-b227-d894492913ce admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:38:43.267554 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1435/2865] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:38:43 2022] PUT /identity/v3/projects/dd90007ae936487eab07619972240d16/users/53c41e0bea2345d080c0536e132f5fd8/roles/8a829170b29d42d6af589399e51edb0f => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:38:43.277894 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338f9596-42d7-4af7-aa58-0556e3c3091a None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:38:43.278397 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338f9596-42d7-4af7-aa58-0556e3c3091a None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:38:43.279062 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338f9596-42d7-4af7-aa58-0556e3c3091a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:38:43.307101 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-338f9596-42d7-4af7-aa58-0556e3c3091a None None] MFA Rules not processed for user `53c41e0bea2345d080c0536e132f5fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:38:43.308319 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-338f9596-42d7-4af7-aa58-0556e3c3091a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:38:43.374157 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1431/2866] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:38:43 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:38:43.385422 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed332a4d-dd36-4cad-b227-d894492913ce admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:38:43.387217 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-ed332a4d-dd36-4cad-b227-d894492913ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:38:43.448964 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed332a4d-dd36-4cad-b227-d894492913ce admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:38:43.452708 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f430f91c-9573-4c51-883e-a37792dc9a3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577c8b14c1f4279beac13b9ba11aba1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:38:43.453299 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f430f91c-9573-4c51-883e-a37792dc9a3e service cinder] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:38:43.453573 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f430f91c-9573-4c51-883e-a37792dc9a3e service cinder] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:38:43.453842 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f430f91c-9573-4c51-883e-a37792dc9a3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:38:43.463176 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f430f91c-9573-4c51-883e-a37792dc9a3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:38:43.464581 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f430f91c-9573-4c51-883e-a37792dc9a3e service cinder] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:38:43.473784 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1436/2867] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:38:43 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 20 22:38:43.997820 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338f9596-42d7-4af7-aa58-0556e3c3091a None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:38:44.049508 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:38:44.061442 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338f9596-42d7-4af7-aa58-0556e3c3091a None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:38:44.065919 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c82862-b1dc-4cd7-9720-0b8ab0ac0471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:38:44.066568 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c82862-b1dc-4cd7-9720-0b8ab0ac0471 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:38:44.066849 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c82862-b1dc-4cd7-9720-0b8ab0ac0471 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:38:44.067118 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c82862-b1dc-4cd7-9720-0b8ab0ac0471 admin admin] PATH_INFO: `/v3/users/4e579e40a0c54fc19ccb4b53488222ae` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:38:44.068249 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c82862-b1dc-4cd7-9720-0b8ab0ac0471 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e579e40a0c54fc19ccb4b53488222ae)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:38:44.070186 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c82862-b1dc-4cd7-9720-0b8ab0ac0471 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:38:44.117135 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-27c82862-b1dc-4cd7-9720-0b8ab0ac0471 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e579e40a0c54fc19ccb4b53488222ae'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:38:44.123550 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-27c82862-b1dc-4cd7-9720-0b8ab0ac0471 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e579e40a0c54fc19ccb4b53488222ae'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:38:44.124171 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-27c82862-b1dc-4cd7-9720-0b8ab0ac0471 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e579e40a0c54fc19ccb4b53488222ae'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:38:44.124768 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-27c82862-b1dc-4cd7-9720-0b8ab0ac0471 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e579e40a0c54fc19ccb4b53488222ae'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:38:44.132043 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-27c82862-b1dc-4cd7-9720-0b8ab0ac0471 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e579e40a0c54fc19ccb4b53488222ae'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:38:44.149093 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1432/2868] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 20 22:38:43 2022] DELETE /identity/v3/users/4e579e40a0c54fc19ccb4b53488222ae => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:38:44.153676 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b2cff3-d0b7-4f82-b940-4bcf2f67b643 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:38:44.153954 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b2cff3-d0b7-4f82-b940-4bcf2f67b643 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:38:44.154221 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b2cff3-d0b7-4f82-b940-4bcf2f67b643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:38:44.172753 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-70b2cff3-d0b7-4f82-b940-4bcf2f67b643 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:38:44.173941 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-70b2cff3-d0b7-4f82-b940-4bcf2f67b643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:38:44.216397 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:38:44.231643 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1437/2869] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:38:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:38:44.241280 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c82862-b1dc-4cd7-9720-0b8ab0ac0471 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:38:44.242730 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-27c82862-b1dc-4cd7-9720-0b8ab0ac0471 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:38:44.301175 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c82862-b1dc-4cd7-9720-0b8ab0ac0471 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:38:44.304804 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba4ebe8-b489-4fca-8ba1-0f1787a6eb72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b0b3ca4ecd41aaba9cf8e0f91fbf54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:38:44.305428 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba4ebe8-b489-4fca-8ba1-0f1787a6eb72 service neutron] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:38:44.305766 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba4ebe8-b489-4fca-8ba1-0f1787a6eb72 service neutron] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:38:44.306041 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba4ebe8-b489-4fca-8ba1-0f1787a6eb72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:38:44.315037 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba4ebe8-b489-4fca-8ba1-0f1787a6eb72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:38:44.316558 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba4ebe8-b489-4fca-8ba1-0f1787a6eb72 service neutron] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:38:44.326269 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1433/2870] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:38:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:38:44.585862 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b2cff3-d0b7-4f82-b940-4bcf2f67b643 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:38:44.587318 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-70b2cff3-d0b7-4f82-b940-4bcf2f67b643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:38:44.599428 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b2cff3-d0b7-4f82-b940-4bcf2f67b643 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:38:44.604026 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53e0f96-c7ce-4c95-bb0b-e5e0293e3859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:38:44.604657 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53e0f96-c7ce-4c95-bb0b-e5e0293e3859 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:38:44.604934 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53e0f96-c7ce-4c95-bb0b-e5e0293e3859 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:38:44.605210 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53e0f96-c7ce-4c95-bb0b-e5e0293e3859 admin admin] PATH_INFO: `/v3/projects/3477d9a8d17c43c28c95f6ddab5174a6` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:38:44.606333 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53e0f96-c7ce-4c95-bb0b-e5e0293e3859 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3477d9a8d17c43c28c95f6ddab5174a6)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:38:44.608264 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53e0f96-c7ce-4c95-bb0b-e5e0293e3859 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:38:44.654394 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-a53e0f96-c7ce-4c95-bb0b-e5e0293e3859 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3477d9a8d17c43c28c95f6ddab5174a6', 'request_id': 'req-a53e0f96-c7ce-4c95-bb0b-e5e0293e3859'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:38:44.660400 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-a53e0f96-c7ce-4c95-bb0b-e5e0293e3859 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3477d9a8d17c43c28c95f6ddab5174a6', 'request_id': 'req-a53e0f96-c7ce-4c95-bb0b-e5e0293e3859'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:38:44.667183 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-a53e0f96-c7ce-4c95-bb0b-e5e0293e3859 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3477d9a8d17c43c28c95f6ddab5174a6', 'request_id': 'req-a53e0f96-c7ce-4c95-bb0b-e5e0293e3859'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:38:44.677486 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-a53e0f96-c7ce-4c95-bb0b-e5e0293e3859 admin admin] The token cache is being invalidate because project 3477d9a8d17c43c28c95f6ddab5174a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81306) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 22:38:44.677770 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-a53e0f96-c7ce-4c95-bb0b-e5e0293e3859 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:38:44.678960 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-a53e0f96-c7ce-4c95-bb0b-e5e0293e3859 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:38:44.680458 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1438/2871] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 20 22:38:44 2022] DELETE /identity/v3/projects/3477d9a8d17c43c28c95f6ddab5174a6 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:38:44.684409 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba4ebe8-b489-4fca-8ba1-0f1787a6eb72 service neutron] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:38:44.693802 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba4ebe8-b489-4fca-8ba1-0f1787a6eb72 service neutron] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:38:44.749656 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1f052a-9cf5-4096-adc1-c3bcafd9d667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:38:44.750280 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1f052a-9cf5-4096-adc1-c3bcafd9d667 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:38:44.750596 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1f052a-9cf5-4096-adc1-c3bcafd9d667 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:38:44.750855 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1f052a-9cf5-4096-adc1-c3bcafd9d667 admin admin] PATH_INFO: `/v3/users/53c41e0bea2345d080c0536e132f5fd8` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:38:44.752102 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1f052a-9cf5-4096-adc1-c3bcafd9d667 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53c41e0bea2345d080c0536e132f5fd8)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:38:44.754000 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1f052a-9cf5-4096-adc1-c3bcafd9d667 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:38:44.771094 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:38:44.802430 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-4d1f052a-9cf5-4096-adc1-c3bcafd9d667 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53c41e0bea2345d080c0536e132f5fd8'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:38:44.809957 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-4d1f052a-9cf5-4096-adc1-c3bcafd9d667 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53c41e0bea2345d080c0536e132f5fd8'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:38:44.810597 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-4d1f052a-9cf5-4096-adc1-c3bcafd9d667 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53c41e0bea2345d080c0536e132f5fd8'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:38:44.811185 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-4d1f052a-9cf5-4096-adc1-c3bcafd9d667 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53c41e0bea2345d080c0536e132f5fd8'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:38:44.818086 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-4d1f052a-9cf5-4096-adc1-c3bcafd9d667 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53c41e0bea2345d080c0536e132f5fd8'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:38:44.835723 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1434/2872] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 20 22:38:44 2022] DELETE /identity/v3/users/53c41e0bea2345d080c0536e132f5fd8 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:38:45.110969 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53e0f96-c7ce-4c95-bb0b-e5e0293e3859 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:38:45.112710 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-a53e0f96-c7ce-4c95-bb0b-e5e0293e3859 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:38:45.130339 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53e0f96-c7ce-4c95-bb0b-e5e0293e3859 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:38:45.187536 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0accd24c-51f6-448d-b04e-67b65bf3eb5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:38:45.188157 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0accd24c-51f6-448d-b04e-67b65bf3eb5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:38:45.188433 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0accd24c-51f6-448d-b04e-67b65bf3eb5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:38:45.188701 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0accd24c-51f6-448d-b04e-67b65bf3eb5a admin admin] PATH_INFO: `/v3/projects/dd90007ae936487eab07619972240d16` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:38:45.189801 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0accd24c-51f6-448d-b04e-67b65bf3eb5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd90007ae936487eab07619972240d16)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:38:45.191720 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0accd24c-51f6-448d-b04e-67b65bf3eb5a admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:38:45.235713 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-0accd24c-51f6-448d-b04e-67b65bf3eb5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd90007ae936487eab07619972240d16', 'request_id': 'req-0accd24c-51f6-448d-b04e-67b65bf3eb5a'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:38:45.242194 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-0accd24c-51f6-448d-b04e-67b65bf3eb5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd90007ae936487eab07619972240d16', 'request_id': 'req-0accd24c-51f6-448d-b04e-67b65bf3eb5a'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:38:45.249676 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-0accd24c-51f6-448d-b04e-67b65bf3eb5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd90007ae936487eab07619972240d16', 'request_id': 'req-0accd24c-51f6-448d-b04e-67b65bf3eb5a'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:38:45.259705 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-0accd24c-51f6-448d-b04e-67b65bf3eb5a admin admin] The token cache is being invalidate because project dd90007ae936487eab07619972240d16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81306) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 22:38:45.260074 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-0accd24c-51f6-448d-b04e-67b65bf3eb5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:38:45.260685 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-0accd24c-51f6-448d-b04e-67b65bf3eb5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:38:45.262244 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1439/2873] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 20 22:38:45 2022] DELETE /identity/v3/projects/dd90007ae936487eab07619972240d16 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:38:45.267092 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9467cccc-61fc-48b1-8e3e-6bc325fda79f None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:38:45.267378 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9467cccc-61fc-48b1-8e3e-6bc325fda79f None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:38:45.267657 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9467cccc-61fc-48b1-8e3e-6bc325fda79f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:38:45.288489 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-9467cccc-61fc-48b1-8e3e-6bc325fda79f None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:38:45.289897 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-9467cccc-61fc-48b1-8e3e-6bc325fda79f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:38:45.347710 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1435/2874] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:38:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:38:45.357034 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cc6403-22e4-46ea-b726-50339bcc7ade None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:38:45.357371 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cc6403-22e4-46ea-b726-50339bcc7ade None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:38:45.357651 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cc6403-22e4-46ea-b726-50339bcc7ade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:38:45.365248 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:38:45.379500 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-f2cc6403-22e4-46ea-b726-50339bcc7ade None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:38:45.380706 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-f2cc6403-22e4-46ea-b726-50339bcc7ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:38:45.389570 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1440/2875] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:38:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:38:45.394635 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9467cccc-61fc-48b1-8e3e-6bc325fda79f None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:38:45.406360 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9467cccc-61fc-48b1-8e3e-6bc325fda79f None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:38:45.411047 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073b6708-013b-4e5f-a64c-f88a2ecbb070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:38:45.411650 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b6708-013b-4e5f-a64c-f88a2ecbb070 admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:38:45.411932 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b6708-013b-4e5f-a64c-f88a2ecbb070 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:38:45.412204 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b6708-013b-4e5f-a64c-f88a2ecbb070 admin admin] PATH_INFO: `/v3/domains` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:38:45.413494 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073b6708-013b-4e5f-a64c-f88a2ecbb070 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:38:45.414052 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073b6708-013b-4e5f-a64c-f88a2ecbb070 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:38:45.415678 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073b6708-013b-4e5f-a64c-f88a2ecbb070 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:38:45.427278 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1436/2876] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 20 22:38:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:38:45.431740 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cc6403-22e4-46ea-b726-50339bcc7ade None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:38:45.440844 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cc6403-22e4-46ea-b726-50339bcc7ade None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:38:45.445325 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13d0cc5-434f-4377-b3ac-5e4faabb2413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:38:45.445913 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13d0cc5-434f-4377-b3ac-5e4faabb2413 admin admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:38:45.446186 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13d0cc5-434f-4377-b3ac-5e4faabb2413 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:38:45.446454 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13d0cc5-434f-4377-b3ac-5e4faabb2413 admin admin] PATH_INFO: `/v3/projects` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:38:45.447122 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13d0cc5-434f-4377-b3ac-5e4faabb2413 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:38:45.448997 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13d0cc5-434f-4377-b3ac-5e4faabb2413 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:38:45.476383 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1441/2877] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 20 22:38:45 2022] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:38:45.484841 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073b6708-013b-4e5f-a64c-f88a2ecbb070 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:38:45.495345 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073b6708-013b-4e5f-a64c-f88a2ecbb070 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:38:45.551462 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dded68e-ece5-4087-994e-e2dd61768641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:38:45.551991 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dded68e-ece5-4087-994e-e2dd61768641 admin admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:38:45.552272 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dded68e-ece5-4087-994e-e2dd61768641 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:38:45.552549 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dded68e-ece5-4087-994e-e2dd61768641 admin admin] PATH_INFO: `/v3/users` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:38:45.553169 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dded68e-ece5-4087-994e-e2dd61768641 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:38:45.555153 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dded68e-ece5-4087-994e-e2dd61768641 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:38:45.575334 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1437/2878] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 20 22:38:45 2022] POST /identity/v3/users => generated 292 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:38:45.579751 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13d0cc5-434f-4377-b3ac-5e4faabb2413 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:38:45.590461 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13d0cc5-434f-4377-b3ac-5e4faabb2413 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:38:45.595250 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e289f8-ebc7-48ce-b7c6-ab8737e4de61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:38:45.595848 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e289f8-ebc7-48ce-b7c6-ab8737e4de61 admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:38:45.596122 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e289f8-ebc7-48ce-b7c6-ab8737e4de61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:38:45.596394 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e289f8-ebc7-48ce-b7c6-ab8737e4de61 admin admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:38:45.597028 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e289f8-ebc7-48ce-b7c6-ab8737e4de61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:38:45.598629 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e289f8-ebc7-48ce-b7c6-ab8737e4de61 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:38:45.609158 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1442/2879] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:38:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:38:45.612875 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dded68e-ece5-4087-994e-e2dd61768641 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:38:45.622533 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dded68e-ece5-4087-994e-e2dd61768641 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:38:45.627204 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c016f576-c27d-4f25-834c-42570fdf7b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:38:45.627789 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c016f576-c27d-4f25-834c-42570fdf7b21 admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:38:45.628070 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c016f576-c27d-4f25-834c-42570fdf7b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:38:45.628337 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c016f576-c27d-4f25-834c-42570fdf7b21 admin admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:38:45.628968 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c016f576-c27d-4f25-834c-42570fdf7b21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:38:45.630565 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c016f576-c27d-4f25-834c-42570fdf7b21 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:38:45.636177 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:38:45.642789 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1438/2880] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:38:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 20 22:38:45.646002 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e289f8-ebc7-48ce-b7c6-ab8737e4de61 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:38:45.656307 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e289f8-ebc7-48ce-b7c6-ab8737e4de61 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:38:45.660902 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3be71da-a371-4799-a5fe-0f7e7368774b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:38:45.661535 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3be71da-a371-4799-a5fe-0f7e7368774b admin admin] REQUEST_METHOD: `PUT` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:38:45.661813 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3be71da-a371-4799-a5fe-0f7e7368774b admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:38:45.662082 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3be71da-a371-4799-a5fe-0f7e7368774b admin admin] PATH_INFO: `/v3/projects/574cab15c81242de9b577a34779b10cf/users/1373236b11714682aec35e4be4edae4e/roles/604444e7ad0d437dbd1f5a6e02b761f5` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:38:45.676537 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3be71da-a371-4799-a5fe-0f7e7368774b admin admin] RBAC: Authorizing `identity:create_grant(project_id=574cab15c81242de9b577a34779b10cf, user_id=1373236b11714682aec35e4be4edae4e, role_id=604444e7ad0d437dbd1f5a6e02b761f5)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:38:45.679219 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3be71da-a371-4799-a5fe-0f7e7368774b admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:38:45.691290 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1443/2881] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:38:45 2022] PUT /identity/v3/projects/574cab15c81242de9b577a34779b10cf/users/1373236b11714682aec35e4be4edae4e/roles/604444e7ad0d437dbd1f5a6e02b761f5 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 22:38:45.701915 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3d1cbe-65da-453e-92b8-a40abf5c6394 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:38:45.702204 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3d1cbe-65da-453e-92b8-a40abf5c6394 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:38:45.702479 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3d1cbe-65da-453e-92b8-a40abf5c6394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:38:45.730424 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-5a3d1cbe-65da-453e-92b8-a40abf5c6394 None None] MFA Rules not processed for user `1373236b11714682aec35e4be4edae4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:38:45.731646 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-5a3d1cbe-65da-453e-92b8-a40abf5c6394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:38:45.794052 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1439/2882] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:38:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:38:45.798463 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3be71da-a371-4799-a5fe-0f7e7368774b admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:38:45.859637 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3be71da-a371-4799-a5fe-0f7e7368774b admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:38:45.864144 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfe0a38-38e7-4e0f-8b30-83e7962eab5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:38:45.864734 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfe0a38-38e7-4e0f-8b30-83e7962eab5d admin admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:38:45.865012 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfe0a38-38e7-4e0f-8b30-83e7962eab5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:38:45.865283 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfe0a38-38e7-4e0f-8b30-83e7962eab5d admin admin] PATH_INFO: `/v3/projects` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:38:45.865958 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfe0a38-38e7-4e0f-8b30-83e7962eab5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:38:45.868364 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfe0a38-38e7-4e0f-8b30-83e7962eab5d admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:38:45.894824 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1444/2883] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 20 22:38:45 2022] POST /identity/v3/projects => generated 381 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:38:45.898875 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3d1cbe-65da-453e-92b8-a40abf5c6394 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:38:45.909661 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3d1cbe-65da-453e-92b8-a40abf5c6394 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:38:45.964543 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64214677-e37c-45ba-9dac-00bb6f66943c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:38:45.965152 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64214677-e37c-45ba-9dac-00bb6f66943c admin admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:38:45.965419 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64214677-e37c-45ba-9dac-00bb6f66943c admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:38:45.965690 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64214677-e37c-45ba-9dac-00bb6f66943c admin admin] PATH_INFO: `/v3/users` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:38:45.966324 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64214677-e37c-45ba-9dac-00bb6f66943c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:38:45.968254 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64214677-e37c-45ba-9dac-00bb6f66943c admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:38:45.988072 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1440/2884] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 20 22:38:45 2022] POST /identity/v3/users => generated 297 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:38:45.992728 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfe0a38-38e7-4e0f-8b30-83e7962eab5d admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:38:46.003708 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfe0a38-38e7-4e0f-8b30-83e7962eab5d admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:38:46.008637 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf791f51-1684-465d-97cc-9d8c10474583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:38:46.009235 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf791f51-1684-465d-97cc-9d8c10474583 admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:38:46.009510 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf791f51-1684-465d-97cc-9d8c10474583 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:38:46.009780 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf791f51-1684-465d-97cc-9d8c10474583 admin admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:38:46.010415 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf791f51-1684-465d-97cc-9d8c10474583 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:38:46.012018 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf791f51-1684-465d-97cc-9d8c10474583 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:38:46.023039 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1445/2885] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:38:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:38:46.027245 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64214677-e37c-45ba-9dac-00bb6f66943c admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:38:46.037140 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64214677-e37c-45ba-9dac-00bb6f66943c admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:38:46.042524 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23ce48c-1e9e-4669-b843-62d721beef06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:38:46.043212 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23ce48c-1e9e-4669-b843-62d721beef06 admin admin] REQUEST_METHOD: `PUT` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:38:46.043493 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23ce48c-1e9e-4669-b843-62d721beef06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:38:46.043766 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23ce48c-1e9e-4669-b843-62d721beef06 admin admin] PATH_INFO: `/v3/projects/9249872cdd0b40d1b96ef77259bf0b43/users/3d65ed23a9824386bfe74645a0d9ba9f/roles/8a829170b29d42d6af589399e51edb0f` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:38:46.059525 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23ce48c-1e9e-4669-b843-62d721beef06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9249872cdd0b40d1b96ef77259bf0b43, user_id=3d65ed23a9824386bfe74645a0d9ba9f, role_id=8a829170b29d42d6af589399e51edb0f)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:38:46.062147 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23ce48c-1e9e-4669-b843-62d721beef06 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:38:46.074184 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1441/2886] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:38:46 2022] PUT /identity/v3/projects/9249872cdd0b40d1b96ef77259bf0b43/users/3d65ed23a9824386bfe74645a0d9ba9f/roles/8a829170b29d42d6af589399e51edb0f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:38:46.078015 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf791f51-1684-465d-97cc-9d8c10474583 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:38:46.088251 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf791f51-1684-465d-97cc-9d8c10474583 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:38:46.145325 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a18c7e2-1a13-4ae2-9e72-c0f091237c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:38:46.145851 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a18c7e2-1a13-4ae2-9e72-c0f091237c49 admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:38:46.146130 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a18c7e2-1a13-4ae2-9e72-c0f091237c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:38:46.146401 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a18c7e2-1a13-4ae2-9e72-c0f091237c49 admin admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:38:46.147072 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a18c7e2-1a13-4ae2-9e72-c0f091237c49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:38:46.149163 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a18c7e2-1a13-4ae2-9e72-c0f091237c49 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:38:46.158813 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1446/2887] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:38:46 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:38:46.164167 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23ce48c-1e9e-4669-b843-62d721beef06 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:38:46.174216 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23ce48c-1e9e-4669-b843-62d721beef06 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:38:46.178798 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a76d29-043f-4371-96df-caff6cdd6fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:38:46.179437 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a76d29-043f-4371-96df-caff6cdd6fc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:38:46.179714 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a76d29-043f-4371-96df-caff6cdd6fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:38:46.179989 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a76d29-043f-4371-96df-caff6cdd6fc6 admin admin] PATH_INFO: `/v3/projects/9249872cdd0b40d1b96ef77259bf0b43/users/3d65ed23a9824386bfe74645a0d9ba9f/roles/8a829170b29d42d6af589399e51edb0f` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:38:46.181876 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a76d29-043f-4371-96df-caff6cdd6fc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9249872cdd0b40d1b96ef77259bf0b43, user_id=3d65ed23a9824386bfe74645a0d9ba9f, role_id=8a829170b29d42d6af589399e51edb0f)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:38:46.184493 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a76d29-043f-4371-96df-caff6cdd6fc6 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:38:46.194358 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1442/2888] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:38:46 2022] PUT /identity/v3/projects/9249872cdd0b40d1b96ef77259bf0b43/users/3d65ed23a9824386bfe74645a0d9ba9f/roles/8a829170b29d42d6af589399e51edb0f => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:38:46.205208 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7077d1-397a-4f33-b0e4-b15737ce02f8 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:38:46.205497 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7077d1-397a-4f33-b0e4-b15737ce02f8 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:38:46.205778 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7077d1-397a-4f33-b0e4-b15737ce02f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:38:46.226012 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:38:46.236008 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-6f7077d1-397a-4f33-b0e4-b15737ce02f8 None None] MFA Rules not processed for user `3d65ed23a9824386bfe74645a0d9ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:38:46.237228 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-6f7077d1-397a-4f33-b0e4-b15737ce02f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:38:46.304231 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1447/2889] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:38:46 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:38:46.315467 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a76d29-043f-4371-96df-caff6cdd6fc6 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:38:46.317195 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-71a76d29-043f-4371-96df-caff6cdd6fc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:38:46.367782 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:38:46.380347 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a76d29-043f-4371-96df-caff6cdd6fc6 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:38:46.384407 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945150e4-109e-4d5b-9115-16036c8be210 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577c8b14c1f4279beac13b9ba11aba1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:38:46.385003 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945150e4-109e-4d5b-9115-16036c8be210 service cinder] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:38:46.385281 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945150e4-109e-4d5b-9115-16036c8be210 service cinder] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:38:46.385551 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945150e4-109e-4d5b-9115-16036c8be210 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:38:46.394412 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945150e4-109e-4d5b-9115-16036c8be210 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:38:46.395918 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945150e4-109e-4d5b-9115-16036c8be210 service cinder] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:38:46.405895 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1443/2890] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:38:46 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:38:46.478437 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7077d1-397a-4f33-b0e4-b15737ce02f8 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:38:46.488094 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7077d1-397a-4f33-b0e4-b15737ce02f8 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:38:46.492331 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fb520d-aa24-46bd-b78c-33899e80242e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577c8b14c1f4279beac13b9ba11aba1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:38:46.492925 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fb520d-aa24-46bd-b78c-33899e80242e service cinder] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:38:46.493207 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fb520d-aa24-46bd-b78c-33899e80242e service cinder] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:38:46.493481 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fb520d-aa24-46bd-b78c-33899e80242e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:38:46.549109 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fb520d-aa24-46bd-b78c-33899e80242e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:38:46.550538 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fb520d-aa24-46bd-b78c-33899e80242e service cinder] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:38:46.559913 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1448/2891] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:38:46 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:38:46.872100 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945150e4-109e-4d5b-9115-16036c8be210 service cinder] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:38:46.932417 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945150e4-109e-4d5b-9115-16036c8be210 service cinder] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:38:46.936786 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc84fb06-def1-49fd-aaad-64c7956ea0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:38:46.937410 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc84fb06-def1-49fd-aaad-64c7956ea0a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:38:46.937689 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc84fb06-def1-49fd-aaad-64c7956ea0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:38:46.937960 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc84fb06-def1-49fd-aaad-64c7956ea0a2 admin admin] PATH_INFO: `/v3/users/1373236b11714682aec35e4be4edae4e` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:38:46.939078 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc84fb06-def1-49fd-aaad-64c7956ea0a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1373236b11714682aec35e4be4edae4e)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:38:46.940978 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc84fb06-def1-49fd-aaad-64c7956ea0a2 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:38:46.986191 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-fc84fb06-def1-49fd-aaad-64c7956ea0a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1373236b11714682aec35e4be4edae4e'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:38:46.993606 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-fc84fb06-def1-49fd-aaad-64c7956ea0a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1373236b11714682aec35e4be4edae4e'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:38:46.994316 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-fc84fb06-def1-49fd-aaad-64c7956ea0a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1373236b11714682aec35e4be4edae4e'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:38:46.994939 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-fc84fb06-def1-49fd-aaad-64c7956ea0a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1373236b11714682aec35e4be4edae4e'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:38:47.001775 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-fc84fb06-def1-49fd-aaad-64c7956ea0a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1373236b11714682aec35e4be4edae4e'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:38:47.018693 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1444/2892] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 20 22:38:46 2022] DELETE /identity/v3/users/1373236b11714682aec35e4be4edae4e => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:38:47.023806 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e45e7-ea14-4e51-869b-6aeb049cd178 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:38:47.024265 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e45e7-ea14-4e51-869b-6aeb049cd178 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:38:47.024386 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e45e7-ea14-4e51-869b-6aeb049cd178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:38:47.043824 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-fe1e45e7-ea14-4e51-869b-6aeb049cd178 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:38:47.045016 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-fe1e45e7-ea14-4e51-869b-6aeb049cd178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:38:47.102178 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1449/2893] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:38:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:38:47.112271 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc84fb06-def1-49fd-aaad-64c7956ea0a2 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:38:47.113708 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-fc84fb06-def1-49fd-aaad-64c7956ea0a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:38:47.169959 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc84fb06-def1-49fd-aaad-64c7956ea0a2 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:38:47.173557 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3551e95-afda-425f-81af-2fb084303f58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b0b3ca4ecd41aaba9cf8e0f91fbf54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:38:47.174161 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3551e95-afda-425f-81af-2fb084303f58 service neutron] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:38:47.174443 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3551e95-afda-425f-81af-2fb084303f58 service neutron] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:38:47.174742 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3551e95-afda-425f-81af-2fb084303f58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:38:47.183566 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3551e95-afda-425f-81af-2fb084303f58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:38:47.184922 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3551e95-afda-425f-81af-2fb084303f58 service neutron] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:38:47.194690 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1445/2894] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:38:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 20 22:38:47.467096 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1e45e7-ea14-4e51-869b-6aeb049cd178 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:38:47.468584 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-fe1e45e7-ea14-4e51-869b-6aeb049cd178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:38:47.481023 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1e45e7-ea14-4e51-869b-6aeb049cd178 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:38:47.485675 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225acd4c-98da-4ad3-b632-42fce10b5bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:38:47.486306 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225acd4c-98da-4ad3-b632-42fce10b5bbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:38:47.486622 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225acd4c-98da-4ad3-b632-42fce10b5bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:38:47.486899 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225acd4c-98da-4ad3-b632-42fce10b5bbf admin admin] PATH_INFO: `/v3/projects/574cab15c81242de9b577a34779b10cf` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:38:47.488148 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225acd4c-98da-4ad3-b632-42fce10b5bbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=574cab15c81242de9b577a34779b10cf)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:38:47.490047 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225acd4c-98da-4ad3-b632-42fce10b5bbf admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:38:47.522873 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:38:47.538230 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-225acd4c-98da-4ad3-b632-42fce10b5bbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '574cab15c81242de9b577a34779b10cf', 'request_id': 'req-225acd4c-98da-4ad3-b632-42fce10b5bbf'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:38:47.544666 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-225acd4c-98da-4ad3-b632-42fce10b5bbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '574cab15c81242de9b577a34779b10cf', 'request_id': 'req-225acd4c-98da-4ad3-b632-42fce10b5bbf'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:38:47.551789 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-225acd4c-98da-4ad3-b632-42fce10b5bbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '574cab15c81242de9b577a34779b10cf', 'request_id': 'req-225acd4c-98da-4ad3-b632-42fce10b5bbf'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:38:47.564938 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-225acd4c-98da-4ad3-b632-42fce10b5bbf admin admin] The token cache is being invalidate because project 574cab15c81242de9b577a34779b10cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81306) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 22:38:47.565231 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-225acd4c-98da-4ad3-b632-42fce10b5bbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:38:47.565862 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-225acd4c-98da-4ad3-b632-42fce10b5bbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:38:47.567365 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1450/2895] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 20 22:38:47 2022] DELETE /identity/v3/projects/574cab15c81242de9b577a34779b10cf => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:38:47.572009 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3551e95-afda-425f-81af-2fb084303f58 service neutron] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:38:47.581474 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3551e95-afda-425f-81af-2fb084303f58 service neutron] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:38:47.585005 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:38:47.638641 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e1b771-2d68-4313-b7fe-fcdfdda0e6c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:38:47.639258 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e1b771-2d68-4313-b7fe-fcdfdda0e6c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:38:47.639581 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e1b771-2d68-4313-b7fe-fcdfdda0e6c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:38:47.639849 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e1b771-2d68-4313-b7fe-fcdfdda0e6c6 admin admin] PATH_INFO: `/v3/users/3d65ed23a9824386bfe74645a0d9ba9f` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:38:47.640948 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e1b771-2d68-4313-b7fe-fcdfdda0e6c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d65ed23a9824386bfe74645a0d9ba9f)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:38:47.642890 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e1b771-2d68-4313-b7fe-fcdfdda0e6c6 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:38:47.687084 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-67e1b771-2d68-4313-b7fe-fcdfdda0e6c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d65ed23a9824386bfe74645a0d9ba9f'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:38:47.694718 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-67e1b771-2d68-4313-b7fe-fcdfdda0e6c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d65ed23a9824386bfe74645a0d9ba9f'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:38:47.695334 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-67e1b771-2d68-4313-b7fe-fcdfdda0e6c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d65ed23a9824386bfe74645a0d9ba9f'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:38:47.695938 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-67e1b771-2d68-4313-b7fe-fcdfdda0e6c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d65ed23a9824386bfe74645a0d9ba9f'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:38:47.702890 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-67e1b771-2d68-4313-b7fe-fcdfdda0e6c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d65ed23a9824386bfe74645a0d9ba9f'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:38:47.719507 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1446/2896] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 20 22:38:47 2022] DELETE /identity/v3/users/3d65ed23a9824386bfe74645a0d9ba9f => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:38:47.984201 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225acd4c-98da-4ad3-b632-42fce10b5bbf admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:38:47.985723 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-225acd4c-98da-4ad3-b632-42fce10b5bbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:38:48.000161 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225acd4c-98da-4ad3-b632-42fce10b5bbf admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:38:48.057576 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6620c2-9b13-4b54-8973-3a67cc41d1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:38:48.058187 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6620c2-9b13-4b54-8973-3a67cc41d1a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:38:48.058466 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6620c2-9b13-4b54-8973-3a67cc41d1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:38:48.058760 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6620c2-9b13-4b54-8973-3a67cc41d1a8 admin admin] PATH_INFO: `/v3/projects/9249872cdd0b40d1b96ef77259bf0b43` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:38:48.059870 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6620c2-9b13-4b54-8973-3a67cc41d1a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9249872cdd0b40d1b96ef77259bf0b43)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:38:48.061776 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6620c2-9b13-4b54-8973-3a67cc41d1a8 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:38:48.106524 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-bc6620c2-9b13-4b54-8973-3a67cc41d1a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9249872cdd0b40d1b96ef77259bf0b43', 'request_id': 'req-bc6620c2-9b13-4b54-8973-3a67cc41d1a8'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:38:48.112955 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-bc6620c2-9b13-4b54-8973-3a67cc41d1a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9249872cdd0b40d1b96ef77259bf0b43', 'request_id': 'req-bc6620c2-9b13-4b54-8973-3a67cc41d1a8'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:38:48.120302 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-bc6620c2-9b13-4b54-8973-3a67cc41d1a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9249872cdd0b40d1b96ef77259bf0b43', 'request_id': 'req-bc6620c2-9b13-4b54-8973-3a67cc41d1a8'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:38:48.130774 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-bc6620c2-9b13-4b54-8973-3a67cc41d1a8 admin admin] The token cache is being invalidate because project 9249872cdd0b40d1b96ef77259bf0b43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81306) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 22:38:48.131060 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-bc6620c2-9b13-4b54-8973-3a67cc41d1a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:38:48.131708 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-bc6620c2-9b13-4b54-8973-3a67cc41d1a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:38:48.133160 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1451/2897] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 20 22:38:47 2022] DELETE /identity/v3/projects/9249872cdd0b40d1b96ef77259bf0b43 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:38:48.138211 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61539d67-75d0-47de-884d-f77547446c87 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:38:48.138499 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61539d67-75d0-47de-884d-f77547446c87 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:38:48.138806 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61539d67-75d0-47de-884d-f77547446c87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:38:48.157871 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-61539d67-75d0-47de-884d-f77547446c87 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:38:48.159104 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-61539d67-75d0-47de-884d-f77547446c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:38:48.219509 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1447/2898] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:38:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:38:48.227490 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b46a853-4b66-46cb-bb28-69e43ebf7b12 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:38:48.227715 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b46a853-4b66-46cb-bb28-69e43ebf7b12 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:38:48.228011 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b46a853-4b66-46cb-bb28-69e43ebf7b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:38:48.247865 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-5b46a853-4b66-46cb-bb28-69e43ebf7b12 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:38:48.249046 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-5b46a853-4b66-46cb-bb28-69e43ebf7b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:38:48.257070 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1452/2899] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:38:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:38:48.261269 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61539d67-75d0-47de-884d-f77547446c87 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:38:48.271169 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61539d67-75d0-47de-884d-f77547446c87 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:38:48.276478 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bb5336-db25-4215-a356-5e2e94a3694f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:38:48.277076 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb5336-db25-4215-a356-5e2e94a3694f admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:38:48.277357 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb5336-db25-4215-a356-5e2e94a3694f admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:38:48.277649 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb5336-db25-4215-a356-5e2e94a3694f admin admin] PATH_INFO: `/v3/domains` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:38:48.278299 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bb5336-db25-4215-a356-5e2e94a3694f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81307) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:38:48.278640 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bb5336-db25-4215-a356-5e2e94a3694f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:38:48.280233 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bb5336-db25-4215-a356-5e2e94a3694f admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:38:48.292404 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1448/2900] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 20 22:38:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:38:48.296891 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b46a853-4b66-46cb-bb28-69e43ebf7b12 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:38:48.306072 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b46a853-4b66-46cb-bb28-69e43ebf7b12 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:38:48.310747 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74c4850-7113-4f09-9d8d-9f26bd316f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:38:48.311347 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74c4850-7113-4f09-9d8d-9f26bd316f1c admin admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:38:48.311625 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74c4850-7113-4f09-9d8d-9f26bd316f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:38:48.311896 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74c4850-7113-4f09-9d8d-9f26bd316f1c admin admin] PATH_INFO: `/v3/projects` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:38:48.312528 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74c4850-7113-4f09-9d8d-9f26bd316f1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:38:48.314405 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74c4850-7113-4f09-9d8d-9f26bd316f1c admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:38:48.341544 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1453/2901] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 20 22:38:48 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:38:48.345792 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bb5336-db25-4215-a356-5e2e94a3694f admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:38:48.356329 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bb5336-db25-4215-a356-5e2e94a3694f admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:38:48.364987 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:38:48.421648 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7c4f90-62a5-471d-b015-8ae224815dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:38:48.422256 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7c4f90-62a5-471d-b015-8ae224815dfc admin admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:38:48.422567 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7c4f90-62a5-471d-b015-8ae224815dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:38:48.422845 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7c4f90-62a5-471d-b015-8ae224815dfc admin admin] PATH_INFO: `/v3/users` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:38:48.423476 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7c4f90-62a5-471d-b015-8ae224815dfc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:38:48.425425 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7c4f90-62a5-471d-b015-8ae224815dfc admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:38:48.445701 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1449/2902] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 20 22:38:48 2022] POST /identity/v3/users => generated 287 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 20 22:38:48.449831 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74c4850-7113-4f09-9d8d-9f26bd316f1c admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:38:48.460537 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74c4850-7113-4f09-9d8d-9f26bd316f1c admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:38:48.465217 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bc4930-8a44-4b0c-b472-bf7c93c507dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:38:48.465832 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bc4930-8a44-4b0c-b472-bf7c93c507dc admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:38:48.466105 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bc4930-8a44-4b0c-b472-bf7c93c507dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:38:48.466370 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bc4930-8a44-4b0c-b472-bf7c93c507dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:38:48.467062 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bc4930-8a44-4b0c-b472-bf7c93c507dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:38:48.468642 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bc4930-8a44-4b0c-b472-bf7c93c507dc admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:38:48.479013 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1454/2903] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:38:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:38:48.482868 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7c4f90-62a5-471d-b015-8ae224815dfc admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:38:48.492612 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7c4f90-62a5-471d-b015-8ae224815dfc admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:38:48.497186 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a01fc9-a120-4969-9769-51bfc51e4fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:38:48.497773 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a01fc9-a120-4969-9769-51bfc51e4fa4 admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:38:48.498053 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a01fc9-a120-4969-9769-51bfc51e4fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:38:48.498323 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a01fc9-a120-4969-9769-51bfc51e4fa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:38:48.498992 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a01fc9-a120-4969-9769-51bfc51e4fa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:38:48.500573 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a01fc9-a120-4969-9769-51bfc51e4fa4 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:38:48.510934 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1450/2904] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:38:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:38:48.514770 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bc4930-8a44-4b0c-b472-bf7c93c507dc admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:38:48.525048 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bc4930-8a44-4b0c-b472-bf7c93c507dc admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:38:48.529594 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1787d11d-8083-483a-96d1-d644dbe5bdb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:38:48.530230 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1787d11d-8083-483a-96d1-d644dbe5bdb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:38:48.530526 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1787d11d-8083-483a-96d1-d644dbe5bdb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:38:48.530809 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1787d11d-8083-483a-96d1-d644dbe5bdb9 admin admin] PATH_INFO: `/v3/projects/f698d68dfbc04d4097ab3fa7fe254ed6/users/43e3876c4e1d46378af0fdfd6906067e/roles/604444e7ad0d437dbd1f5a6e02b761f5` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:38:48.532982 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:38:48.548301 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1787d11d-8083-483a-96d1-d644dbe5bdb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f698d68dfbc04d4097ab3fa7fe254ed6, user_id=43e3876c4e1d46378af0fdfd6906067e, role_id=604444e7ad0d437dbd1f5a6e02b761f5)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:38:48.550980 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1787d11d-8083-483a-96d1-d644dbe5bdb9 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:38:48.563714 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1455/2905] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:38:48 2022] PUT /identity/v3/projects/f698d68dfbc04d4097ab3fa7fe254ed6/users/43e3876c4e1d46378af0fdfd6906067e/roles/604444e7ad0d437dbd1f5a6e02b761f5 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:38:48.569605 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986e2160-7c81-4b79-a589-10f957cc0645 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:38:48.569905 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986e2160-7c81-4b79-a589-10f957cc0645 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:38:48.570187 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986e2160-7c81-4b79-a589-10f957cc0645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:38:48.589743 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-986e2160-7c81-4b79-a589-10f957cc0645 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:38:48.590971 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-986e2160-7c81-4b79-a589-10f957cc0645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:38:48.648623 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1451/2906] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:38:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 22:38:48.658307 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1787d11d-8083-483a-96d1-d644dbe5bdb9 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:38:48.659999 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-1787d11d-8083-483a-96d1-d644dbe5bdb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:38:48.718134 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1787d11d-8083-483a-96d1-d644dbe5bdb9 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:38:48.721809 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9124dab-6085-49cf-81ad-f72d9547cfbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b0b3ca4ecd41aaba9cf8e0f91fbf54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:38:48.722427 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9124dab-6085-49cf-81ad-f72d9547cfbc service neutron] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:38:48.722731 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9124dab-6085-49cf-81ad-f72d9547cfbc service neutron] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:38:48.723000 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9124dab-6085-49cf-81ad-f72d9547cfbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:38:48.732371 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9124dab-6085-49cf-81ad-f72d9547cfbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:38:48.733713 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9124dab-6085-49cf-81ad-f72d9547cfbc service neutron] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:38:48.743558 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1456/2907] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:38:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:38:49.347945 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe38eec7-cd0b-4fce-946b-4cd216af3de3 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:38:49.348252 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe38eec7-cd0b-4fce-946b-4cd216af3de3 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:38:49.348521 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe38eec7-cd0b-4fce-946b-4cd216af3de3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:38:49.377312 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-fe38eec7-cd0b-4fce-946b-4cd216af3de3 None None] MFA Rules not processed for user `43e3876c4e1d46378af0fdfd6906067e`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:38:49.379001 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-fe38eec7-cd0b-4fce-946b-4cd216af3de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:38:49.445128 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1452/2908] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:38:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 22:38:49.449388 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9124dab-6085-49cf-81ad-f72d9547cfbc service neutron] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:38:49.458995 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9124dab-6085-49cf-81ad-f72d9547cfbc service neutron] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:38:49.464208 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8e8d8b-724b-4a0e-bc5d-1f69ba059256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:38:49.464804 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e8d8b-724b-4a0e-bc5d-1f69ba059256 admin admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:38:49.465078 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e8d8b-724b-4a0e-bc5d-1f69ba059256 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:38:49.465346 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e8d8b-724b-4a0e-bc5d-1f69ba059256 admin admin] PATH_INFO: `/v3/projects` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:38:49.465977 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8e8d8b-724b-4a0e-bc5d-1f69ba059256 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:38:49.467882 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8e8d8b-724b-4a0e-bc5d-1f69ba059256 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:38:49.494013 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1457/2909] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 20 22:38:49 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 20 22:38:49.497922 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe38eec7-cd0b-4fce-946b-4cd216af3de3 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:38:49.509712 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe38eec7-cd0b-4fce-946b-4cd216af3de3 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:38:49.529435 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:38:49.568067 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cdcff6-ecec-43e2-89c1-d683b6d10941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:38:49.568699 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cdcff6-ecec-43e2-89c1-d683b6d10941 admin admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:38:49.569497 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cdcff6-ecec-43e2-89c1-d683b6d10941 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:38:49.569777 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cdcff6-ecec-43e2-89c1-d683b6d10941 admin admin] PATH_INFO: `/v3/users` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:38:49.570391 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cdcff6-ecec-43e2-89c1-d683b6d10941 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:38:49.572320 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cdcff6-ecec-43e2-89c1-d683b6d10941 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:38:49.592599 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1453/2910] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 20 22:38:49 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 20 22:38:49.596607 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8e8d8b-724b-4a0e-bc5d-1f69ba059256 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:38:49.606686 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8e8d8b-724b-4a0e-bc5d-1f69ba059256 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:38:49.611195 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bbd403-2f3f-4c29-949b-a54f63fda2c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:38:49.611806 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bbd403-2f3f-4c29-949b-a54f63fda2c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:38:49.612085 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bbd403-2f3f-4c29-949b-a54f63fda2c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:38:49.612353 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bbd403-2f3f-4c29-949b-a54f63fda2c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:38:49.612979 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bbd403-2f3f-4c29-949b-a54f63fda2c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:38:49.614573 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bbd403-2f3f-4c29-949b-a54f63fda2c9 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:38:49.625104 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1458/2911] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:38:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:38:49.629291 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cdcff6-ecec-43e2-89c1-d683b6d10941 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:38:49.639720 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cdcff6-ecec-43e2-89c1-d683b6d10941 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:38:49.644269 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478cdd35-645d-4034-8d77-c724066e18c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:38:49.644918 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478cdd35-645d-4034-8d77-c724066e18c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:38:49.645201 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478cdd35-645d-4034-8d77-c724066e18c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:38:49.645476 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478cdd35-645d-4034-8d77-c724066e18c1 admin admin] PATH_INFO: `/v3/projects/f1900637cdb24c3389678214f9f1b719/users/aa52f70a50124fecb2f82e838f81da22/roles/8a829170b29d42d6af589399e51edb0f` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:38:49.660447 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478cdd35-645d-4034-8d77-c724066e18c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1900637cdb24c3389678214f9f1b719, user_id=aa52f70a50124fecb2f82e838f81da22, role_id=8a829170b29d42d6af589399e51edb0f)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:38:49.663147 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478cdd35-645d-4034-8d77-c724066e18c1 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:38:49.676111 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1454/2912] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:38:49 2022] PUT /identity/v3/projects/f1900637cdb24c3389678214f9f1b719/users/aa52f70a50124fecb2f82e838f81da22/roles/8a829170b29d42d6af589399e51edb0f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:38:49.680025 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bbd403-2f3f-4c29-949b-a54f63fda2c9 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:38:49.690908 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bbd403-2f3f-4c29-949b-a54f63fda2c9 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:38:49.747186 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e23505f-dba2-4b9e-8128-a53d78be745f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:38:49.747789 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e23505f-dba2-4b9e-8128-a53d78be745f admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:38:49.748072 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e23505f-dba2-4b9e-8128-a53d78be745f admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:38:49.748346 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e23505f-dba2-4b9e-8128-a53d78be745f admin admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:38:49.748979 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e23505f-dba2-4b9e-8128-a53d78be745f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:38:49.750597 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e23505f-dba2-4b9e-8128-a53d78be745f admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:38:49.760646 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1459/2913] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:38:49 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:38:49.764776 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478cdd35-645d-4034-8d77-c724066e18c1 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:38:49.775700 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478cdd35-645d-4034-8d77-c724066e18c1 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:38:49.780885 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6029779-c2b5-4c20-8259-42cf8ea065e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:38:49.781469 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6029779-c2b5-4c20-8259-42cf8ea065e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:38:49.781744 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6029779-c2b5-4c20-8259-42cf8ea065e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:38:49.782018 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6029779-c2b5-4c20-8259-42cf8ea065e2 admin admin] PATH_INFO: `/v3/projects/f1900637cdb24c3389678214f9f1b719/users/aa52f70a50124fecb2f82e838f81da22/roles/8a829170b29d42d6af589399e51edb0f` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:38:49.784025 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6029779-c2b5-4c20-8259-42cf8ea065e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1900637cdb24c3389678214f9f1b719, user_id=aa52f70a50124fecb2f82e838f81da22, role_id=8a829170b29d42d6af589399e51edb0f)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:38:49.786647 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6029779-c2b5-4c20-8259-42cf8ea065e2 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:38:49.796727 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1455/2914] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:38:49 2022] PUT /identity/v3/projects/f1900637cdb24c3389678214f9f1b719/users/aa52f70a50124fecb2f82e838f81da22/roles/8a829170b29d42d6af589399e51edb0f => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:38:50.405536 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1783d02b-0500-4a86-b6ea-f75a0adfcc49 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:38:50.405914 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1783d02b-0500-4a86-b6ea-f75a0adfcc49 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:38:50.406265 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1783d02b-0500-4a86-b6ea-f75a0adfcc49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:38:50.435641 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-1783d02b-0500-4a86-b6ea-f75a0adfcc49 None None] MFA Rules not processed for user `aa52f70a50124fecb2f82e838f81da22`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:38:50.436990 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-1783d02b-0500-4a86-b6ea-f75a0adfcc49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:38:50.477245 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:38:50.509643 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1460/2915] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:38:50 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:38:50.519907 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd54b932-ec44-46e7-b1f4-5d222f5ac19d None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:38:50.520194 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd54b932-ec44-46e7-b1f4-5d222f5ac19d None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:38:50.520464 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd54b932-ec44-46e7-b1f4-5d222f5ac19d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:38:50.540566 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-bd54b932-ec44-46e7-b1f4-5d222f5ac19d None None] MFA Rules not processed for user `43e3876c4e1d46378af0fdfd6906067e`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:38:50.541771 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-bd54b932-ec44-46e7-b1f4-5d222f5ac19d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:38:50.595043 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1456/2916] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:38:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:38:50.608421 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1783d02b-0500-4a86-b6ea-f75a0adfcc49 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:38:50.610036 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-1783d02b-0500-4a86-b6ea-f75a0adfcc49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:38:50.686306 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1783d02b-0500-4a86-b6ea-f75a0adfcc49 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:38:50.691760 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7492ff05-53dc-4055-b468-84aafa244899 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db7eed561e99452289a662ad326cf919', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:38:50.692362 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7492ff05-53dc-4055-b468-84aafa244899 service nova] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:38:50.692642 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7492ff05-53dc-4055-b468-84aafa244899 service nova] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:38:50.692913 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7492ff05-53dc-4055-b468-84aafa244899 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:38:50.701168 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7492ff05-53dc-4055-b468-84aafa244899 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:38:50.702780 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7492ff05-53dc-4055-b468-84aafa244899 service nova] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:38:50.711842 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1461/2917] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:38:50 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:38:50.936057 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd54b932-ec44-46e7-b1f4-5d222f5ac19d None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:38:50.988574 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd54b932-ec44-46e7-b1f4-5d222f5ac19d None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:38:50.992665 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1549efe6-6b1c-4682-b94e-87fdbe53d169 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b0b3ca4ecd41aaba9cf8e0f91fbf54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:38:50.993257 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1549efe6-6b1c-4682-b94e-87fdbe53d169 service neutron] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:38:50.993538 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1549efe6-6b1c-4682-b94e-87fdbe53d169 service neutron] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:38:50.993808 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1549efe6-6b1c-4682-b94e-87fdbe53d169 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:38:50.995548 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-1549efe6-6b1c-4682-b94e-87fdbe53d169 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:38:51.004879 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1549efe6-6b1c-4682-b94e-87fdbe53d169 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:38:51.006295 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1549efe6-6b1c-4682-b94e-87fdbe53d169 service neutron] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:38:51.014233 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1457/2918] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:38:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:39:00.707488 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=46 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:39:01.010766 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=85,keystone:INSERT=5 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:39:03.691113 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7492ff05-53dc-4055-b468-84aafa244899 service nova] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:39:03.692550 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-7492ff05-53dc-4055-b468-84aafa244899 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:39:03.748850 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7492ff05-53dc-4055-b468-84aafa244899 service nova] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:39:03.752459 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df26b7dc-1d09-428c-8f78-6b869f8171ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577c8b14c1f4279beac13b9ba11aba1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:39:03.753061 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df26b7dc-1d09-428c-8f78-6b869f8171ff service cinder] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:39:03.753336 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df26b7dc-1d09-428c-8f78-6b869f8171ff service cinder] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:39:03.753632 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df26b7dc-1d09-428c-8f78-6b869f8171ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:39:03.762828 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df26b7dc-1d09-428c-8f78-6b869f8171ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:39:03.764249 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df26b7dc-1d09-428c-8f78-6b869f8171ff service cinder] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:39:03.774008 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1462/2919] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:39:03 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:39:13.769622 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=26 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:39:21.592849 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1549efe6-6b1c-4682-b94e-87fdbe53d169 service neutron] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:39:21.594299 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-1549efe6-6b1c-4682-b94e-87fdbe53d169 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:39:21.667254 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1549efe6-6b1c-4682-b94e-87fdbe53d169 service neutron] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:39:21.672214 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb1c2e4-19f0-4ce8-9e5f-79901a05a2ac service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c79676ee86294dab92ba732e38d6fa74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:39:21.672856 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb1c2e4-19f0-4ce8-9e5f-79901a05a2ac service placement] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:39:21.673166 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb1c2e4-19f0-4ce8-9e5f-79901a05a2ac service placement] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:39:21.673457 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb1c2e4-19f0-4ce8-9e5f-79901a05a2ac service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:39:21.675207 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-2cb1c2e4-19f0-4ce8-9e5f-79901a05a2ac service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:39:21.687088 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb1c2e4-19f0-4ce8-9e5f-79901a05a2ac service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:39:21.688954 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb1c2e4-19f0-4ce8-9e5f-79901a05a2ac service placement] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:39:21.700141 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1458/2920] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:39:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:39:22.152880 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df26b7dc-1d09-428c-8f78-6b869f8171ff service cinder] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:39:22.215655 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df26b7dc-1d09-428c-8f78-6b869f8171ff service cinder] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:39:22.220239 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34625d9a-ae50-4f91-b7ac-88dd9d2660fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:39:22.220862 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34625d9a-ae50-4f91-b7ac-88dd9d2660fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:39:22.221158 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34625d9a-ae50-4f91-b7ac-88dd9d2660fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:39:22.221418 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34625d9a-ae50-4f91-b7ac-88dd9d2660fd admin admin] PATH_INFO: `/v3/users/43e3876c4e1d46378af0fdfd6906067e` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:39:22.222551 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34625d9a-ae50-4f91-b7ac-88dd9d2660fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=43e3876c4e1d46378af0fdfd6906067e)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:39:22.224475 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34625d9a-ae50-4f91-b7ac-88dd9d2660fd admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:39:22.269814 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-34625d9a-ae50-4f91-b7ac-88dd9d2660fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43e3876c4e1d46378af0fdfd6906067e'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:39:22.277213 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-34625d9a-ae50-4f91-b7ac-88dd9d2660fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43e3876c4e1d46378af0fdfd6906067e'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:39:22.277828 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-34625d9a-ae50-4f91-b7ac-88dd9d2660fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43e3876c4e1d46378af0fdfd6906067e'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:39:22.278424 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-34625d9a-ae50-4f91-b7ac-88dd9d2660fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43e3876c4e1d46378af0fdfd6906067e'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:39:22.285316 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-34625d9a-ae50-4f91-b7ac-88dd9d2660fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43e3876c4e1d46378af0fdfd6906067e'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:39:22.303577 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1463/2921] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 20 22:39:22 2022] DELETE /identity/v3/users/43e3876c4e1d46378af0fdfd6906067e => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:39:22.479376 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb1c2e4-19f0-4ce8-9e5f-79901a05a2ac service placement] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:39:22.491719 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb1c2e4-19f0-4ce8-9e5f-79901a05a2ac service placement] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:39:22.548388 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61e4de9-06b4-475c-84d0-829edaed9da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:39:22.549015 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61e4de9-06b4-475c-84d0-829edaed9da5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:39:22.549294 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61e4de9-06b4-475c-84d0-829edaed9da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:39:22.549561 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61e4de9-06b4-475c-84d0-829edaed9da5 admin admin] PATH_INFO: `/v3/projects/f698d68dfbc04d4097ab3fa7fe254ed6` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:39:22.550820 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61e4de9-06b4-475c-84d0-829edaed9da5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f698d68dfbc04d4097ab3fa7fe254ed6)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:39:22.552662 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61e4de9-06b4-475c-84d0-829edaed9da5 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:39:22.598352 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-e61e4de9-06b4-475c-84d0-829edaed9da5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f698d68dfbc04d4097ab3fa7fe254ed6', 'request_id': 'req-e61e4de9-06b4-475c-84d0-829edaed9da5'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:39:22.604464 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-e61e4de9-06b4-475c-84d0-829edaed9da5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f698d68dfbc04d4097ab3fa7fe254ed6', 'request_id': 'req-e61e4de9-06b4-475c-84d0-829edaed9da5'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:39:22.611294 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-e61e4de9-06b4-475c-84d0-829edaed9da5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f698d68dfbc04d4097ab3fa7fe254ed6', 'request_id': 'req-e61e4de9-06b4-475c-84d0-829edaed9da5'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:39:22.621404 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-e61e4de9-06b4-475c-84d0-829edaed9da5 admin admin] The token cache is being invalidate because project f698d68dfbc04d4097ab3fa7fe254ed6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81307) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 22:39:22.621687 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-e61e4de9-06b4-475c-84d0-829edaed9da5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:39:22.622299 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-e61e4de9-06b4-475c-84d0-829edaed9da5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:39:22.623775 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1459/2922] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 20 22:39:22 2022] DELETE /identity/v3/projects/f698d68dfbc04d4097ab3fa7fe254ed6 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:39:22.627768 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34625d9a-ae50-4f91-b7ac-88dd9d2660fd admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:39:22.629148 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-34625d9a-ae50-4f91-b7ac-88dd9d2660fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:39:22.642418 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34625d9a-ae50-4f91-b7ac-88dd9d2660fd admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:39:22.699073 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4968ba-241c-467b-8154-30054b397b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:39:22.699701 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4968ba-241c-467b-8154-30054b397b72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:39:22.699975 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4968ba-241c-467b-8154-30054b397b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:39:22.700243 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4968ba-241c-467b-8154-30054b397b72 admin admin] PATH_INFO: `/v3/users/aa52f70a50124fecb2f82e838f81da22` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:39:22.701379 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4968ba-241c-467b-8154-30054b397b72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa52f70a50124fecb2f82e838f81da22)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:39:22.703322 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4968ba-241c-467b-8154-30054b397b72 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:39:22.728960 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:39:22.760576 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-8f4968ba-241c-467b-8154-30054b397b72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa52f70a50124fecb2f82e838f81da22'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:39:22.767729 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-8f4968ba-241c-467b-8154-30054b397b72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa52f70a50124fecb2f82e838f81da22'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:39:22.768344 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-8f4968ba-241c-467b-8154-30054b397b72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa52f70a50124fecb2f82e838f81da22'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:39:22.768946 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-8f4968ba-241c-467b-8154-30054b397b72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa52f70a50124fecb2f82e838f81da22'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:39:22.775814 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-8f4968ba-241c-467b-8154-30054b397b72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa52f70a50124fecb2f82e838f81da22'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:39:22.792970 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1464/2923] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 20 22:39:22 2022] DELETE /identity/v3/users/aa52f70a50124fecb2f82e838f81da22 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:39:22.964075 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61e4de9-06b4-475c-84d0-829edaed9da5 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:39:22.965540 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-e61e4de9-06b4-475c-84d0-829edaed9da5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:39:22.979112 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61e4de9-06b4-475c-84d0-829edaed9da5 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:39:22.996701 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:39:23.041974 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851a311f-b563-49ac-b9d7-c31564340118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:39:23.042987 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851a311f-b563-49ac-b9d7-c31564340118 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:39:23.043491 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851a311f-b563-49ac-b9d7-c31564340118 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:39:23.044000 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851a311f-b563-49ac-b9d7-c31564340118 admin admin] PATH_INFO: `/v3/projects/f1900637cdb24c3389678214f9f1b719` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:39:23.045784 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851a311f-b563-49ac-b9d7-c31564340118 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1900637cdb24c3389678214f9f1b719)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:39:23.047739 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851a311f-b563-49ac-b9d7-c31564340118 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:39:23.098040 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-851a311f-b563-49ac-b9d7-c31564340118 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1900637cdb24c3389678214f9f1b719', 'request_id': 'req-851a311f-b563-49ac-b9d7-c31564340118'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:39:23.104144 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-851a311f-b563-49ac-b9d7-c31564340118 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1900637cdb24c3389678214f9f1b719', 'request_id': 'req-851a311f-b563-49ac-b9d7-c31564340118'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:39:23.111686 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-851a311f-b563-49ac-b9d7-c31564340118 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1900637cdb24c3389678214f9f1b719', 'request_id': 'req-851a311f-b563-49ac-b9d7-c31564340118'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:39:23.123290 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-851a311f-b563-49ac-b9d7-c31564340118 admin admin] The token cache is being invalidate because project f1900637cdb24c3389678214f9f1b719 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81307) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 22:39:23.123607 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-851a311f-b563-49ac-b9d7-c31564340118 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:39:23.124231 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-851a311f-b563-49ac-b9d7-c31564340118 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:39:23.125731 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1460/2924] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 20 22:39:22 2022] DELETE /identity/v3/projects/f1900637cdb24c3389678214f9f1b719 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:39:23.132712 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69192d47-d6cc-41f8-a3fb-289762025352 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:39:23.133000 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69192d47-d6cc-41f8-a3fb-289762025352 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:39:23.133273 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69192d47-d6cc-41f8-a3fb-289762025352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:39:23.152570 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-69192d47-d6cc-41f8-a3fb-289762025352 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:39:23.153771 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-69192d47-d6cc-41f8-a3fb-289762025352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:39:23.213770 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1465/2925] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:39:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 22:39:23.222417 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b630df77-8d98-4431-8107-e048d1bb4cd5 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:39:23.222740 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b630df77-8d98-4431-8107-e048d1bb4cd5 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:39:23.223022 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b630df77-8d98-4431-8107-e048d1bb4cd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:39:23.246791 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-b630df77-8d98-4431-8107-e048d1bb4cd5 None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:39:23.248008 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-b630df77-8d98-4431-8107-e048d1bb4cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:39:23.255896 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1461/2926] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:39:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:39:23.260119 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69192d47-d6cc-41f8-a3fb-289762025352 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:39:23.269868 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69192d47-d6cc-41f8-a3fb-289762025352 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:39:23.274557 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587e69d8-f722-470d-9132-0d09d4a66d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:39:23.275158 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587e69d8-f722-470d-9132-0d09d4a66d49 admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:39:23.275439 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587e69d8-f722-470d-9132-0d09d4a66d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:39:23.275712 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587e69d8-f722-470d-9132-0d09d4a66d49 admin admin] PATH_INFO: `/v3/domains` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:39:23.276355 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587e69d8-f722-470d-9132-0d09d4a66d49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81306) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 22:39:23.276658 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587e69d8-f722-470d-9132-0d09d4a66d49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:39:23.278247 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587e69d8-f722-470d-9132-0d09d4a66d49 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:39:23.290474 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1466/2927] 10.222.0.33 () {58 vars in 1153 bytes} [Tue Sep 20 22:39:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 22:39:23.294849 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b630df77-8d98-4431-8107-e048d1bb4cd5 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:39:23.305024 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b630df77-8d98-4431-8107-e048d1bb4cd5 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:39:23.309728 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64fbc2f-5f74-403b-91c6-a631d184deb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:39:23.310325 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64fbc2f-5f74-403b-91c6-a631d184deb0 admin admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:39:23.310643 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64fbc2f-5f74-403b-91c6-a631d184deb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:39:23.310917 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64fbc2f-5f74-403b-91c6-a631d184deb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:39:23.311546 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64fbc2f-5f74-403b-91c6-a631d184deb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:39:23.313438 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64fbc2f-5f74-403b-91c6-a631d184deb0 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:39:23.340339 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1462/2928] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 20 22:39:23 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:39:23.349042 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587e69d8-f722-470d-9132-0d09d4a66d49 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:39:23.359380 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587e69d8-f722-470d-9132-0d09d4a66d49 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:39:23.414729 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71ab8fb-e973-42c8-90d9-996da3d51ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:39:23.415329 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71ab8fb-e973-42c8-90d9-996da3d51ce3 admin admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:39:23.415605 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71ab8fb-e973-42c8-90d9-996da3d51ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:39:23.415871 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71ab8fb-e973-42c8-90d9-996da3d51ce3 admin admin] PATH_INFO: `/v3/users` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:39:23.416499 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71ab8fb-e973-42c8-90d9-996da3d51ce3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:39:23.418381 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71ab8fb-e973-42c8-90d9-996da3d51ce3 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:39:23.439358 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1467/2929] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 20 22:39:23 2022] POST /identity/v3/users => generated 292 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:39:23.443488 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64fbc2f-5f74-403b-91c6-a631d184deb0 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:39:23.453806 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64fbc2f-5f74-403b-91c6-a631d184deb0 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:39:23.458407 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e76c6c8-dfac-4930-a220-a42870dcc4b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:39:23.459026 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e76c6c8-dfac-4930-a220-a42870dcc4b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:39:23.459305 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e76c6c8-dfac-4930-a220-a42870dcc4b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:39:23.459577 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e76c6c8-dfac-4930-a220-a42870dcc4b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:39:23.460208 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e76c6c8-dfac-4930-a220-a42870dcc4b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:39:23.461783 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e76c6c8-dfac-4930-a220-a42870dcc4b7 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:39:23.471433 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1463/2930] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:39:23 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:39:23.475062 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71ab8fb-e973-42c8-90d9-996da3d51ce3 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:39:23.485256 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71ab8fb-e973-42c8-90d9-996da3d51ce3 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:39:23.489780 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3255a8f8-b397-49ea-9275-6f2eaa6a8a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:39:23.490364 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255a8f8-b397-49ea-9275-6f2eaa6a8a8d admin admin] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:39:23.490673 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255a8f8-b397-49ea-9275-6f2eaa6a8a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:39:23.490949 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255a8f8-b397-49ea-9275-6f2eaa6a8a8d admin admin] PATH_INFO: `/v3/roles` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:39:23.492201 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3255a8f8-b397-49ea-9275-6f2eaa6a8a8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:39:23.493770 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3255a8f8-b397-49ea-9275-6f2eaa6a8a8d admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:39:23.504269 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1468/2931] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:39:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:39:23.508107 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e76c6c8-dfac-4930-a220-a42870dcc4b7 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:39:23.518066 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e76c6c8-dfac-4930-a220-a42870dcc4b7 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:39:23.523154 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c37f5e-4d8a-4e67-9d48-5e7deb172da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:39:23.523786 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c37f5e-4d8a-4e67-9d48-5e7deb172da7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:39:23.524066 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c37f5e-4d8a-4e67-9d48-5e7deb172da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:39:23.524335 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c37f5e-4d8a-4e67-9d48-5e7deb172da7 admin admin] PATH_INFO: `/v3/projects/03b58a261336440b91bf44d7b4e494a7/users/e037afc506f043af8e72e3500abad42d/roles/604444e7ad0d437dbd1f5a6e02b761f5` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:39:23.539345 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c37f5e-4d8a-4e67-9d48-5e7deb172da7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03b58a261336440b91bf44d7b4e494a7, user_id=e037afc506f043af8e72e3500abad42d, role_id=604444e7ad0d437dbd1f5a6e02b761f5)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:39:23.542226 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c37f5e-4d8a-4e67-9d48-5e7deb172da7 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:39:23.554805 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1464/2932] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:39:23 2022] PUT /identity/v3/projects/03b58a261336440b91bf44d7b4e494a7/users/e037afc506f043af8e72e3500abad42d/roles/604444e7ad0d437dbd1f5a6e02b761f5 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:39:23.559634 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aca827-358b-495d-a78d-e2877d23ed2f None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:39:23.559933 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aca827-358b-495d-a78d-e2877d23ed2f None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:39:23.560217 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aca827-358b-495d-a78d-e2877d23ed2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:39:23.568276 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:39:23.579736 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-78aca827-358b-495d-a78d-e2877d23ed2f None None] MFA Rules not processed for user `85f4e64839754c658de5c3fe0e1220a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:39:23.580942 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-78aca827-358b-495d-a78d-e2877d23ed2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:39:23.638247 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1469/2933] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:39:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:39:23.648336 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c37f5e-4d8a-4e67-9d48-5e7deb172da7 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:39:23.650117 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-b5c37f5e-4d8a-4e67-9d48-5e7deb172da7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:39:23.701346 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:39:23.707611 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c37f5e-4d8a-4e67-9d48-5e7deb172da7 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:39:23.712768 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830ec870-a562-4fff-82eb-eed76b9e7612 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b0b3ca4ecd41aaba9cf8e0f91fbf54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:39:23.713379 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ec870-a562-4fff-82eb-eed76b9e7612 service neutron] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:39:23.713660 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ec870-a562-4fff-82eb-eed76b9e7612 service neutron] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:39:23.713933 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ec870-a562-4fff-82eb-eed76b9e7612 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:39:23.723161 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830ec870-a562-4fff-82eb-eed76b9e7612 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:39:23.724599 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830ec870-a562-4fff-82eb-eed76b9e7612 service neutron] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:39:23.734767 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1465/2934] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:39:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:39:27.609333 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a68a340-4cfb-46b0-b91d-43cf52576db5 None None] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:39:27.609880 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a68a340-4cfb-46b0-b91d-43cf52576db5 None None] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:39:27.609880 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a68a340-4cfb-46b0-b91d-43cf52576db5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:39:27.640361 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.auth.core [None req-9a68a340-4cfb-46b0-b91d-43cf52576db5 None None] MFA Rules not processed for user `e037afc506f043af8e72e3500abad42d`. Rule list: `[]` (Enabled: `True`). {{(pid=81306) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:39:27.641598 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-9a68a340-4cfb-46b0-b91d-43cf52576db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:39:27.709366 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1470/2935] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:39:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:39:27.713827 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830ec870-a562-4fff-82eb-eed76b9e7612 service neutron] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:39:27.724241 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830ec870-a562-4fff-82eb-eed76b9e7612 service neutron] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:39:27.729450 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c13a2a-b12f-445c-8716-6fd552ab859e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:39:27.730054 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c13a2a-b12f-445c-8716-6fd552ab859e admin admin] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:39:27.730546 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c13a2a-b12f-445c-8716-6fd552ab859e admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:39:27.730811 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c13a2a-b12f-445c-8716-6fd552ab859e admin admin] PATH_INFO: `/v3/projects` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:39:27.731466 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c13a2a-b12f-445c-8716-6fd552ab859e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:39:27.733401 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c13a2a-b12f-445c-8716-6fd552ab859e admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:39:27.761620 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1466/2936] 10.222.0.33 () {60 vars in 1153 bytes} [Tue Sep 20 22:39:27 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 22:39:27.765619 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a68a340-4cfb-46b0-b91d-43cf52576db5 None None] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:39:27.777036 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a68a340-4cfb-46b0-b91d-43cf52576db5 None None] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:39:27.836220 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eee9d12-d020-4daa-bfec-21c4b59bc6ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:39:27.836834 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eee9d12-d020-4daa-bfec-21c4b59bc6ad admin admin] REQUEST_METHOD: `POST` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:39:27.837111 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eee9d12-d020-4daa-bfec-21c4b59bc6ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:39:27.837382 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eee9d12-d020-4daa-bfec-21c4b59bc6ad admin admin] PATH_INFO: `/v3/users` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:39:27.838012 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eee9d12-d020-4daa-bfec-21c4b59bc6ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:39:27.839950 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eee9d12-d020-4daa-bfec-21c4b59bc6ad admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:39:27.862957 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1471/2937] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Sep 20 22:39:27 2022] POST /identity/v3/users => generated 298 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 20 22:39:27.867548 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c13a2a-b12f-445c-8716-6fd552ab859e admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:39:27.877900 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c13a2a-b12f-445c-8716-6fd552ab859e admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:39:27.882478 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4341c52-91d7-431f-9a9e-bd7e09dbb5eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:39:27.883118 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4341c52-91d7-431f-9a9e-bd7e09dbb5eb admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:39:27.883394 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4341c52-91d7-431f-9a9e-bd7e09dbb5eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:39:27.883660 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4341c52-91d7-431f-9a9e-bd7e09dbb5eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:39:27.884310 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4341c52-91d7-431f-9a9e-bd7e09dbb5eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:39:27.885910 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4341c52-91d7-431f-9a9e-bd7e09dbb5eb admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:39:27.897216 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1467/2938] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:39:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:39:27.901486 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eee9d12-d020-4daa-bfec-21c4b59bc6ad admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:39:27.912015 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eee9d12-d020-4daa-bfec-21c4b59bc6ad admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:39:27.918022 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581ed8dd-91d8-460c-835b-bfcf32d039d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:39:27.918854 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581ed8dd-91d8-460c-835b-bfcf32d039d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:39:27.919205 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581ed8dd-91d8-460c-835b-bfcf32d039d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:39:27.919539 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581ed8dd-91d8-460c-835b-bfcf32d039d6 admin admin] PATH_INFO: `/v3/projects/478888180fc344db866a4aeff82e5b4e/users/425c06b6d6f74299a6a403b0dbb206bc/roles/8a829170b29d42d6af589399e51edb0f` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:39:27.936187 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581ed8dd-91d8-460c-835b-bfcf32d039d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=478888180fc344db866a4aeff82e5b4e, user_id=425c06b6d6f74299a6a403b0dbb206bc, role_id=8a829170b29d42d6af589399e51edb0f)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:39:27.938875 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581ed8dd-91d8-460c-835b-bfcf32d039d6 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:39:27.948268 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:39:27.953498 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1472/2939] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:39:27 2022] PUT /identity/v3/projects/478888180fc344db866a4aeff82e5b4e/users/425c06b6d6f74299a6a403b0dbb206bc/roles/8a829170b29d42d6af589399e51edb0f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 22:39:27.957405 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4341c52-91d7-431f-9a9e-bd7e09dbb5eb admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:39:27.968028 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4341c52-91d7-431f-9a9e-bd7e09dbb5eb admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:39:28.025454 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8ecf6e-ba38-4289-9f8a-70c8677d4c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:39:28.026063 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8ecf6e-ba38-4289-9f8a-70c8677d4c8e admin admin] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:39:28.026338 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8ecf6e-ba38-4289-9f8a-70c8677d4c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:39:28.026641 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8ecf6e-ba38-4289-9f8a-70c8677d4c8e admin admin] PATH_INFO: `/v3/roles` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:39:28.027274 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8ecf6e-ba38-4289-9f8a-70c8677d4c8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:39:28.028865 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8ecf6e-ba38-4289-9f8a-70c8677d4c8e admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:39:28.040541 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1468/2940] 10.222.0.33 () {58 vars in 1122 bytes} [Tue Sep 20 22:39:27 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 22:39:28.044281 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581ed8dd-91d8-460c-835b-bfcf32d039d6 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:39:28.054666 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581ed8dd-91d8-460c-835b-bfcf32d039d6 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:39:28.059537 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b26061e-ebba-468b-8dc2-bb6f48cad9f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:39:28.060466 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b26061e-ebba-468b-8dc2-bb6f48cad9f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:39:28.060752 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b26061e-ebba-468b-8dc2-bb6f48cad9f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:39:28.061035 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b26061e-ebba-468b-8dc2-bb6f48cad9f2 admin admin] PATH_INFO: `/v3/projects/478888180fc344db866a4aeff82e5b4e/users/425c06b6d6f74299a6a403b0dbb206bc/roles/8a829170b29d42d6af589399e51edb0f` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:39:28.063091 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b26061e-ebba-468b-8dc2-bb6f48cad9f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=478888180fc344db866a4aeff82e5b4e, user_id=425c06b6d6f74299a6a403b0dbb206bc, role_id=8a829170b29d42d6af589399e51edb0f)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:39:28.065768 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b26061e-ebba-468b-8dc2-bb6f48cad9f2 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:39:28.077654 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1473/2941] 10.222.0.33 () {60 vars in 1483 bytes} [Tue Sep 20 22:39:28 2022] PUT /identity/v3/projects/478888180fc344db866a4aeff82e5b4e/users/425c06b6d6f74299a6a403b0dbb206bc/roles/8a829170b29d42d6af589399e51edb0f => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:39:32.883115 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34960722-c56a-4fe6-9790-fb4c6a492a73 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:39:32.883646 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34960722-c56a-4fe6-9790-fb4c6a492a73 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:39:32.883822 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34960722-c56a-4fe6-9790-fb4c6a492a73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:39:32.914301 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-34960722-c56a-4fe6-9790-fb4c6a492a73 None None] MFA Rules not processed for user `425c06b6d6f74299a6a403b0dbb206bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:39:32.915823 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-34960722-c56a-4fe6-9790-fb4c6a492a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:39:32.990434 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1469/2942] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:39:32 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:39:33.004161 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b26061e-ebba-468b-8dc2-bb6f48cad9f2 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:39:33.005899 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-1b26061e-ebba-468b-8dc2-bb6f48cad9f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:39:33.090004 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b26061e-ebba-468b-8dc2-bb6f48cad9f2 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:39:33.093821 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5a5281-b400-4771-a7f1-5ca7cb504795 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbecfbbf24fd425ca99499fd44d8c7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:39:33.094672 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5a5281-b400-4771-a7f1-5ca7cb504795 service glance] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:39:33.094955 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5a5281-b400-4771-a7f1-5ca7cb504795 service glance] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:39:33.095234 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5a5281-b400-4771-a7f1-5ca7cb504795 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:39:33.157721 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5a5281-b400-4771-a7f1-5ca7cb504795 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:39:33.159431 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5a5281-b400-4771-a7f1-5ca7cb504795 service glance] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:39:33.169663 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1474/2943] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:39:33 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:39:33.307037 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c130203-52f1-43d8-94d2-2deff820cdcb None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:39:33.307409 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c130203-52f1-43d8-94d2-2deff820cdcb None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:39:33.307753 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c130203-52f1-43d8-94d2-2deff820cdcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:39:33.364616 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-1c130203-52f1-43d8-94d2-2deff820cdcb None None] MFA Rules not processed for user `e916748fdee84c34af034e75a919b986`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:39:33.365847 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-1c130203-52f1-43d8-94d2-2deff820cdcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:39:33.375074 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:39:33.435066 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1470/2944] 10.222.0.33 () {58 vars in 1009 bytes} [Tue Sep 20 22:39:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:39:33.483890 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5a5281-b400-4771-a7f1-5ca7cb504795 service glance] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:39:33.485311 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-dc5a5281-b400-4771-a7f1-5ca7cb504795 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:39:33.577213 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:39:33.580095 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5a5281-b400-4771-a7f1-5ca7cb504795 service glance] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:39:33.586135 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97c33b8-3044-465d-af4f-3145e6a64608 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '257983500d7b430c8f0377b2aa743ae0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:39:33.586772 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97c33b8-3044-465d-af4f-3145e6a64608 service swift] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:39:33.587055 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97c33b8-3044-465d-af4f-3145e6a64608 service swift] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:39:33.587328 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97c33b8-3044-465d-af4f-3145e6a64608 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:39:33.595641 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97c33b8-3044-465d-af4f-3145e6a64608 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:39:33.597208 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97c33b8-3044-465d-af4f-3145e6a64608 service swift] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:39:33.605391 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1475/2945] 10.222.0.33 () {60 vars in 1384 bytes} [Tue Sep 20 22:39:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 20 22:39:42.308359 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de7208c-4ba5-4184-9044-833528f24362 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:39:42.308761 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de7208c-4ba5-4184-9044-833528f24362 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:39:42.308899 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de7208c-4ba5-4184-9044-833528f24362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:39:42.328192 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-0de7208c-4ba5-4184-9044-833528f24362 None None] MFA Rules not processed for user `e037afc506f043af8e72e3500abad42d`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:39:42.329389 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-0de7208c-4ba5-4184-9044-833528f24362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:39:42.336207 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1471/2946] 10.222.0.33 () {58 vars in 958 bytes} [Tue Sep 20 22:39:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:39:42.894279 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97c33b8-3044-465d-af4f-3145e6a64608 service swift] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:39:42.951597 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97c33b8-3044-465d-af4f-3145e6a64608 service swift] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:39:42.957213 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a6fe3e-473f-4db0-b34e-55592079f5d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b0b3ca4ecd41aaba9cf8e0f91fbf54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:39:42.958084 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a6fe3e-473f-4db0-b34e-55592079f5d8 service neutron] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:39:42.958434 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a6fe3e-473f-4db0-b34e-55592079f5d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:39:42.958998 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a6fe3e-473f-4db0-b34e-55592079f5d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:39:42.960994 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-45a6fe3e-473f-4db0-b34e-55592079f5d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:39:43.037028 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a6fe3e-473f-4db0-b34e-55592079f5d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:39:43.039135 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a6fe3e-473f-4db0-b34e-55592079f5d8 service neutron] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:39:43.050891 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1476/2947] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:39:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:39:44.106068 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c3a5d3-3b72-4528-8084-88df19f47d09 None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:39:44.106560 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c3a5d3-3b72-4528-8084-88df19f47d09 None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:39:44.106674 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c3a5d3-3b72-4528-8084-88df19f47d09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:39:44.129242 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-92c3a5d3-3b72-4528-8084-88df19f47d09 None None] MFA Rules not processed for user `e916748fdee84c34af034e75a919b986`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:39:44.130116 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-92c3a5d3-3b72-4528-8084-88df19f47d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:39:44.140131 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1472/2948] 10.222.0.33 () {58 vars in 1009 bytes} [Tue Sep 20 22:39:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 22:39:44.152998 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a6fe3e-473f-4db0-b34e-55592079f5d8 service neutron] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:39:44.167502 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a6fe3e-473f-4db0-b34e-55592079f5d8 service neutron] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:39:44.173160 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad98ed19-71dc-4874-a232-50b5b7f72bd1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '257983500d7b430c8f0377b2aa743ae0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:39:44.173853 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad98ed19-71dc-4874-a232-50b5b7f72bd1 service swift] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:39:44.174211 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad98ed19-71dc-4874-a232-50b5b7f72bd1 service swift] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:39:44.174618 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad98ed19-71dc-4874-a232-50b5b7f72bd1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:39:44.183674 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad98ed19-71dc-4874-a232-50b5b7f72bd1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:39:44.185246 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad98ed19-71dc-4874-a232-50b5b7f72bd1 service swift] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:39:44.193275 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1477/2949] 10.222.0.33 () {60 vars in 1384 bytes} [Tue Sep 20 22:39:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 20 22:39:46.477295 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c3a5d3-3b72-4528-8084-88df19f47d09 None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:39:46.478763 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-92c3a5d3-3b72-4528-8084-88df19f47d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:39:46.493640 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c3a5d3-3b72-4528-8084-88df19f47d09 None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:39:46.497391 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d720ace-24a6-47a4-83ae-d7746fc10d98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b0b3ca4ecd41aaba9cf8e0f91fbf54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:39:46.498001 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d720ace-24a6-47a4-83ae-d7746fc10d98 service neutron] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:39:46.498280 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d720ace-24a6-47a4-83ae-d7746fc10d98 service neutron] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:39:46.498572 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d720ace-24a6-47a4-83ae-d7746fc10d98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:39:46.500437 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-0d720ace-24a6-47a4-83ae-d7746fc10d98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:39:46.516382 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d720ace-24a6-47a4-83ae-d7746fc10d98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:39:46.517976 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d720ace-24a6-47a4-83ae-d7746fc10d98 service neutron] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:39:46.531934 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1473/2950] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:39:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:39:54.190079 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=64 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:39:56.525951 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=35 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:40:02.118284 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad98ed19-71dc-4874-a232-50b5b7f72bd1 service swift] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:40:02.127834 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad98ed19-71dc-4874-a232-50b5b7f72bd1 service swift] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:40:02.132017 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f05f4c7-2213-456a-99b1-0cc1286c6b3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b0b3ca4ecd41aaba9cf8e0f91fbf54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:40:02.132609 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f05f4c7-2213-456a-99b1-0cc1286c6b3b service neutron] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:40:02.132888 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f05f4c7-2213-456a-99b1-0cc1286c6b3b service neutron] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:40:02.133160 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f05f4c7-2213-456a-99b1-0cc1286c6b3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:40:02.134997 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-6f05f4c7-2213-456a-99b1-0cc1286c6b3b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:40:02.144562 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f05f4c7-2213-456a-99b1-0cc1286c6b3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:40:02.145964 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f05f4c7-2213-456a-99b1-0cc1286c6b3b service neutron] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:40:02.154946 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1478/2951] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:40:02 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:40:09.070388 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d720ace-24a6-47a4-83ae-d7746fc10d98 service neutron] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:40:09.079063 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d720ace-24a6-47a4-83ae-d7746fc10d98 service neutron] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:40:09.082633 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e2c42d-1d71-49e2-999d-32f247d88f8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9b0b3ca4ecd41aaba9cf8e0f91fbf54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:40:09.083229 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e2c42d-1d71-49e2-999d-32f247d88f8c service neutron] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:40:09.083508 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e2c42d-1d71-49e2-999d-32f247d88f8c service neutron] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:40:09.083776 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e2c42d-1d71-49e2-999d-32f247d88f8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:40:09.093197 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e2c42d-1d71-49e2-999d-32f247d88f8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:40:09.094661 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e2c42d-1d71-49e2-999d-32f247d88f8c service neutron] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:40:09.104096 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1474/2952] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:40:09 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:40:12.150400 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=6 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:40:19.099925 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=6 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:42:11.559289 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f05f4c7-2213-456a-99b1-0cc1286c6b3b service neutron] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:42:11.562787 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-6f05f4c7-2213-456a-99b1-0cc1286c6b3b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:42:11.700576 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f05f4c7-2213-456a-99b1-0cc1286c6b3b service neutron] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:42:11.705647 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ecd64f-657a-4d83-be3c-dd40a4982cb5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c79676ee86294dab92ba732e38d6fa74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:42:11.706246 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ecd64f-657a-4d83-be3c-dd40a4982cb5 service placement] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:42:11.706545 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ecd64f-657a-4d83-be3c-dd40a4982cb5 service placement] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:42:11.706822 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ecd64f-657a-4d83-be3c-dd40a4982cb5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:42:11.708504 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-75ecd64f-657a-4d83-be3c-dd40a4982cb5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:42:11.719721 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ecd64f-657a-4d83-be3c-dd40a4982cb5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:42:11.721286 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ecd64f-657a-4d83-be3c-dd40a4982cb5 service placement] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:42:11.731046 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1479/2953] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:42:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:42:21.726849 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=63 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:42:29.326404 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e2c42d-1d71-49e2-999d-32f247d88f8c service neutron] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:42:29.328326 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-a4e2c42d-1d71-49e2-999d-32f247d88f8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:42:29.400877 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e2c42d-1d71-49e2-999d-32f247d88f8c service neutron] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:42:29.407498 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6bbfa7-746e-4ab7-8781-8e6be70446ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db7eed561e99452289a662ad326cf919', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:42:29.408115 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6bbfa7-746e-4ab7-8781-8e6be70446ca service nova] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:42:29.408392 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6bbfa7-746e-4ab7-8781-8e6be70446ca service nova] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:42:29.408772 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6bbfa7-746e-4ab7-8781-8e6be70446ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:42:29.410570 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-5e6bbfa7-746e-4ab7-8781-8e6be70446ca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:42:29.424528 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6bbfa7-746e-4ab7-8781-8e6be70446ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:42:29.426402 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6bbfa7-746e-4ab7-8781-8e6be70446ca service nova] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:42:29.438568 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1475/2954] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:42:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:42:35.308712 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ecd64f-657a-4d83-be3c-dd40a4982cb5 service placement] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:42:35.310489 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-75ecd64f-657a-4d83-be3c-dd40a4982cb5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:42:35.327839 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ecd64f-657a-4d83-be3c-dd40a4982cb5 service placement] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:42:35.333726 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803e5641-2204-42cb-8683-beba2d7fc6f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db7eed561e99452289a662ad326cf919', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:42:35.334966 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803e5641-2204-42cb-8683-beba2d7fc6f5 service nova] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:42:35.335234 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803e5641-2204-42cb-8683-beba2d7fc6f5 service nova] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:42:35.335509 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803e5641-2204-42cb-8683-beba2d7fc6f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:42:35.337258 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-803e5641-2204-42cb-8683-beba2d7fc6f5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:42:35.350167 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803e5641-2204-42cb-8683-beba2d7fc6f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:42:35.351792 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803e5641-2204-42cb-8683-beba2d7fc6f5 service nova] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:42:35.363389 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1480/2955] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:42:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:42:36.520009 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0490f0-c3f1-4f29-ae84-66471cbd32ef None None] REQUEST_METHOD: `POST` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:42:36.520452 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0490f0-c3f1-4f29-ae84-66471cbd32ef None None] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:42:36.520557 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0490f0-c3f1-4f29-ae84-66471cbd32ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:42:36.550418 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.auth.core [None req-6c0490f0-c3f1-4f29-ae84-66471cbd32ef None None] MFA Rules not processed for user `e916748fdee84c34af034e75a919b986`. Rule list: `[]` (Enabled: `True`). {{(pid=81307) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 22:42:36.551576 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-6c0490f0-c3f1-4f29-ae84-66471cbd32ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:42:36.558690 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1476/2956] 10.222.0.33 () {58 vars in 967 bytes} [Tue Sep 20 22:42:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 22:42:36.599259 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803e5641-2204-42cb-8683-beba2d7fc6f5 service nova] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:42:36.613226 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803e5641-2204-42cb-8683-beba2d7fc6f5 service nova] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:42:36.618142 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768eecb5-ee1d-4041-9c5c-8e9cd37de6f5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '257983500d7b430c8f0377b2aa743ae0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:42:36.618788 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768eecb5-ee1d-4041-9c5c-8e9cd37de6f5 service swift] REQUEST_METHOD: `GET` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:42:36.619067 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768eecb5-ee1d-4041-9c5c-8e9cd37de6f5 service swift] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:42:36.619333 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768eecb5-ee1d-4041-9c5c-8e9cd37de6f5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:42:36.627460 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768eecb5-ee1d-4041-9c5c-8e9cd37de6f5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:42:36.629009 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768eecb5-ee1d-4041-9c5c-8e9cd37de6f5 service swift] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:42:36.637388 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1481/2957] 10.222.0.33 () {60 vars in 1384 bytes} [Tue Sep 20 22:42:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 20 22:42:43.212500 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0490f0-c3f1-4f29-ae84-66471cbd32ef None None] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:42:43.309403 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0490f0-c3f1-4f29-ae84-66471cbd32ef None None] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:42:43.315971 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c9e8be-d478-4d5f-9fdd-a96e8ef46d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:42:43.316631 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c9e8be-d478-4d5f-9fdd-a96e8ef46d37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:42:43.316914 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c9e8be-d478-4d5f-9fdd-a96e8ef46d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:42:43.317192 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c9e8be-d478-4d5f-9fdd-a96e8ef46d37 admin admin] PATH_INFO: `/v3/users/e037afc506f043af8e72e3500abad42d` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:42:43.319060 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c9e8be-d478-4d5f-9fdd-a96e8ef46d37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e037afc506f043af8e72e3500abad42d)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:42:43.321030 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c9e8be-d478-4d5f-9fdd-a96e8ef46d37 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:42:43.368750 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-f1c9e8be-d478-4d5f-9fdd-a96e8ef46d37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e037afc506f043af8e72e3500abad42d'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:42:43.377178 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-f1c9e8be-d478-4d5f-9fdd-a96e8ef46d37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e037afc506f043af8e72e3500abad42d'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:42:43.377807 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-f1c9e8be-d478-4d5f-9fdd-a96e8ef46d37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e037afc506f043af8e72e3500abad42d'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:42:43.378401 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-f1c9e8be-d478-4d5f-9fdd-a96e8ef46d37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e037afc506f043af8e72e3500abad42d'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:42:43.385444 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-f1c9e8be-d478-4d5f-9fdd-a96e8ef46d37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e037afc506f043af8e72e3500abad42d'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:42:43.396302 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:42:43.403648 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1477/2958] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 20 22:42:43 2022] DELETE /identity/v3/users/e037afc506f043af8e72e3500abad42d => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:42:43.579119 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768eecb5-ee1d-4041-9c5c-8e9cd37de6f5 service swift] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:42:43.589724 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768eecb5-ee1d-4041-9c5c-8e9cd37de6f5 service swift] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:42:43.654790 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe1a6ca-cecb-404e-abd7-7a4085e0b544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:42:43.655417 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe1a6ca-cecb-404e-abd7-7a4085e0b544 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:42:43.655695 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe1a6ca-cecb-404e-abd7-7a4085e0b544 admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:42:43.655993 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe1a6ca-cecb-404e-abd7-7a4085e0b544 admin admin] PATH_INFO: `/v3/projects/03b58a261336440b91bf44d7b4e494a7` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:42:43.657309 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe1a6ca-cecb-404e-abd7-7a4085e0b544 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03b58a261336440b91bf44d7b4e494a7)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:42:43.659541 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe1a6ca-cecb-404e-abd7-7a4085e0b544 admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:42:43.707402 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-dbe1a6ca-cecb-404e-abd7-7a4085e0b544 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03b58a261336440b91bf44d7b4e494a7', 'request_id': 'req-dbe1a6ca-cecb-404e-abd7-7a4085e0b544'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:42:43.713947 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-dbe1a6ca-cecb-404e-abd7-7a4085e0b544 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03b58a261336440b91bf44d7b4e494a7', 'request_id': 'req-dbe1a6ca-cecb-404e-abd7-7a4085e0b544'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:42:43.721567 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-dbe1a6ca-cecb-404e-abd7-7a4085e0b544 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03b58a261336440b91bf44d7b4e494a7', 'request_id': 'req-dbe1a6ca-cecb-404e-abd7-7a4085e0b544'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:42:43.744871 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-dbe1a6ca-cecb-404e-abd7-7a4085e0b544 admin admin] The token cache is being invalidate because project 03b58a261336440b91bf44d7b4e494a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81306) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 22:42:43.745092 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-dbe1a6ca-cecb-404e-abd7-7a4085e0b544 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:42:43.745717 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-dbe1a6ca-cecb-404e-abd7-7a4085e0b544 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:42:43.747303 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1482/2959] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 20 22:42:43 2022] DELETE /identity/v3/projects/03b58a261336440b91bf44d7b4e494a7 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:42:43.751271 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c9e8be-d478-4d5f-9fdd-a96e8ef46d37 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:42:43.752693 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-f1c9e8be-d478-4d5f-9fdd-a96e8ef46d37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:42:43.765487 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c9e8be-d478-4d5f-9fdd-a96e8ef46d37 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:42:43.821946 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c830ec-5998-472e-9886-8668aec386b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:42:43.822616 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c830ec-5998-472e-9886-8668aec386b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:42:43.822897 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c830ec-5998-472e-9886-8668aec386b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:42:43.823166 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c830ec-5998-472e-9886-8668aec386b9 admin admin] PATH_INFO: `/v3/users/425c06b6d6f74299a6a403b0dbb206bc` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:42:43.824271 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c830ec-5998-472e-9886-8668aec386b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=425c06b6d6f74299a6a403b0dbb206bc)` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:42:43.826260 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c830ec-5998-472e-9886-8668aec386b9 admin admin] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:42:43.871877 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-b9c830ec-5998-472e-9886-8668aec386b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '425c06b6d6f74299a6a403b0dbb206bc'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:42:43.879046 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-b9c830ec-5998-472e-9886-8668aec386b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '425c06b6d6f74299a6a403b0dbb206bc'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:42:43.879678 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-b9c830ec-5998-472e-9886-8668aec386b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '425c06b6d6f74299a6a403b0dbb206bc'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:42:43.880360 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-b9c830ec-5998-472e-9886-8668aec386b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '425c06b6d6f74299a6a403b0dbb206bc'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:42:43.887287 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.notifications [None req-b9c830ec-5998-472e-9886-8668aec386b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '425c06b6d6f74299a6a403b0dbb206bc'} {{(pid=81307) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:42:43.904893 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1478/2960] 10.222.0.33 () {58 vars in 1224 bytes} [Tue Sep 20 22:42:43 2022] DELETE /identity/v3/users/425c06b6d6f74299a6a403b0dbb206bc => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 22:42:44.075967 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe1a6ca-cecb-404e-abd7-7a4085e0b544 admin admin] Authenticating user token {{(pid=81306) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:42:44.077391 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.fernet_utils [None req-dbe1a6ca-cecb-404e-abd7-7a4085e0b544 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81306) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:42:44.092159 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe1a6ca-cecb-404e-abd7-7a4085e0b544 admin admin] Validating token access rules against request {{(pid=81306) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:42:44.140800 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:42:44.151945 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821e973b-c278-4ac7-93a7-97132603ea8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f4e64839754c658de5c3fe0e1220a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b201745482554bcb8321485927bbaae5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81306) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:42:44.152781 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821e973b-c278-4ac7-93a7-97132603ea8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:42:44.153062 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821e973b-c278-4ac7-93a7-97132603ea8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:42:44.153338 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821e973b-c278-4ac7-93a7-97132603ea8d admin admin] PATH_INFO: `/v3/projects/478888180fc344db866a4aeff82e5b4e` {{(pid=81306) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:42:44.154449 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821e973b-c278-4ac7-93a7-97132603ea8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=478888180fc344db866a4aeff82e5b4e)` {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:42:44.156382 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821e973b-c278-4ac7-93a7-97132603ea8d admin admin] RBAC: Authorization granted {{(pid=81306) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:42:44.201878 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-821e973b-c278-4ac7-93a7-97132603ea8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '478888180fc344db866a4aeff82e5b4e', 'request_id': 'req-821e973b-c278-4ac7-93a7-97132603ea8d'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:42:44.208043 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-821e973b-c278-4ac7-93a7-97132603ea8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '478888180fc344db866a4aeff82e5b4e', 'request_id': 'req-821e973b-c278-4ac7-93a7-97132603ea8d'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:42:44.215592 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-821e973b-c278-4ac7-93a7-97132603ea8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '478888180fc344db866a4aeff82e5b4e', 'request_id': 'req-821e973b-c278-4ac7-93a7-97132603ea8d'} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:42:44.226332 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-821e973b-c278-4ac7-93a7-97132603ea8d admin admin] The token cache is being invalidate because project 478888180fc344db866a4aeff82e5b4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81306) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 22:42:44.226639 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-821e973b-c278-4ac7-93a7-97132603ea8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:42:44.227274 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG keystone.notifications [None req-821e973b-c278-4ac7-93a7-97132603ea8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81306) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 22:42:44.228726 dv-cinder-858276-1-smb devstack@keystone.service[81306]: [pid: 81306|app: 0|req: 1483/2961] 10.222.0.33 () {58 vars in 1233 bytes} [Tue Sep 20 22:42:44 2022] DELETE /identity/v3/projects/478888180fc344db866a4aeff82e5b4e => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 22:42:53.901211 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=55,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:42:54.223335 dv-cinder-858276-1-smb devstack@keystone.service[81306]: DEBUG dbcounter [-] [81306] Writing DB stats keystone:SELECT=27,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 22:47:17.551646 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c830ec-5998-472e-9886-8668aec386b9 admin admin] Authenticating user token {{(pid=81307) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 22:47:17.553576 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-b9c830ec-5998-472e-9886-8668aec386b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:47:17.620888 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c830ec-5998-472e-9886-8668aec386b9 admin admin] Validating token access rules against request {{(pid=81307) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 22:47:17.678353 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4da10f-bc24-415f-a7b3-2c51a118dbfe service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c79676ee86294dab92ba732e38d6fa74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ce415d02aa9489bae19cd514805fd8c', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81307) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 22:47:17.678989 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4da10f-bc24-415f-a7b3-2c51a118dbfe service placement] REQUEST_METHOD: `GET` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 22:47:17.679267 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4da10f-bc24-415f-a7b3-2c51a118dbfe service placement] SCRIPT_NAME: `/identity` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 22:47:17.679540 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4da10f-bc24-415f-a7b3-2c51a118dbfe service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81307) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 22:47:17.681269 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.fernet_utils [None req-5c4da10f-bc24-415f-a7b3-2c51a118dbfe service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81307) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 22:47:17.692840 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4da10f-bc24-415f-a7b3-2c51a118dbfe service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 22:47:17.694392 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4da10f-bc24-415f-a7b3-2c51a118dbfe service placement] RBAC: Authorization granted {{(pid=81307) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 22:47:17.704047 dv-cinder-858276-1-smb devstack@keystone.service[81307]: [pid: 81307|app: 0|req: 1479/2962] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Sep 20 22:47:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 22:47:27.699880 dv-cinder-858276-1-smb devstack@keystone.service[81307]: DEBUG dbcounter [-] [81307] Writing DB stats keystone:SELECT=58 {{(pid=81307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}